Sep 08 06:36:10 devstack cinder-volume[76534]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 08 06:36:10 devstack cinder-volume[76534]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 08 06:36:10 devstack cinder-volume[76534]: we strongly recommend against using it for new projects. Sep 08 06:36:10 devstack cinder-volume[76534]: If you are already using Eventlet, we recommend migrating to a different Sep 08 06:36:10 devstack cinder-volume[76534]: framework. For more detail see Sep 08 06:36:10 devstack cinder-volume[76534]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 08 06:36:10 devstack cinder-volume[76534]: import eventlet # noqa Sep 08 06:36:13 devstack cinder-volume[76534]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76534) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 08 06:36:13 devstack cinder-volume[76534]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76534) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 08 06:36:13 devstack cinder-volume[76534]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76534) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 08 06:36:14 devstack cinder-volume[76534]: INFO dbcounter [None req-1f159300-7424-4902-af27-43172761408f None None] Registered counter for database cinder Sep 08 06:36:14 devstack cinder-volume[76534]: DEBUG oslo_db.sqlalchemy.engines [None req-1f159300-7424-4902-af27-43172761408f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76534) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG dbcounter [-] [76534] Writer thread running {{(pid=76534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 08 06:36:15 devstack cinder-volume[76534]: INFO cinder.rpc [None req-1f159300-7424-4902-af27-43172761408f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 08 06:36:15 devstack cinder-volume[76534]: INFO cinder.rpc [None req-1f159300-7424-4902-af27-43172761408f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_db.sqlalchemy.engines [None req-1f159300-7424-4902-af27-43172761408f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76534) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 08 06:36:15 devstack cinder-volume[76534]: INFO cinder.volume.manager [None req-1f159300-7424-4902-af27-43172761408f None None] Determined volume DB was empty at startup. Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG cinder.volume.manager [None req-1f159300-7424-4902-af27-43172761408f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76534) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 08 06:36:15 devstack cinder-volume[76534]: INFO cinder.volume.manager [None req-1f159300-7424-4902-af27-43172761408f None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 08 06:36:15 devstack cinder-volume[76534]: WARNING stevedore.named [None req-1f159300-7424-4902-af27-43172761408f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 08 06:36:15 devstack cinder-volume[76534]: WARNING castellan.key_manager [None req-1f159300-7424-4902-af27-43172761408f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 08 06:36:15 devstack cinder-volume[76534]: WARNING cinder.keymgr.conf_key_mgr [None req-1f159300-7424-4902-af27-43172761408f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG cinder.volume.drivers.lvm [None req-1f159300-7424-4902-af27-43172761408f None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76534) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-1f159300-7424-4902-af27-43172761408f None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_concurrency.processutils [None req-1f159300-7424-4902-af27-43172761408f None None] CMD "cinder-rtstool verify" returned: 0 in 0.398s {{(pid=76534) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_db.sqlalchemy.engines [None req-1f159300-7424-4902-af27-43172761408f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76534) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 08 06:36:15 devstack cinder-volume[76534]: INFO cinder.rpc [None req-1f159300-7424-4902-af27-43172761408f None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 08 06:36:15 devstack cinder-volume[76534]: INFO cinder.rpc [None req-1f159300-7424-4902-af27-43172761408f None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 08 06:36:15 devstack cinder-volume[76534]: WARNING stevedore.named [None req-1f159300-7424-4902-af27-43172761408f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 08 06:36:15 devstack cinder-volume[76534]: WARNING castellan.key_manager [None req-1f159300-7424-4902-af27-43172761408f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 08 06:36:15 devstack cinder-volume[76534]: INFO cinder.volume.manager [None req-1f159300-7424-4902-af27-43172761408f None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_db.sqlalchemy.engines [None req-1f159300-7424-4902-af27-43172761408f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76534) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 08 06:36:15 devstack cinder-volume[76534]: INFO oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] Starting 1 workers Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] Started child 76681 {{(pid=76534) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] Full set of CONF: {{(pid=76534) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] ******************************************************************************** {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] Configuration options gathered from: {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] ================================================================================ {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] allow_availability_zone_fallback = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] allow_compression_on_image_upload = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76681]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] allowed_direct_url_schemes = [] {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] api_rate_limit = True {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] auth_strategy = keystone {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] az_cache_duration = 3600 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_availability_zone = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_host = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_name = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_stats_polling_interval = 60 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backup_api_class = cinder.backup.api.API {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backup_name_template = backup-%s {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backup_use_same_host = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backup_use_temp_snapshot = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] chap_password = **** {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] chap_username = {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] cinder_internal_tenant_project_id = 955d53d82db04a9382251268e397d2c8 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] cinder_internal_tenant_user_id = 0c1ec087147f4577a1634d9e6801ec71 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] cloned_volume_same_az = True {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] cluster = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] compression_format = gzip {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] compute_api_class = cinder.compute.nova.API {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] config_dir = [] {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] config_source = [] {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] control_exchange = openstack {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] debug = True {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] default_availability_zone = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] default_group_type = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] default_volume_type = lvmdriver-1 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] disk_geometry = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] driver_client_cert = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] driver_client_cert_key = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] driver_data_namespace = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] driver_ssl_cert_path = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] driver_ssl_cert_verify = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] driver_use_ssl = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] enable_force_upload = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] enable_new_services = True {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] enable_unsupported_driver = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] enabled_backends = ['lvmdriver-1'] {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] enforce_multipath_for_image_xfer = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] filter_function = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] glance_api_insecure = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] glance_api_servers = ['http://192.168.122.168/image'] {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] glance_api_ssl_compression = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] glance_ca_certificates_file = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] glance_catalog_info = image:glance:publicURL {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] glance_certfile = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] glance_keyfile = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] glance_num_retries = 3 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] glance_request_timeout = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] goodness_function = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] graceful_shutdown_timeout = 5 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] group_api_class = cinder.group.api.API {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] host = devstack {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76681]: INFO cinder.volume.manager [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] image_compress_on_upload = True {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] image_conversion_address_space_limit = 1 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] image_conversion_cpu_limit = 60 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] image_conversion_disable = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] image_upload_use_cinder_backend = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] image_upload_use_internal_tenant = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] image_volume_cache_enabled = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] image_volume_cache_max_count = 0 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] image_volume_cache_max_size_gb = 0 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] init_host_max_objects_retrieval = 0 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] instance_format = [instance: %(uuid)s] {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] iscsi_target_flags = {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] iscsi_write_cache = on {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] iser_helper = tgtadm {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] iser_ip_address = 192.168.122.168 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] iser_port = 3260 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] log_color = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] log_config_append = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] log_dir = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] log_file = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] log_options = True {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] log_rotate_interval = 1 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] log_rotate_interval_type = days {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] log_rotation_type = none {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] max_age = 0 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] max_logfile_count = 30 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] max_logfile_size_mb = 200 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] max_over_subscription_ratio = 20.0 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] message_reap_interval = 86400 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] message_ttl = 2592000 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] migration_create_volume_timeout_secs = 300 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] monkey_patch = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] monkey_patch_modules = [] {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] my_ip = 192.168.122.168 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] no_snapshot_gb_quota = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] num_iser_scan_tries = 3 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] num_shell_tries = 3 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] num_volume_device_scan_tries = 3 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] nvmeof_conn_info_version = 1 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] nvmet_ns_id = 10 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] nvmet_port_id = 1 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] osapi_max_limit = 1000 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] osapi_volume_ext_list = [] {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] osapi_volume_listen = 0.0.0.0 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] osapi_volume_listen_port = 8776 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] osapi_volume_use_ssl = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] osapi_volume_workers = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] per_volume_size_limit = -1 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] periodic_fuzzy_delay = 60 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] periodic_interval = 60 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] project_id_regex = [0-9a-f\-]+ {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] public_endpoint = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] publish_errors = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] quota_backup_gigabytes = 1000 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] quota_backups = 10 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] quota_gigabytes = 1000 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] quota_groups = 10 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] quota_snapshots = 10 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] quota_volumes = 10 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] rate_limit_burst = 0 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] rate_limit_except_level = CRITICAL {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] rate_limit_interval = 0 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] reinit_driver_count = 3 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] replication_device = **** {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] report_discard_supported = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] report_interval = 120 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] reservation_clean_interval = 86400 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] reservation_expire = 86400 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] reserved_image_namespaces = [] {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] reserved_percentage = 0 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] rpc_response_timeout = 120 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] run_external_periodic_tasks = True {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] scst_target_driver = iscsi {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] scst_target_iqn_name = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] service_down_time = 720 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] shell_completion = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] snapshot_name_template = snapshot-%s {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] snapshot_same_host = True {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] split_loggers = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] state_path = /opt/stack/data/cinder {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] storage_availability_zone = nova {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] storage_protocol = iSCSI {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] syslog_log_facility = LOG_USER {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] target_helper = lioadm {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] target_ip_address = 192.168.122.168 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] target_port = 3260 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] target_protocol = iscsi {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] target_secondary_ip_addresses = [] {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] trace_flags = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] transfer_api_class = cinder.transfer.api.API {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] transport_url = **** {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] until_refresh = 0 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] use_chap_auth = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] use_default_quota_class = True {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] use_journal = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] use_json = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] use_multipath_for_image_xfer = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] use_stderr = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] use_syslog = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] verify_glance_signatures = enabled {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] volume_api_class = cinder.volume.api.API {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:15 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] volume_backend_name = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:16 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:36:16 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] volume_clear = zero {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] volume_clear_ionice = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] volume_clear_size = 0 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] volume_copy_bps_limit = 0 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] volume_dd_blocksize = 1M {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] volume_name_template = volume-%s {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] volume_service_inithost_offload = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] volume_usage_audit_period = month {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] zoning_mode = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] oslo_concurrency.disable_process_locking = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] keystone_authtoken.auth_section = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] keystone_authtoken.auth_type = password {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] keystone_authtoken.auth_version = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] keystone_authtoken.cache = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] keystone_authtoken.certfile = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] keystone_authtoken.delay_auth_decision = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] keystone_authtoken.http_connect_timeout = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] keystone_authtoken.include_service_catalog = True {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] keystone_authtoken.insecure = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] keystone_authtoken.interface = public {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] keystone_authtoken.keyfile = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] keystone_authtoken.memcache_password = **** {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] keystone_authtoken.memcache_username = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] keystone_authtoken.region_name = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] keystone_authtoken.service_token_roles_required = True {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] keystone_authtoken.service_type = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] keystone_authtoken.token_cache_time = 300 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.168/identity {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] cache.backend = dogpile.cache.null {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] cache.backend_argument = **** {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] cache.backend_expiration_time = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] cache.config_prefix = cache.oslo {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] cache.debug_cache_backend = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] cache.enable_retry_client = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] cache.enable_socket_keepalive = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] cache.enabled = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] cache.expiration_time = 600 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack sudo[76685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 08 06:36:16 devstack sudo[76685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] cache.hashclient_retry_attempts = 2 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] cache.memcache_dead_retry = 300 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] cache.memcache_pool_maxsize = 10 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] cache.memcache_sasl_enabled = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] cache.password = **** {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] cache.proxies = [] {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] cache.redis_db = 0 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] cache.redis_sentinel_service_name = mymaster {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] cache.redis_server = localhost:6379 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] cache.retry_attempts = 2 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] cache.retry_delay = 0.0 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] cache.socket_keepalive_count = 1 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] cache.socket_keepalive_idle = 1 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] cache.socket_keepalive_interval = 1 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] cache.socket_timeout = 1.0 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] cache.tls_allowed_ciphers = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] cache.tls_cafile = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] cache.tls_certfile = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] cache.tls_enabled = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] cache.tls_keyfile = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] cache.username = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] coordination.backend_url = **** {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] database.asyncio_connection = **** {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] database.asyncio_slave_connection = **** {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] database.backend = sqlalchemy {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] database.connection = **** {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] database.connection_debug = 0 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] database.connection_parameters = {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] database.connection_recycle_time = 3600 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] database.connection_trace = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] database.db_inc_retry_interval = True {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] database.db_max_retries = 20 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] database.db_max_retry_interval = 10 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] database.db_retry_interval = 1 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] database.max_overflow = 50 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] database.max_pool_size = 5 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] database.max_retries = 10 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] database.mysql_wsrep_sync_wait = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] database.pool_timeout = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] database.retry_interval = 10 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] database.slave_connection = **** {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] database.sqlite_synchronous = True {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] database.synchronous_reader = True {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] database.use_db_reconnect = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] oslo_messaging_tracing.insecure = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] profiler.connection_string = messaging:// {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] profiler.enabled = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] profiler.es_doc_type = notification {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] profiler.es_scroll_size = 10000 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] profiler.es_scroll_time = 2m {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] profiler.filter_error_trace = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] profiler.hmac_keys = **** {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] profiler.sentinel_service_name = mymaster {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] profiler.socket_timeout = 0.1 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] profiler.trace_requests = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] profiler.trace_sqlalchemy = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] profiler_jaeger.process_tags = {} {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] profiler_jaeger.service_name_prefix = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] profiler_otlp.service_name_prefix = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] oslo_policy.enforce_new_defaults = True {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] oslo_policy.policy_default_rule = default {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] oslo_policy.policy_file = policy.yaml {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] oslo_policy.remote_timeout = 60.0 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] privsep_osbrick.group = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] privsep_osbrick.helper_command = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] privsep_osbrick.user = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] cinder_sys_admin.group = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] cinder_sys_admin.helper_command = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] cinder_sys_admin.user = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] service_user.auth_section = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] service_user.auth_type = password {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] service_user.cafile = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] service_user.certfile = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] service_user.collect_timing = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] service_user.insecure = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] service_user.keyfile = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] service_user.send_service_user_token = True {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] service_user.split_loggers = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] service_user.timeout = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] service_user.tls_ciphers = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] service_user.tls_min_version = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] glance.auth_section = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] glance.auth_type = password {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] glance.certfile = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] glance.collect_timing = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] glance.insecure = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] glance.keyfile = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] glance.region_name = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] glance.split_loggers = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] glance.timeout = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] glance.tls_ciphers = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] glance.tls_min_version = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_defaults.backend_availability_zone = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_defaults.chap_password = **** {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_defaults.chap_username = {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_defaults.disk_geometry = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_defaults.driver_client_cert = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_defaults.driver_client_cert_key = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_defaults.driver_data_namespace = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_defaults.driver_use_ssl = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_defaults.enable_unsupported_driver = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_defaults.extra_capabilities = {} {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_defaults.filter_function = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_defaults.goodness_function = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_defaults.iscsi_target_flags = {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_defaults.iscsi_write_cache = on {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_defaults.iser_helper = tgtadm {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_defaults.iser_ip_address = 192.168.122.168 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_defaults.iser_port = 3260 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_defaults.lvm_mirrors = 0 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_defaults.lvm_share_target = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_defaults.lvm_type = auto {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_defaults.num_shell_tries = 3 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_defaults.nvmet_port_id = 1 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_defaults.replication_device = **** {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_defaults.report_discard_supported = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_defaults.reserved_percentage = 0 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_defaults.scst_target_driver = iscsi {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_defaults.scst_target_iqn_name = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_defaults.storage_protocol = iSCSI {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_defaults.target_helper = tgtadm {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_defaults.target_ip_address = 192.168.122.168 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_defaults.target_port = 3260 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_defaults.target_protocol = iscsi {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_defaults.trace_flags = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_defaults.unique_fqdn_network = True {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_defaults.use_chap_auth = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_defaults.volume_backend_name = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_defaults.volume_clear = zero {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_defaults.volume_clear_ionice = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_defaults.volume_clear_size = 0 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_defaults.volume_group = cinder-volumes {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] oslo_reports.file_event_handler = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] oslo_reports.log_dir = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] lvmdriver-1.backend_availability_zone = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] lvmdriver-1.backend_host = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] lvmdriver-1.chap_password = **** {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] lvmdriver-1.chap_username = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] lvmdriver-1.chiscsi_conf = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] lvmdriver-1.disk_geometry = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] lvmdriver-1.driver_client_cert = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] lvmdriver-1.driver_data_namespace = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] lvmdriver-1.driver_use_ssl = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] lvmdriver-1.extra_capabilities = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] lvmdriver-1.filter_function = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] lvmdriver-1.goodness_function = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] lvmdriver-1.iser_helper = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] lvmdriver-1.iser_ip_address = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] lvmdriver-1.iser_port = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] lvmdriver-1.iser_target_prefix = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] lvmdriver-1.lvm_conf_file = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] lvmdriver-1.lvm_mirrors = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] lvmdriver-1.lvm_share_target = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] lvmdriver-1.lvm_type = auto {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] lvmdriver-1.num_shell_tries = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] lvmdriver-1.nvmet_port_id = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] lvmdriver-1.replication_device = **** {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] lvmdriver-1.report_discard_supported = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] lvmdriver-1.reserved_percentage = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] lvmdriver-1.scst_target_driver = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] lvmdriver-1.storage_protocol = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] lvmdriver-1.target_helper = lioadm {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] lvmdriver-1.target_ip_address = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] lvmdriver-1.target_port = 3260 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] lvmdriver-1.target_protocol = iscsi {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] lvmdriver-1.trace_flags = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] lvmdriver-1.use_chap_auth = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] lvmdriver-1.volume_clear = zero {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] lvmdriver-1.volume_clear_size = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] lvmdriver-1.volumes_dir = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] oslo_messaging_rabbit.ssl = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] oslo_messaging_rabbit.ssl_version = {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] oslo_messaging_notifications.driver = [] {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] oslo_messaging_notifications.retry = -1 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] oslo_messaging_notifications.transport_url = **** {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] key_manager.fixed_key = **** {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] barbican.barbican_api_version = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] barbican.barbican_endpoint = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] barbican.barbican_endpoint_type = public {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] barbican.barbican_region_name = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] barbican.cafile = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] barbican.certfile = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] barbican.collect_timing = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] barbican.insecure = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] barbican.keyfile = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] barbican.number_of_retries = 60 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] barbican.retry_delay = 1 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] barbican.send_service_user_token = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] barbican.split_loggers = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] barbican.timeout = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] barbican.tls_ciphers = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] barbican.tls_min_version = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] barbican.verify_ssl = True {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] barbican.verify_ssl_path = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] barbican_service_user.auth_section = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] barbican_service_user.auth_type = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] barbican_service_user.cafile = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] barbican_service_user.certfile = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] barbican_service_user.collect_timing = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] barbican_service_user.insecure = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] barbican_service_user.keyfile = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] barbican_service_user.split_loggers = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] barbican_service_user.timeout = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] barbican_service_user.tls_ciphers = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] barbican_service_user.tls_min_version = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack sudo[76685]: pam_unix(sudo:session): session closed for user root Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] vault.approle_role_id = **** {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] vault.approle_secret_id = **** {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:36:16 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] vault.auth_method = approle {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] vault.auth_path = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] vault.kv_mountpoint = secret {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] vault.kv_path = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] vault.kv_version = 2 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] vault.namespace = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] vault.root_token_id = **** {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] vault.ssl_ca_crt_file = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] vault.timeout = 60.0 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] vault.token_file = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] vault.token_role = None {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] vault.use_ssl = False {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:36:16 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] ******************************************************************************** {{(pid=76534) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 08 06:36:16 devstack sudo[76690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 08 06:36:16 devstack sudo[76690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:36:16 devstack sudo[76690]: pam_unix(sudo:session): session closed for user root Sep 08 06:36:16 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.259s {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:36:16 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 06:36:16 devstack cinder-volume[76681]: INFO cinder.brick.local_dev.lvm [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 08 06:36:16 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:36:16 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:36:16 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:36:16 devstack sudo[76701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 08 06:36:16 devstack sudo[76701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:36:16 devstack sudo[76701]: pam_unix(sudo:session): session closed for user root Sep 08 06:36:16 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:36:16 devstack cinder-volume[76681]: DEBUG cinder.brick.local_dev.lvm [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76681) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 08 06:36:16 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:36:16 devstack sudo[76784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 08 06:36:16 devstack sudo[76784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:36:17 devstack sudo[76784]: pam_unix(sudo:session): session closed for user root Sep 08 06:36:17 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.493s {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:36:17 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:36:17 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:36:17 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:36:17 devstack sudo[76978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 08 06:36:17 devstack sudo[76978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:36:17 devstack sudo[76978]: pam_unix(sudo:session): session closed for user root Sep 08 06:36:17 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.268s {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:36:17 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:36:17 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:36:17 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:36:17 devstack sudo[77066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 08 06:36:17 devstack sudo[77066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:36:17 devstack sudo[77066]: pam_unix(sudo:session): session closed for user root Sep 08 06:36:17 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.260s {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:36:17 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:36:17 devstack sudo[77152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 08 06:36:17 devstack sudo[77152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:36:18 devstack sudo[77152]: pam_unix(sudo:session): session closed for user root Sep 08 06:36:18 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:36:18 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:36:18 devstack sudo[77227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 08 06:36:18 devstack sudo[77227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:36:18 devstack sudo[77227]: pam_unix(sudo:session): session closed for user root Sep 08 06:36:18 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.309s {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:36:18 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:36:18 devstack sudo[77307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 06:36:18 devstack sudo[77307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:36:18 devstack sudo[77307]: pam_unix(sudo:session): session closed for user root Sep 08 06:36:18 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:36:18 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:36:18 devstack sudo[77314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 08 06:36:18 devstack sudo[77314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:36:19 devstack sudo[77314]: pam_unix(sudo:session): session closed for user root Sep 08 06:36:19 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.345s {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:36:19 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:36:19 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:36:19 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:36:19 devstack sudo[77395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 08 06:36:19 devstack sudo[77395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:36:19 devstack sudo[77395]: pam_unix(sudo:session): session closed for user root Sep 08 06:36:19 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.296s {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:36:19 devstack cinder-volume[76681]: INFO cinder.volume.drivers.lvm [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 08 06:36:19 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:36:19 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:36:19 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:36:19 devstack sudo[77409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 08 06:36:19 devstack sudo[77409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:36:19 devstack sudo[77409]: pam_unix(sudo:session): session closed for user root Sep 08 06:36:19 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.308s {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:36:19 devstack cinder-volume[76681]: DEBUG cinder.volume.drivers.lvm [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] Updating volume stats {{(pid=76681) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 08 06:36:19 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:36:19 devstack sudo[77488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 08 06:36:19 devstack sudo[77488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:36:19 devstack sudo[77488]: pam_unix(sudo:session): session closed for user root Sep 08 06:36:19 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:36:19 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:36:20 devstack sudo[77497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 06:36:20 devstack sudo[77497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:36:20 devstack sudo[77497]: pam_unix(sudo:session): session closed for user root Sep 08 06:36:20 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:36:20 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:36:20 devstack sudo[77500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 08 06:36:20 devstack sudo[77500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:36:20 devstack sudo[77500]: pam_unix(sudo:session): session closed for user root Sep 08 06:36:20 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:36:20 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:36:20 devstack sudo[77503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 06:36:20 devstack sudo[77503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:36:20 devstack sudo[77503]: pam_unix(sudo:session): session closed for user root Sep 08 06:36:20 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:36:20 devstack cinder-volume[76681]: INFO cinder.volume.driver [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] Driver hasn't implemented _init_vendor_properties() Sep 08 06:36:20 devstack cinder-volume[76681]: DEBUG cinder.volume.driver [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76681) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 08 06:36:20 devstack cinder-volume[76681]: DEBUG oslo_db.sqlalchemy.engines [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76681) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 08 06:36:20 devstack cinder-volume[76681]: DEBUG dbcounter [-] [76681] Writer thread running {{(pid=76681) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 08 06:36:20 devstack cinder-volume[76681]: DEBUG cinder.db.api [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] Building query based on filter {{(pid=76681) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 08 06:36:20 devstack cinder-volume[76681]: DEBUG cinder.image.image_utils [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76681) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 08 06:36:20 devstack cinder-volume[76681]: INFO cinder.keymgr.migration [None req-a71f330c-f64b-4734-84ed-22280a5a3c5f None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 08 06:36:20 devstack cinder-volume[76681]: DEBUG cinder.volume.drivers.lvm [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] Updating volume stats {{(pid=76681) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 08 06:36:20 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:36:20 devstack sudo[77507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 08 06:36:20 devstack sudo[77507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:36:21 devstack sudo[77507]: pam_unix(sudo:session): session closed for user root Sep 08 06:36:21 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:36:21 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:36:21 devstack sudo[77510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 06:36:21 devstack sudo[77510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:36:21 devstack sudo[77510]: pam_unix(sudo:session): session closed for user root Sep 08 06:36:21 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:36:21 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:36:21 devstack sudo[77513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 08 06:36:21 devstack sudo[77513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:36:21 devstack sudo[77513]: pam_unix(sudo:session): session closed for user root Sep 08 06:36:21 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.279s {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:36:21 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:36:21 devstack sudo[77518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 06:36:21 devstack sudo[77518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:36:21 devstack sudo[77518]: pam_unix(sudo:session): session closed for user root Sep 08 06:36:21 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:36:21 devstack cinder-volume[76681]: DEBUG cinder.manager [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] Notifying Schedulers of capabilities ... {{(pid=76681) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:36:22 devstack cinder-volume[76681]: INFO cinder.volume.manager [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] Driver initialization completed successfully. Sep 08 06:36:22 devstack cinder-volume[76681]: INFO cinder.manager [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] Initiating service 2 cleanup Sep 08 06:36:22 devstack cinder-volume[76681]: INFO cinder.manager [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] Service 2 cleanup completed. Sep 08 06:36:22 devstack cinder-volume[76681]: DEBUG cinder.service [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] Creating RPC server for service cinder-volume {{(pid=76681) start /opt/stack/cinder/cinder/service.py:231}} Sep 08 06:36:22 devstack cinder-volume[76681]: DEBUG cinder.service [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76681) start /opt/stack/cinder/cinder/service.py:237}} Sep 08 06:36:22 devstack cinder-volume[76681]: INFO cinder.volume.manager [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 08 06:36:22 devstack cinder-volume[76681]: DEBUG cinder.volume.drivers.lvm [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] Updating volume stats {{(pid=76681) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 08 06:36:22 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:36:22 devstack sudo[77522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 08 06:36:22 devstack sudo[77522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:36:22 devstack sudo[77522]: pam_unix(sudo:session): session closed for user root Sep 08 06:36:22 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:36:22 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:36:22 devstack sudo[77525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 06:36:22 devstack sudo[77525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:36:22 devstack sudo[77525]: pam_unix(sudo:session): session closed for user root Sep 08 06:36:22 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:36:22 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:36:22 devstack sudo[77528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 08 06:36:22 devstack sudo[77528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:36:22 devstack sudo[77528]: pam_unix(sudo:session): session closed for user root Sep 08 06:36:22 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.246s {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:36:22 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:36:22 devstack sudo[77531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 06:36:22 devstack sudo[77531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:36:23 devstack sudo[77531]: pam_unix(sudo:session): session closed for user root Sep 08 06:36:23 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:36:23 devstack cinder-volume[76681]: INFO cinder.volume.manager [None req-d5752c43-8946-47d2-9b8c-69119302c71a None None] Driver post RPC initialization completed successfully. Sep 08 06:36:25 devstack cinder-volume[76534]: DEBUG dbcounter [-] [76534] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76534) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 06:36:33 devstack cinder-volume[76681]: DEBUG dbcounter [-] [76681] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76681) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 06:36:33 devstack cinder-volume[76681]: DEBUG dbcounter [-] [76681] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=76681) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 06:36:39 devstack cinder-volume[76681]: DEBUG oslo_service.periodic_task [None req-5a81fab8-9c8f-4959-8d96-09a54145bf6b None None] Running periodic task VolumeManager._thread_info {{(pid=76681) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 06:36:39 devstack cinder-volume[76681]: DEBUG cinder.volume.manager [None req-5a81fab8-9c8f-4959-8d96-09a54145bf6b None None] thread count: 6 {{(pid=76681) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 06:36:39 devstack cinder-volume[76681]: DEBUG cinder.volume.manager [None req-5a81fab8-9c8f-4959-8d96-09a54145bf6b None None] thread info: [<_MainThread(MainThread, started 140131239174272)>, , , , , ] {{(pid=76681) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 06:37:39 devstack cinder-volume[76681]: DEBUG oslo_service.periodic_task [None req-5a81fab8-9c8f-4959-8d96-09a54145bf6b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76681) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 06:37:39 devstack cinder-volume[76681]: DEBUG cinder.volume.drivers.lvm [None req-5a81fab8-9c8f-4959-8d96-09a54145bf6b None None] Updating volume stats {{(pid=76681) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 08 06:37:39 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-5a81fab8-9c8f-4959-8d96-09a54145bf6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:37:39 devstack sudo[80142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 08 06:37:39 devstack sudo[80142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:37:39 devstack sudo[80142]: pam_unix(sudo:session): session closed for user root Sep 08 06:37:39 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-5a81fab8-9c8f-4959-8d96-09a54145bf6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:37:39 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-5a81fab8-9c8f-4959-8d96-09a54145bf6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:37:39 devstack sudo[80145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 06:37:39 devstack sudo[80145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:37:39 devstack sudo[80145]: pam_unix(sudo:session): session closed for user root Sep 08 06:37:39 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-5a81fab8-9c8f-4959-8d96-09a54145bf6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:37:39 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-5a81fab8-9c8f-4959-8d96-09a54145bf6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:37:39 devstack sudo[80148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 08 06:37:39 devstack sudo[80148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:37:40 devstack sudo[80148]: pam_unix(sudo:session): session closed for user root Sep 08 06:37:40 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-5a81fab8-9c8f-4959-8d96-09a54145bf6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.244s {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:37:40 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-5a81fab8-9c8f-4959-8d96-09a54145bf6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:37:40 devstack sudo[80151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 06:37:40 devstack sudo[80151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:37:40 devstack sudo[80151]: pam_unix(sudo:session): session closed for user root Sep 08 06:37:40 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-5a81fab8-9c8f-4959-8d96-09a54145bf6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.242s {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:37:40 devstack cinder-volume[76681]: DEBUG cinder.manager [None req-5a81fab8-9c8f-4959-8d96-09a54145bf6b None None] Notifying Schedulers of capabilities ... {{(pid=76681) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:37:40 devstack cinder-volume[76681]: DEBUG oslo_service.periodic_task [None req-5a81fab8-9c8f-4959-8d96-09a54145bf6b None None] Running periodic task VolumeManager._thread_info {{(pid=76681) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 06:37:40 devstack cinder-volume[76681]: DEBUG cinder.volume.manager [None req-5a81fab8-9c8f-4959-8d96-09a54145bf6b None None] thread count: 6 {{(pid=76681) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 06:37:40 devstack cinder-volume[76681]: DEBUG cinder.volume.manager [None req-5a81fab8-9c8f-4959-8d96-09a54145bf6b None None] thread info: [<_MainThread(MainThread, started 140131239174272)>, , , , , ] {{(pid=76681) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 06:38:33 devstack cinder-volume[76681]: DEBUG dbcounter [-] [76681] Writing DB stats cinder:SELECT=1 {{(pid=76681) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 06:38:33 devstack cinder-volume[76681]: DEBUG dbcounter [-] [76681] Writing DB stats cinder:UPDATE=1 {{(pid=76681) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 06:38:39 devstack cinder-volume[76681]: DEBUG oslo_service.periodic_task [None req-5a81fab8-9c8f-4959-8d96-09a54145bf6b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76681) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 06:38:39 devstack cinder-volume[76681]: DEBUG cinder.volume.drivers.lvm [None req-5a81fab8-9c8f-4959-8d96-09a54145bf6b None None] Updating volume stats {{(pid=76681) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 08 06:38:39 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-5a81fab8-9c8f-4959-8d96-09a54145bf6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:38:39 devstack sudo[83157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 08 06:38:39 devstack sudo[83157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:38:39 devstack sudo[83157]: pam_unix(sudo:session): session closed for user root Sep 08 06:38:39 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-5a81fab8-9c8f-4959-8d96-09a54145bf6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:38:39 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-5a81fab8-9c8f-4959-8d96-09a54145bf6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:38:39 devstack sudo[83165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 06:38:39 devstack sudo[83165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:38:39 devstack sudo[83165]: pam_unix(sudo:session): session closed for user root Sep 08 06:38:39 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-5a81fab8-9c8f-4959-8d96-09a54145bf6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:38:39 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-5a81fab8-9c8f-4959-8d96-09a54145bf6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:38:39 devstack sudo[83168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 08 06:38:39 devstack sudo[83168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:38:40 devstack sudo[83168]: pam_unix(sudo:session): session closed for user root Sep 08 06:38:40 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-5a81fab8-9c8f-4959-8d96-09a54145bf6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.246s {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:38:40 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-5a81fab8-9c8f-4959-8d96-09a54145bf6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:38:40 devstack sudo[83171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 06:38:40 devstack sudo[83171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:38:40 devstack sudo[83171]: pam_unix(sudo:session): session closed for user root Sep 08 06:38:40 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-5a81fab8-9c8f-4959-8d96-09a54145bf6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:38:40 devstack cinder-volume[76681]: DEBUG cinder.manager [None req-5a81fab8-9c8f-4959-8d96-09a54145bf6b None None] Notifying Schedulers of capabilities ... {{(pid=76681) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:38:40 devstack cinder-volume[76681]: DEBUG oslo_service.periodic_task [None req-5a81fab8-9c8f-4959-8d96-09a54145bf6b None None] Running periodic task VolumeManager._thread_info {{(pid=76681) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 06:38:40 devstack cinder-volume[76681]: DEBUG cinder.volume.manager [None req-5a81fab8-9c8f-4959-8d96-09a54145bf6b None None] thread count: 6 {{(pid=76681) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 06:38:40 devstack cinder-volume[76681]: DEBUG cinder.volume.manager [None req-5a81fab8-9c8f-4959-8d96-09a54145bf6b None None] thread info: [<_MainThread(MainThread, started 140131239174272)>, , , , , ] {{(pid=76681) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 06:39:39 devstack cinder-volume[76681]: DEBUG oslo_service.periodic_task [None req-5a81fab8-9c8f-4959-8d96-09a54145bf6b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76681) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 06:39:39 devstack cinder-volume[76681]: DEBUG cinder.volume.drivers.lvm [None req-5a81fab8-9c8f-4959-8d96-09a54145bf6b None None] Updating volume stats {{(pid=76681) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 08 06:39:39 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-5a81fab8-9c8f-4959-8d96-09a54145bf6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:39:39 devstack sudo[85440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 08 06:39:39 devstack sudo[85440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:39:39 devstack sudo[85440]: pam_unix(sudo:session): session closed for user root Sep 08 06:39:39 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-5a81fab8-9c8f-4959-8d96-09a54145bf6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:39:39 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-5a81fab8-9c8f-4959-8d96-09a54145bf6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:39:39 devstack sudo[85443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 06:39:39 devstack sudo[85443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:39:39 devstack sudo[85443]: pam_unix(sudo:session): session closed for user root Sep 08 06:39:39 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-5a81fab8-9c8f-4959-8d96-09a54145bf6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:39:39 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-5a81fab8-9c8f-4959-8d96-09a54145bf6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:39:39 devstack sudo[85446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 08 06:39:39 devstack sudo[85446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:39:40 devstack sudo[85446]: pam_unix(sudo:session): session closed for user root Sep 08 06:39:40 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-5a81fab8-9c8f-4959-8d96-09a54145bf6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:39:40 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-5a81fab8-9c8f-4959-8d96-09a54145bf6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:39:40 devstack sudo[85449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 06:39:40 devstack sudo[85449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:39:40 devstack sudo[85449]: pam_unix(sudo:session): session closed for user root Sep 08 06:39:40 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-5a81fab8-9c8f-4959-8d96-09a54145bf6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:39:40 devstack cinder-volume[76681]: DEBUG cinder.manager [None req-5a81fab8-9c8f-4959-8d96-09a54145bf6b None None] Notifying Schedulers of capabilities ... {{(pid=76681) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:39:40 devstack cinder-volume[76681]: DEBUG oslo_service.periodic_task [None req-5a81fab8-9c8f-4959-8d96-09a54145bf6b None None] Running periodic task VolumeManager._thread_info {{(pid=76681) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 06:39:40 devstack cinder-volume[76681]: DEBUG cinder.volume.manager [None req-5a81fab8-9c8f-4959-8d96-09a54145bf6b None None] thread count: 6 {{(pid=76681) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 06:39:40 devstack cinder-volume[76681]: DEBUG cinder.volume.manager [None req-5a81fab8-9c8f-4959-8d96-09a54145bf6b None None] thread info: [<_MainThread(MainThread, started 140131239174272)>, , , , , ] {{(pid=76681) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 06:40:33 devstack cinder-volume[76681]: DEBUG dbcounter [-] [76681] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76681) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 06:40:38 devstack cinder-volume[76534]: INFO oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] Caught SIGTERM, stopping children Sep 08 06:40:38 devstack cinder-volume[76534]: DEBUG oslo_concurrency.lockutils [None req-1f159300-7424-4902-af27-43172761408f None None] Acquiring lock "singleton_lock" {{(pid=76534) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 08 06:40:38 devstack cinder-volume[76534]: DEBUG oslo_concurrency.lockutils [None req-1f159300-7424-4902-af27-43172761408f None None] Acquired lock "singleton_lock" {{(pid=76534) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 08 06:40:38 devstack cinder-volume[76534]: DEBUG oslo_concurrency.lockutils [None req-1f159300-7424-4902-af27-43172761408f None None] Releasing lock "singleton_lock" {{(pid=76534) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 08 06:40:38 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] Stop services. {{(pid=76534) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 08 06:40:38 devstack cinder-volume[76534]: DEBUG oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] Killing children. {{(pid=76534) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 08 06:40:38 devstack cinder-volume[76534]: INFO oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] Waiting on 1 children to exit Sep 08 06:40:39 devstack cinder-volume[76681]: DEBUG oslo_service.periodic_task [None req-5a81fab8-9c8f-4959-8d96-09a54145bf6b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76681) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 06:40:39 devstack cinder-volume[76681]: DEBUG cinder.volume.drivers.lvm [None req-5a81fab8-9c8f-4959-8d96-09a54145bf6b None None] Updating volume stats {{(pid=76681) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 08 06:40:39 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-5a81fab8-9c8f-4959-8d96-09a54145bf6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:40:39 devstack sudo[86665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 08 06:40:39 devstack sudo[86665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:40:39 devstack sudo[86665]: pam_unix(sudo:session): session closed for user root Sep 08 06:40:39 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-5a81fab8-9c8f-4959-8d96-09a54145bf6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:40:39 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-5a81fab8-9c8f-4959-8d96-09a54145bf6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:40:39 devstack sudo[86668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 06:40:39 devstack sudo[86668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:40:39 devstack sudo[86668]: pam_unix(sudo:session): session closed for user root Sep 08 06:40:39 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-5a81fab8-9c8f-4959-8d96-09a54145bf6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:40:39 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-5a81fab8-9c8f-4959-8d96-09a54145bf6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:40:39 devstack sudo[86671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 08 06:40:39 devstack sudo[86671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:40:40 devstack sudo[86671]: pam_unix(sudo:session): session closed for user root Sep 08 06:40:40 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-5a81fab8-9c8f-4959-8d96-09a54145bf6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.249s {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:40:40 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-5a81fab8-9c8f-4959-8d96-09a54145bf6b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:40:40 devstack sudo[86674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 06:40:40 devstack sudo[86674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:40:40 devstack sudo[86674]: pam_unix(sudo:session): session closed for user root Sep 08 06:40:40 devstack cinder-volume[76681]: DEBUG oslo_concurrency.processutils [None req-5a81fab8-9c8f-4959-8d96-09a54145bf6b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76681) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:40:40 devstack cinder-volume[76681]: DEBUG cinder.manager [None req-5a81fab8-9c8f-4959-8d96-09a54145bf6b None None] Notifying Schedulers of capabilities ... {{(pid=76681) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:40:42 devstack cinder-volume[76681]: DEBUG oslo_concurrency.lockutils [None req-1f159300-7424-4902-af27-43172761408f None None] Acquiring lock "singleton_lock" {{(pid=76681) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 08 06:40:42 devstack cinder-volume[76681]: DEBUG oslo_concurrency.lockutils [None req-1f159300-7424-4902-af27-43172761408f None None] Acquired lock "singleton_lock" {{(pid=76681) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 08 06:40:42 devstack cinder-volume[76681]: DEBUG oslo_concurrency.lockutils [None req-1f159300-7424-4902-af27-43172761408f None None] Releasing lock "singleton_lock" {{(pid=76681) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 08 06:40:42 devstack cinder-volume[76681]: WARNING amqp [None req-1f159300-7424-4902-af27-43172761408f None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 08 06:40:42 devstack cinder-volume[76681]: WARNING amqp [None req-1f159300-7424-4902-af27-43172761408f None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 08 06:40:42 devstack cinder-volume[76534]: INFO oslo_service.backend._eventlet.service [None req-1f159300-7424-4902-af27-43172761408f None None] Child 76681 exited with status 0 Sep 08 06:40:42 devstack cinder-volume[86678]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 08 06:40:42 devstack cinder-volume[86678]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 08 06:40:42 devstack cinder-volume[86678]: we strongly recommend against using it for new projects. Sep 08 06:40:42 devstack cinder-volume[86678]: If you are already using Eventlet, we recommend migrating to a different Sep 08 06:40:42 devstack cinder-volume[86678]: framework. For more detail see Sep 08 06:40:42 devstack cinder-volume[86678]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 08 06:40:42 devstack cinder-volume[86678]: import eventlet # noqa Sep 08 06:40:44 devstack cinder-volume[86678]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86678) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 08 06:40:44 devstack cinder-volume[86678]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86678) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 08 06:40:44 devstack cinder-volume[86678]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86678) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 08 06:40:45 devstack cinder-volume[86678]: INFO dbcounter [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] Registered counter for database cinder Sep 08 06:40:45 devstack cinder-volume[86678]: DEBUG oslo_db.sqlalchemy.engines [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86678) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 08 06:40:45 devstack cinder-volume[86678]: DEBUG dbcounter [-] [86678] Writer thread running {{(pid=86678) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 08 06:40:45 devstack cinder-volume[86678]: INFO cinder.rpc [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 08 06:40:45 devstack cinder-volume[86678]: INFO cinder.rpc [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 08 06:40:45 devstack cinder-volume[86678]: DEBUG oslo_db.sqlalchemy.engines [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86678) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 08 06:40:45 devstack cinder-volume[86678]: INFO cinder.volume.manager [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] Determined volume DB was empty at startup. Sep 08 06:40:45 devstack cinder-volume[86678]: DEBUG cinder.volume.manager [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86678) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 08 06:40:45 devstack cinder-volume[86678]: INFO cinder.volume.manager [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 08 06:40:45 devstack cinder-volume[86678]: WARNING stevedore.named [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 08 06:40:45 devstack cinder-volume[86678]: WARNING castellan.key_manager [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 08 06:40:45 devstack cinder-volume[86678]: WARNING cinder.keymgr.conf_key_mgr [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 08 06:40:45 devstack cinder-volume[86678]: INFO cinder.volume.manager [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_db.sqlalchemy.engines [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86678) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 08 06:40:46 devstack cinder-volume[86678]: INFO oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] Starting 1 workers Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] Started child 86925 {{(pid=86678) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] Full set of CONF: {{(pid=86678) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] ******************************************************************************** {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] Configuration options gathered from: {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] ================================================================================ {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] allow_availability_zone_fallback = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] allow_compression_on_image_upload = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] allowed_direct_url_schemes = [] {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] api_rate_limit = True {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] auth_strategy = keystone {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_availability_zone = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_host = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_name = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_stats_polling_interval = 60 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backup_api_class = cinder.backup.api.API {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backup_name_template = backup-%s {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backup_use_same_host = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backup_use_temp_snapshot = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] chap_password = **** {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] chap_username = {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] cinder_internal_tenant_project_id = 955d53d82db04a9382251268e397d2c8 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] cinder_internal_tenant_user_id = 0c1ec087147f4577a1634d9e6801ec71 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] cluster = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] compression_format = gzip {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] compute_api_class = cinder.compute.nova.API {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] config_dir = [] {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] config_source = [] {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] control_exchange = openstack {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] debug = True {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] default_availability_zone = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] default_group_type = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] default_volume_type = QuobyteHD {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] disk_geometry = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] driver_client_cert = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] driver_client_cert_key = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] driver_data_namespace = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] driver_ssl_cert_path = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] driver_ssl_cert_verify = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] driver_use_ssl = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] enable_new_services = True {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] enable_unsupported_driver = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] enabled_backends = ['QuobyteHD'] {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] enforce_multipath_for_image_xfer = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] filter_function = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] glance_api_insecure = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] glance_api_servers = ['http://192.168.122.168/image'] {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86925]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] glance_api_ssl_compression = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] glance_ca_certificates_file = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] glance_catalog_info = image:glance:publicURL {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] glance_certfile = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] glance_keyfile = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] glance_num_retries = 3 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] glance_request_timeout = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] goodness_function = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] graceful_shutdown_timeout = 5 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] group_api_class = cinder.group.api.API {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] host = devstack {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] image_compress_on_upload = True {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] image_conversion_address_space_limit = 1 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] image_conversion_cpu_limit = 60 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] image_conversion_disable = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] image_upload_use_cinder_backend = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] image_upload_use_internal_tenant = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] image_volume_cache_enabled = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] image_volume_cache_max_count = 0 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] image_volume_cache_max_size_gb = 0 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] init_host_max_objects_retrieval = 0 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] instance_format = [instance: %(uuid)s] {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] iscsi_target_flags = {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] iscsi_write_cache = on {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] iser_helper = tgtadm {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] iser_ip_address = 192.168.122.168 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] iser_port = 3260 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] log_color = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] log_config_append = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] log_dir = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] log_file = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] log_options = True {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] log_rotate_interval = 1 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] log_rotate_interval_type = days {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] log_rotation_type = none {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] max_age = 0 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] max_logfile_count = 30 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] max_logfile_size_mb = 200 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] max_over_subscription_ratio = 20.0 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] message_reap_interval = 86400 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] message_ttl = 2592000 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] migration_create_volume_timeout_secs = 300 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] monkey_patch = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] monkey_patch_modules = [] {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] my_ip = 192.168.122.168 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] no_snapshot_gb_quota = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] num_iser_scan_tries = 3 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] num_shell_tries = 3 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] num_volume_device_scan_tries = 3 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] nvmeof_conn_info_version = 1 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] nvmet_ns_id = 10 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] nvmet_port_id = 1 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] osapi_max_limit = 1000 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] osapi_volume_ext_list = [] {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] osapi_volume_listen = 0.0.0.0 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] osapi_volume_listen_port = 8776 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] osapi_volume_use_ssl = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] osapi_volume_workers = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] per_volume_size_limit = -1 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] periodic_fuzzy_delay = 60 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] periodic_interval = 60 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] project_id_regex = [0-9a-f\-]+ {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] public_endpoint = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] publish_errors = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] quota_backup_gigabytes = 1000 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] quota_backups = 10 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] quota_gigabytes = 1000 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] quota_groups = 10 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] quota_snapshots = 10 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] quota_volumes = 10 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] rate_limit_burst = 0 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] rate_limit_except_level = CRITICAL {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] rate_limit_interval = 0 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] reinit_driver_count = 3 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] replication_device = **** {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] report_discard_supported = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] report_interval = 120 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] reservation_clean_interval = 86400 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] reservation_expire = 86400 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] reserved_image_namespaces = [] {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] reserved_percentage = 0 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] rpc_response_timeout = 120 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] run_external_periodic_tasks = True {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] scst_target_driver = iscsi {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] scst_target_iqn_name = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] service_down_time = 720 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] shell_completion = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] snapshot_name_template = snapshot-%s {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] split_loggers = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] state_path = /opt/stack/data/cinder {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] storage_availability_zone = nova {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] storage_protocol = iSCSI {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] syslog_log_facility = LOG_USER {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] target_helper = lioadm {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] target_ip_address = 192.168.122.168 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] target_port = 3260 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] target_protocol = iscsi {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] target_secondary_ip_addresses = [] {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] trace_flags = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] transfer_api_class = cinder.transfer.api.API {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] transport_url = **** {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] until_refresh = 0 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] use_chap_auth = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] use_default_quota_class = True {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] use_journal = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] use_json = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] use_multipath_for_image_xfer = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] use_stderr = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] use_syslog = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] verify_glance_signatures = enabled {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] volume_api_class = cinder.volume.api.API {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] volume_backend_name = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] volume_clear = zero {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] volume_clear_ionice = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] volume_clear_size = 0 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-7ef2b4ce-369a-4554-a84e-1c8a6d809249 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] volume_copy_bps_limit = 0 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.remotefs [None req-7ef2b4ce-369a-4554-a84e-1c8a6d809249 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86925) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] volume_dd_blocksize = 1M {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] volume_name_template = volume-%s {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] volume_service_inithost_offload = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] volume_usage_audit_period = month {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] zoning_mode = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] oslo_concurrency.disable_process_locking = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] keystone_authtoken.auth_section = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] keystone_authtoken.auth_type = password {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] keystone_authtoken.auth_version = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] keystone_authtoken.cache = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] keystone_authtoken.certfile = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] keystone_authtoken.delay_auth_decision = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] keystone_authtoken.http_connect_timeout = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] keystone_authtoken.include_service_catalog = True {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] keystone_authtoken.insecure = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] keystone_authtoken.interface = public {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] keystone_authtoken.keyfile = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] keystone_authtoken.memcache_password = **** {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] keystone_authtoken.memcache_username = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] keystone_authtoken.region_name = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] keystone_authtoken.service_token_roles_required = True {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] keystone_authtoken.service_type = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] keystone_authtoken.token_cache_time = 300 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.168/identity {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] cache.backend = dogpile.cache.null {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] cache.backend_argument = **** {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] cache.backend_expiration_time = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] cache.config_prefix = cache.oslo {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] cache.debug_cache_backend = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] cache.enable_retry_client = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] cache.enable_socket_keepalive = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] cache.enabled = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] cache.expiration_time = 600 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] cache.hashclient_retry_attempts = 2 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] cache.memcache_dead_retry = 300 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] cache.memcache_pool_maxsize = 10 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] cache.memcache_sasl_enabled = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] cache.password = **** {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] cache.proxies = [] {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] cache.redis_db = 0 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] cache.redis_sentinel_service_name = mymaster {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] cache.redis_server = localhost:6379 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] cache.retry_attempts = 2 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] cache.retry_delay = 0.0 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] cache.socket_keepalive_count = 1 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] cache.socket_keepalive_idle = 1 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] cache.socket_keepalive_interval = 1 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] cache.socket_timeout = 1.0 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] cache.tls_allowed_ciphers = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] cache.tls_cafile = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] cache.tls_certfile = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] cache.tls_enabled = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] cache.tls_keyfile = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] cache.username = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] coordination.backend_url = **** {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] database.asyncio_connection = **** {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] database.asyncio_slave_connection = **** {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] database.backend = sqlalchemy {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] database.connection = **** {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] database.connection_debug = 0 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] database.connection_parameters = {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] database.connection_recycle_time = 3600 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] database.connection_trace = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] database.db_inc_retry_interval = True {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] database.db_max_retries = 20 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] database.db_max_retry_interval = 10 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] database.db_retry_interval = 1 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] database.max_overflow = 50 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] database.max_pool_size = 5 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] database.max_retries = 10 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] database.mysql_wsrep_sync_wait = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] database.pool_timeout = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] database.retry_interval = 10 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] database.slave_connection = **** {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] database.sqlite_synchronous = True {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] database.synchronous_reader = True {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] database.use_db_reconnect = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] oslo_messaging_tracing.insecure = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] profiler.connection_string = messaging:// {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] profiler.enabled = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] profiler.es_doc_type = notification {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] profiler.es_scroll_size = 10000 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] profiler.es_scroll_time = 2m {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] profiler.filter_error_trace = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] profiler.hmac_keys = **** {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] profiler.sentinel_service_name = mymaster {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] profiler.socket_timeout = 0.1 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] profiler.trace_requests = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] profiler.trace_sqlalchemy = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] profiler_jaeger.process_tags = {} {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] profiler_jaeger.service_name_prefix = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] profiler_otlp.service_name_prefix = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] oslo_policy.enforce_new_defaults = True {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] oslo_policy.policy_default_rule = default {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-7ef2b4ce-369a-4554-a84e-1c8a6d809249 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86925) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] oslo_policy.policy_file = policy.yaml {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.quobyte [None req-7ef2b4ce-369a-4554-a84e-1c8a6d809249 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 08 06:40:46 devstack cinder-volume[86925]: WARNING cinder.volume.drivers.quobyte [None req-7ef2b4ce-369a-4554-a84e-1c8a6d809249 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] oslo_policy.remote_timeout = 60.0 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] privsep_osbrick.group = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7ef2b4ce-369a-4554-a84e-1c8a6d809249 None None] Running cmd (subprocess): mount.quobyte {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] privsep_osbrick.helper_command = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] privsep_osbrick.user = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] cinder_sys_admin.group = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] cinder_sys_admin.helper_command = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] cinder_sys_admin.user = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] service_user.auth_section = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] service_user.auth_type = password {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] service_user.cafile = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] service_user.certfile = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] service_user.collect_timing = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] service_user.insecure = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] service_user.keyfile = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] service_user.send_service_user_token = True {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] service_user.split_loggers = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] service_user.timeout = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] service_user.tls_ciphers = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] service_user.tls_min_version = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] glance.auth_section = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] glance.auth_type = password {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] glance.certfile = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] glance.collect_timing = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] glance.insecure = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] glance.keyfile = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] glance.region_name = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] glance.split_loggers = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] glance.timeout = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] glance.tls_ciphers = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] glance.tls_min_version = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.backend_availability_zone = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.chap_password = **** {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.chap_username = {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.disk_geometry = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.driver_client_cert = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.driver_client_cert_key = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.driver_data_namespace = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.driver_use_ssl = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.enable_unsupported_driver = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.extra_capabilities = {} {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.filter_function = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.goodness_function = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.iscsi_target_flags = {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.iscsi_write_cache = on {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.iser_helper = tgtadm {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.iser_ip_address = 192.168.122.168 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.iser_port = 3260 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.nas_host = {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.nas_login = admin {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.nas_mount_options = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.nas_password = **** {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.nas_private_key = {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.nas_share_path = {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.nas_ssh_port = 22 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.num_shell_tries = 3 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.nvmet_port_id = 1 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.quobyte_client_cfg = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.quobyte_volume_url = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.replication_device = **** {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.report_discard_supported = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.reserved_percentage = 0 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.scst_target_driver = iscsi {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.scst_target_iqn_name = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.storage_protocol = iSCSI {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.target_helper = tgtadm {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.target_ip_address = 192.168.122.168 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.target_port = 3260 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.target_protocol = iscsi {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.trace_flags = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.unique_fqdn_network = True {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.use_chap_auth = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.volume_backend_name = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.volume_clear = zero {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.volume_clear_ionice = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.volume_clear_size = 0 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] oslo_reports.file_event_handler = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] oslo_reports.log_dir = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.backend_availability_zone = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.backend_host = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.chap_password = **** {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.chap_username = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.chiscsi_conf = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.disk_geometry = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.driver_client_cert = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.driver_client_cert_key = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.driver_data_namespace = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.driver_use_ssl = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.extra_capabilities = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.filter_function = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.goodness_function = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.iscsi_target_flags = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.iscsi_write_cache = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.iser_helper = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.iser_ip_address = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.iser_port = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.iser_target_prefix = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.nas_host = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.nas_login = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.nas_mount_options = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.nas_password = **** {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.nas_private_key = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.nas_share_path = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.nas_ssh_port = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.num_shell_tries = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.nvmet_ns_id = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.nvmet_port_id = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.replication_device = **** {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.report_discard_supported = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.reserved_percentage = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.scst_target_driver = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.storage_protocol = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.target_helper = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.target_ip_address = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.target_port = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.target_prefix = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.target_protocol = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.trace_flags = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.unique_fqdn_network = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.use_chap_auth = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.volume_clear = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.volume_clear_ionice = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.volume_clear_size = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] QuobyteHD.volumes_dir = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7ef2b4ce-369a-4554-a84e-1c8a6d809249 None None] CMD "mount.quobyte" returned: 1 in 0.077s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:40:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-7ef2b4ce-369a-4554-a84e-1c8a6d809249 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:40:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-7ef2b4ce-369a-4554-a84e-1c8a6d809249 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:40:46 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-7ef2b4ce-369a-4554-a84e-1c8a6d809249 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86925]: INFO cinder.volume.drivers.quobyte [None req-7ef2b4ce-369a-4554-a84e-1c8a6d809249 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d ... Sep 08 06:40:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7ef2b4ce-369a-4554-a84e-1c8a6d809249 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd -c /etc/quobyte/client-cinder.cfg {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] oslo_messaging_rabbit.ssl = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack sudo[86931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd -c /etc/quobyte/client-cinder.cfg Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] oslo_messaging_rabbit.ssl_version = {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack sudo[86931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] oslo_messaging_notifications.driver = [] {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] oslo_messaging_notifications.retry = -1 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] oslo_messaging_notifications.transport_url = **** {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] key_manager.fixed_key = **** {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] barbican.barbican_api_version = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] barbican.barbican_endpoint = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] barbican.barbican_endpoint_type = public {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] barbican.barbican_region_name = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] barbican.cafile = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] barbican.certfile = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] barbican.collect_timing = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] barbican.insecure = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] barbican.keyfile = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] barbican.number_of_retries = 60 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] barbican.retry_delay = 1 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] barbican.send_service_user_token = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] barbican.split_loggers = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] barbican.timeout = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] barbican.tls_ciphers = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] barbican.tls_min_version = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] barbican.verify_ssl = True {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] barbican.verify_ssl_path = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] barbican_service_user.auth_section = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] barbican_service_user.auth_type = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] barbican_service_user.cafile = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] barbican_service_user.certfile = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] barbican_service_user.collect_timing = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] barbican_service_user.insecure = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] barbican_service_user.keyfile = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] barbican_service_user.split_loggers = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] barbican_service_user.timeout = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] barbican_service_user.tls_ciphers = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] barbican_service_user.tls_min_version = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] vault.approle_role_id = **** {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] vault.approle_secret_id = **** {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] vault.auth_method = approle {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] vault.auth_path = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] vault.kv_mountpoint = secret {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] vault.kv_path = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] vault.kv_version = 2 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] vault.namespace = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] vault.root_token_id = **** {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] vault.ssl_ca_crt_file = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] vault.timeout = 60.0 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] vault.token_file = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] vault.token_role = None {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] vault.use_ssl = False {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:40:46 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] ******************************************************************************** {{(pid=86678) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 08 06:40:46 devstack sudo[86931]: pam_unix(sudo:session): session closed for user root Sep 08 06:40:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7ef2b4ce-369a-4554-a84e-1c8a6d809249 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.391s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:40:46 devstack cinder-volume[86925]: INFO cinder.volume.drivers.quobyte [None req-7ef2b4ce-369a-4554-a84e-1c8a6d809249 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d succeeded Sep 08 06:40:46 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-7ef2b4ce-369a-4554-a84e-1c8a6d809249 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:40:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-7ef2b4ce-369a-4554-a84e-1c8a6d809249 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.402s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:40:46 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7ef2b4ce-369a-4554-a84e-1c8a6d809249 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:40:46 devstack sudo[87000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:40:46 devstack sudo[87000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:40:47 devstack sudo[87000]: pam_unix(sudo:session): session closed for user root Sep 08 06:40:47 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7ef2b4ce-369a-4554-a84e-1c8a6d809249 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.242s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:40:47 devstack cinder-volume[86925]: INFO cinder.volume.driver [None req-7ef2b4ce-369a-4554-a84e-1c8a6d809249 None None] Driver hasn't implemented _init_vendor_properties() Sep 08 06:40:47 devstack cinder-volume[86925]: DEBUG cinder.volume.driver [None req-7ef2b4ce-369a-4554-a84e-1c8a6d809249 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5347785949707, 'free_capacity_gb': 1773.5347785949707, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86925) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 08 06:40:47 devstack cinder-volume[86925]: DEBUG oslo_db.sqlalchemy.engines [None req-7ef2b4ce-369a-4554-a84e-1c8a6d809249 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86925) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 08 06:40:47 devstack cinder-volume[86925]: DEBUG dbcounter [-] [86925] Writer thread running {{(pid=86925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 08 06:40:47 devstack cinder-volume[86925]: DEBUG cinder.db.api [None req-7ef2b4ce-369a-4554-a84e-1c8a6d809249 None None] Building query based on filter {{(pid=86925) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 08 06:40:47 devstack cinder-volume[86925]: DEBUG cinder.image.image_utils [None req-7ef2b4ce-369a-4554-a84e-1c8a6d809249 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86925) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 08 06:40:47 devstack cinder-volume[86925]: INFO cinder.keymgr.migration [None req-dc061a83-1b22-4739-9cfa-26b02b6685ca None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 08 06:40:47 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-7ef2b4ce-369a-4554-a84e-1c8a6d809249 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:40:47 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-7ef2b4ce-369a-4554-a84e-1c8a6d809249 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:40:47 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-7ef2b4ce-369a-4554-a84e-1c8a6d809249 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:40:47 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-7ef2b4ce-369a-4554-a84e-1c8a6d809249 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:40:47 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-7ef2b4ce-369a-4554-a84e-1c8a6d809249 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:40:47 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7ef2b4ce-369a-4554-a84e-1c8a6d809249 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:40:47 devstack sudo[87004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:40:47 devstack sudo[87004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:40:47 devstack sudo[87004]: pam_unix(sudo:session): session closed for user root Sep 08 06:40:47 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7ef2b4ce-369a-4554-a84e-1c8a6d809249 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.232s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:40:47 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-7ef2b4ce-369a-4554-a84e-1c8a6d809249 None None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:40:47 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-7ef2b4ce-369a-4554-a84e-1c8a6d809249 None None] Driver initialization completed successfully. Sep 08 06:40:47 devstack cinder-volume[86925]: INFO cinder.manager [None req-7ef2b4ce-369a-4554-a84e-1c8a6d809249 None None] Initiating service 3 cleanup Sep 08 06:40:47 devstack cinder-volume[86925]: INFO cinder.manager [None req-7ef2b4ce-369a-4554-a84e-1c8a6d809249 None None] Service 3 cleanup completed. Sep 08 06:40:47 devstack cinder-volume[86925]: DEBUG cinder.service [None req-7ef2b4ce-369a-4554-a84e-1c8a6d809249 None None] Creating RPC server for service cinder-volume {{(pid=86925) start /opt/stack/cinder/cinder/service.py:231}} Sep 08 06:40:47 devstack cinder-volume[86925]: DEBUG cinder.service [None req-7ef2b4ce-369a-4554-a84e-1c8a6d809249 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86925) start /opt/stack/cinder/cinder/service.py:237}} Sep 08 06:40:47 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-7ef2b4ce-369a-4554-a84e-1c8a6d809249 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 08 06:40:47 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-7ef2b4ce-369a-4554-a84e-1c8a6d809249 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:40:47 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-7ef2b4ce-369a-4554-a84e-1c8a6d809249 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:40:47 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-7ef2b4ce-369a-4554-a84e-1c8a6d809249 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:40:47 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-7ef2b4ce-369a-4554-a84e-1c8a6d809249 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:40:47 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-7ef2b4ce-369a-4554-a84e-1c8a6d809249 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:40:47 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7ef2b4ce-369a-4554-a84e-1c8a6d809249 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:40:47 devstack sudo[87007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:40:47 devstack sudo[87007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:40:47 devstack sudo[87007]: pam_unix(sudo:session): session closed for user root Sep 08 06:40:47 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-7ef2b4ce-369a-4554-a84e-1c8a6d809249 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.238s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:40:47 devstack cinder-volume[86925]: INFO cinder.volume.manager [None req-7ef2b4ce-369a-4554-a84e-1c8a6d809249 None None] Driver post RPC initialization completed successfully. Sep 08 06:40:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-686b45fb-2bcd-4b4b-8daa-07c95738a29f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:40:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-686b45fb-2bcd-4b4b-8daa-07c95738a29f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:40:52 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-686b45fb-2bcd-4b4b-8daa-07c95738a29f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=86925) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:40:52 devstack cinder-volume[86925]: DEBUG cinder.volume.drivers.quobyte [None req-686b45fb-2bcd-4b4b-8daa-07c95738a29f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=86925) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:40:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-686b45fb-2bcd-4b4b-8daa-07c95738a29f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86925) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:40:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-686b45fb-2bcd-4b4b-8daa-07c95738a29f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:40:52 devstack sudo[87155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:40:52 devstack sudo[87155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:40:52 devstack cinder-volume[86678]: INFO oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] Caught SIGTERM, stopping children Sep 08 06:40:52 devstack cinder-volume[86678]: DEBUG oslo_concurrency.lockutils [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] Acquiring lock "singleton_lock" {{(pid=86678) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 08 06:40:52 devstack cinder-volume[86678]: DEBUG oslo_concurrency.lockutils [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] Acquired lock "singleton_lock" {{(pid=86678) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 08 06:40:52 devstack cinder-volume[86678]: DEBUG oslo_concurrency.lockutils [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] Releasing lock "singleton_lock" {{(pid=86678) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 08 06:40:52 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] Stop services. {{(pid=86678) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 08 06:40:52 devstack cinder-volume[86678]: DEBUG oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] Killing children. {{(pid=86678) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 08 06:40:52 devstack cinder-volume[86678]: INFO oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] Waiting on 1 children to exit Sep 08 06:40:52 devstack sudo[87155]: pam_unix(sudo:session): session closed for user root Sep 08 06:40:52 devstack cinder-volume[86925]: DEBUG oslo_concurrency.processutils [None req-686b45fb-2bcd-4b4b-8daa-07c95738a29f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.299s {{(pid=86925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:40:52 devstack cinder-volume[86925]: DEBUG cinder.manager [None req-686b45fb-2bcd-4b4b-8daa-07c95738a29f None None] Notifying Schedulers of capabilities ... {{(pid=86925) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo.messaging._drivers.impl_rabbit [None req-686b45fb-2bcd-4b4b-8daa-07c95738a29f None None] Failed to publish message to topic 'cinder-scheduler_fanout': Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo.messaging._drivers.impl_rabbit [None req-686b45fb-2bcd-4b4b-8daa-07c95738a29f None None] Unable to connect to AMQP server on 192.168.122.168:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server [None req-686b45fb-2bcd-4b4b-8daa-07c95738a29f None None] Exception during message handling: oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.168:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1109, in ensure Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server ret, channel = autoretry_method() Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^ Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 558, in _ensured Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server return fun(*args, **kwargs) Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^ Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 641, in __call__ Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server return fun(*args, channel=channels[0], **kwargs), channels[0] Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1098, in execute_method Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server method() Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1560, in _publish Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server self._producer.publish( Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 190, in publish Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server return _publish( Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server ^^^^^^^^^ Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 214, in _publish Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server return channel.basic_publish( Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 1820, in basic_publish_confirm Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server self.wait([spec.Basic.Ack, spec.Basic.Nack], Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 99, in wait Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server self.connection.drain_events(timeout=timeout) Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 526, in drain_events Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server while not self.blocking_read(timeout): Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 532, in blocking_read Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server return self.on_inbound_frame(frame) Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/method_framing.py", line 53, in on_frame Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server callback(channel, method_sig, buf, None) Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 538, in on_inbound_method Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server return self.channels[channel_id].dispatch_method( Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 156, in dispatch_method Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server listener(*args) Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 293, in _on_close Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server raise error_for_code( Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred: Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 176, in _process_incoming Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 2906, in publish_service_capabilities Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server self._publish_service_capabilities(context) Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/manager.py", line 220, in _publish_service_capabilities Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server self.scheduler_rpcapi.update_service_capabilities( Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/scheduler/rpcapi.py", line 222, in update_service_capabilities Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server cctxt.cast(ctxt, 'update_service_capabilities', **msg_args) Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/client.py", line 161, in cast Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server self.transport._send( Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/transport.py", line 123, in _send Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server return self._driver.send(target, ctxt, message, Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 794, in send Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server return self._send(target, ctxt, message, wait_for_reply, timeout, Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 769, in _send Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server conn.fanout_send(target.topic, msg, retry=retry) Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1679, in fanout_send Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server self._ensure_publishing(self._publish, exchange, msg, retry=retry) Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1509, in _ensure_publishing Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server self.ensure(method, retry=retry, error_callback=_error_callback) Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1131, in ensure Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server raise exceptions.MessageDeliveryFailure(msg) Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.168:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 08 06:40:52 devstack cinder-volume[86925]: ERROR oslo_messaging.rpc.server Sep 08 06:40:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] Acquiring lock "singleton_lock" {{(pid=86925) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 08 06:40:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] Acquired lock "singleton_lock" {{(pid=86925) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 08 06:40:55 devstack cinder-volume[86925]: DEBUG oslo_concurrency.lockutils [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] Releasing lock "singleton_lock" {{(pid=86925) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 08 06:40:55 devstack cinder-volume[86925]: WARNING amqp [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 08 06:40:55 devstack cinder-volume[86925]: WARNING amqp [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 08 06:40:55 devstack cinder-volume[86678]: INFO oslo_service.backend._eventlet.service [None req-4f4f539c-cb18-43ee-86ce-fd48f68981dc None None] Child 86925 exited with status 0 Sep 08 06:40:56 devstack cinder-volume[87208]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 08 06:40:56 devstack cinder-volume[87208]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 08 06:40:56 devstack cinder-volume[87208]: we strongly recommend against using it for new projects. Sep 08 06:40:56 devstack cinder-volume[87208]: If you are already using Eventlet, we recommend migrating to a different Sep 08 06:40:56 devstack cinder-volume[87208]: framework. For more detail see Sep 08 06:40:56 devstack cinder-volume[87208]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 08 06:40:56 devstack cinder-volume[87208]: import eventlet # noqa Sep 08 06:40:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87208) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 08 06:40:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87208) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 08 06:40:59 devstack cinder-volume[87208]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87208) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 08 06:41:00 devstack cinder-volume[87208]: INFO dbcounter [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] Registered counter for database cinder Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_db.sqlalchemy.engines [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87208) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG dbcounter [-] [87208] Writer thread running {{(pid=87208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 08 06:41:00 devstack cinder-volume[87208]: INFO cinder.rpc [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 08 06:41:00 devstack cinder-volume[87208]: INFO cinder.rpc [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_db.sqlalchemy.engines [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87208) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 08 06:41:00 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] Determined volume DB was empty at startup. Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG cinder.volume.manager [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87208) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 08 06:41:00 devstack cinder-volume[87208]: WARNING stevedore.named [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 08 06:41:00 devstack cinder-volume[87208]: WARNING castellan.key_manager [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 08 06:41:00 devstack cinder-volume[87208]: WARNING cinder.keymgr.conf_key_mgr [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 08 06:41:00 devstack cinder-volume[87208]: INFO cinder.volume.manager [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_db.sqlalchemy.engines [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87208) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 08 06:41:00 devstack cinder-volume[87208]: INFO oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] Starting 1 workers Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] Started child 87507 {{(pid=87208) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] Full set of CONF: {{(pid=87208) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] ******************************************************************************** {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] Configuration options gathered from: {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] ================================================================================ {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] allow_availability_zone_fallback = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] allow_compression_on_image_upload = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] allowed_direct_url_schemes = [] {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87507]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] api_rate_limit = True {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] auth_strategy = keystone {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_availability_zone = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_host = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_name = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_stats_polling_interval = 60 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backup_api_class = cinder.backup.api.API {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backup_name_template = backup-%s {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backup_use_same_host = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backup_use_temp_snapshot = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] chap_password = **** {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] chap_username = {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] cinder_internal_tenant_project_id = 955d53d82db04a9382251268e397d2c8 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] cinder_internal_tenant_user_id = 0c1ec087147f4577a1634d9e6801ec71 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] cluster = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] compression_format = gzip {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] compute_api_class = cinder.compute.nova.API {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] config_dir = [] {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] config_source = [] {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] control_exchange = openstack {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] debug = True {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] default_availability_zone = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] default_group_type = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] default_volume_type = QuobyteHD {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] disk_geometry = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] driver_client_cert = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] driver_client_cert_key = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] driver_data_namespace = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] driver_ssl_cert_path = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] driver_ssl_cert_verify = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] driver_use_ssl = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] enable_new_services = True {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] enable_unsupported_driver = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] enabled_backends = ['QuobyteHD'] {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] enforce_multipath_for_image_xfer = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] filter_function = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] glance_api_insecure = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] glance_api_servers = ['http://192.168.122.168/image'] {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] glance_api_ssl_compression = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] glance_ca_certificates_file = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] glance_catalog_info = image:glance:publicURL {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] glance_certfile = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] glance_keyfile = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] glance_num_retries = 3 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] glance_request_timeout = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] goodness_function = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] graceful_shutdown_timeout = 5 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] group_api_class = cinder.group.api.API {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] host = devstack {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] image_compress_on_upload = True {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] image_conversion_address_space_limit = 1 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] image_conversion_cpu_limit = 60 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] image_conversion_disable = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] image_upload_use_cinder_backend = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] image_upload_use_internal_tenant = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] image_volume_cache_enabled = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] image_volume_cache_max_count = 0 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] image_volume_cache_max_size_gb = 0 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] init_host_max_objects_retrieval = 0 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] instance_format = [instance: %(uuid)s] {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] iscsi_target_flags = {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] iscsi_write_cache = on {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] iser_helper = tgtadm {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] iser_ip_address = 192.168.122.168 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] iser_port = 3260 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] log_color = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] log_config_append = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] log_dir = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] log_file = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] log_options = True {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] log_rotate_interval = 1 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] log_rotate_interval_type = days {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] log_rotation_type = none {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] max_age = 0 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] max_logfile_count = 30 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] max_logfile_size_mb = 200 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] max_over_subscription_ratio = 20.0 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] message_reap_interval = 86400 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] message_ttl = 2592000 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] migration_create_volume_timeout_secs = 300 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] monkey_patch = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] monkey_patch_modules = [] {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] my_ip = 192.168.122.168 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] no_snapshot_gb_quota = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] num_iser_scan_tries = 3 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] num_shell_tries = 3 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] num_volume_device_scan_tries = 3 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] nvmeof_conn_info_version = 1 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] nvmet_ns_id = 10 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] nvmet_port_id = 1 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-f8a50091-7ebb-4056-96e9-61c1dd25fcc2 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] osapi_max_limit = 1000 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] osapi_volume_ext_list = [] {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] osapi_volume_listen_port = 8776 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] osapi_volume_use_ssl = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] osapi_volume_workers = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] per_volume_size_limit = -1 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] periodic_fuzzy_delay = 60 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] periodic_interval = 60 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] public_endpoint = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] publish_errors = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-f8a50091-7ebb-4056-96e9-61c1dd25fcc2 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87507) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] quota_backup_gigabytes = 1000 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] quota_backups = 10 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] quota_gigabytes = 1000 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] quota_groups = 10 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] quota_snapshots = 10 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] quota_volumes = 10 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] rate_limit_burst = 0 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] rate_limit_except_level = CRITICAL {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] rate_limit_interval = 0 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] reinit_driver_count = 3 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] replication_device = **** {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] report_discard_supported = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] report_interval = 120 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] reservation_clean_interval = 86400 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] reservation_expire = 86400 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] reserved_image_namespaces = [] {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] reserved_percentage = 0 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] rpc_response_timeout = 120 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] run_external_periodic_tasks = True {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] scst_target_driver = iscsi {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] scst_target_iqn_name = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] service_down_time = 720 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] shell_completion = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] snapshot_name_template = snapshot-%s {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] split_loggers = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] state_path = /opt/stack/data/cinder {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] storage_availability_zone = nova {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] storage_protocol = iSCSI {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] syslog_log_facility = LOG_USER {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] target_helper = lioadm {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] target_ip_address = 192.168.122.168 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] target_port = 3260 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] target_protocol = iscsi {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] target_secondary_ip_addresses = [] {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] trace_flags = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] transport_url = **** {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] until_refresh = 0 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] use_chap_auth = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] use_default_quota_class = True {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] use_journal = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] use_json = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] use_multipath_for_image_xfer = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] use_stderr = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] use_syslog = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] verify_glance_signatures = enabled {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] volume_api_class = cinder.volume.api.API {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] volume_backend_name = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] volume_clear = zero {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] volume_clear_ionice = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] volume_clear_size = 0 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] volume_copy_bps_limit = 0 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] volume_dd_blocksize = 1M {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] volume_name_template = volume-%s {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] volume_service_inithost_offload = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] volume_usage_audit_period = month {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] zoning_mode = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] oslo_concurrency.disable_process_locking = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] keystone_authtoken.auth_section = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] keystone_authtoken.auth_type = password {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] keystone_authtoken.auth_version = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] keystone_authtoken.cache = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] keystone_authtoken.certfile = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] keystone_authtoken.include_service_catalog = True {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] keystone_authtoken.insecure = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] keystone_authtoken.interface = public {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] keystone_authtoken.keyfile = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] keystone_authtoken.memcache_password = **** {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] keystone_authtoken.memcache_username = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] keystone_authtoken.region_name = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] keystone_authtoken.service_type = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.168/identity {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] cache.backend = dogpile.cache.null {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] cache.backend_argument = **** {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] cache.backend_expiration_time = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] cache.config_prefix = cache.oslo {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] cache.debug_cache_backend = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] cache.enable_retry_client = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] cache.enable_socket_keepalive = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] cache.enabled = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] cache.expiration_time = 600 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] cache.hashclient_retry_attempts = 2 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] cache.memcache_dead_retry = 300 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] cache.memcache_pool_maxsize = 10 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] cache.memcache_sasl_enabled = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] cache.password = **** {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] cache.proxies = [] {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] cache.redis_db = 0 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] cache.redis_server = localhost:6379 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] cache.retry_attempts = 2 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] cache.retry_delay = 0.0 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] cache.socket_keepalive_count = 1 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] cache.socket_keepalive_idle = 1 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] cache.socket_keepalive_interval = 1 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] cache.socket_timeout = 1.0 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] cache.tls_allowed_ciphers = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] cache.tls_cafile = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] cache.tls_certfile = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] cache.tls_enabled = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] cache.tls_keyfile = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] cache.username = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] coordination.backend_url = **** {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] database.asyncio_connection = **** {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] database.asyncio_slave_connection = **** {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] database.backend = sqlalchemy {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] database.connection = **** {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] database.connection_debug = 0 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] database.connection_parameters = {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] database.connection_recycle_time = 3600 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] database.connection_trace = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] database.db_inc_retry_interval = True {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] database.db_max_retries = 20 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] database.db_max_retry_interval = 10 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] database.db_retry_interval = 1 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] database.max_overflow = 50 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] database.max_pool_size = 5 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] database.max_retries = 10 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] database.mysql_wsrep_sync_wait = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] database.pool_timeout = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] database.retry_interval = 10 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] database.slave_connection = **** {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] database.sqlite_synchronous = True {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] database.synchronous_reader = True {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] database.use_db_reconnect = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] oslo_messaging_tracing.insecure = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] profiler.connection_string = messaging:// {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] profiler.enabled = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] profiler.es_doc_type = notification {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] profiler.es_scroll_size = 10000 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] profiler.es_scroll_time = 2m {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] profiler.filter_error_trace = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] profiler.hmac_keys = **** {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] profiler.sentinel_service_name = mymaster {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] profiler.socket_timeout = 0.1 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] profiler.trace_requests = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] profiler.trace_sqlalchemy = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] profiler_jaeger.process_tags = {} {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] profiler_jaeger.service_name_prefix = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] profiler_otlp.service_name_prefix = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] oslo_policy.enforce_new_defaults = True {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] oslo_policy.policy_default_rule = default {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] oslo_policy.policy_file = policy.yaml {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] privsep_osbrick.group = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] privsep_osbrick.helper_command = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] privsep_osbrick.user = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] cinder_sys_admin.group = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] cinder_sys_admin.helper_command = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] cinder_sys_admin.user = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] service_user.auth_section = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] service_user.auth_type = password {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] service_user.cafile = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] service_user.certfile = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] service_user.collect_timing = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] service_user.insecure = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] service_user.keyfile = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] service_user.send_service_user_token = True {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] service_user.split_loggers = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] service_user.timeout = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] service_user.tls_ciphers = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] service_user.tls_min_version = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] glance.auth_section = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] glance.auth_type = password {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] glance.certfile = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] glance.collect_timing = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] glance.insecure = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] glance.keyfile = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] glance.region_name = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] glance.split_loggers = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] glance.timeout = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] glance.tls_ciphers = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] glance.tls_min_version = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.backend_availability_zone = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.chap_password = **** {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.chap_username = {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.disk_geometry = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.driver_client_cert = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.driver_client_cert_key = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.driver_data_namespace = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.driver_use_ssl = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.extra_capabilities = {} {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.filter_function = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.goodness_function = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.iscsi_target_flags = {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.iscsi_write_cache = on {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.iser_helper = tgtadm {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.iser_ip_address = 192.168.122.168 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.iser_port = 3260 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.nas_host = {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.nas_login = admin {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.nas_mount_options = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.nas_password = **** {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.nas_private_key = {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.nas_share_path = {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.num_shell_tries = 3 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-f8a50091-7ebb-4056-96e9-61c1dd25fcc2 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87507) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.quobyte [None req-f8a50091-7ebb-4056-96e9-61c1dd25fcc2 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.quobyte_volume_url = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.replication_device = **** {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.report_discard_supported = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.reserved_percentage = 0 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.target_helper = tgtadm {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.target_ip_address = 192.168.122.168 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.target_port = 3260 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.quobyte [None req-f8a50091-7ebb-4056-96e9-61c1dd25fcc2 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.target_protocol = iscsi {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.trace_flags = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.unique_fqdn_network = True {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f8a50091-7ebb-4056-96e9-61c1dd25fcc2 None None] Running cmd (subprocess): mount.quobyte {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.use_chap_auth = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.volume_backend_name = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.volume_clear = zero {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.volume_clear_ionice = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.volume_clear_size = 0 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] oslo_reports.file_event_handler = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] oslo_reports.log_dir = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.backend_availability_zone = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.backend_host = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.chap_password = **** {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.chap_username = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.chiscsi_conf = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.disk_geometry = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.driver_client_cert = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.driver_data_namespace = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.driver_use_ssl = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.extra_capabilities = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.filter_function = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.goodness_function = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.iser_helper = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.iser_ip_address = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.iser_port = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.iser_target_prefix = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.nas_host = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.nas_login = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.nas_mount_options = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.nas_password = **** {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.nas_private_key = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.nas_share_path = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.nas_ssh_port = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.num_shell_tries = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.nvmet_port_id = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.replication_device = **** {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.report_discard_supported = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.reserved_percentage = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.scst_target_driver = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.storage_protocol = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.target_helper = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.target_ip_address = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.target_port = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.target_prefix = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.target_protocol = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.trace_flags = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.use_chap_auth = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.volume_clear = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.volume_clear_size = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] QuobyteHD.volumes_dir = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] oslo_messaging_rabbit.ssl = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] oslo_messaging_notifications.driver = [] {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] oslo_messaging_notifications.retry = -1 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack quobyte-client[87508]: Reading configuration file: /etc/quobyte/client.cfg Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] key_manager.fixed_key = **** {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack quobyte-client[87508]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] barbican.barbican_api_version = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] barbican.barbican_endpoint = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] barbican.barbican_endpoint_type = public {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] barbican.barbican_region_name = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f8a50091-7ebb-4056-96e9-61c1dd25fcc2 None None] CMD "mount.quobyte" returned: 1 in 0.073s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:41:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-f8a50091-7ebb-4056-96e9-61c1dd25fcc2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:41:01 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] barbican.cafile = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:01 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] barbican.certfile = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:01 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] barbican.collect_timing = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-f8a50091-7ebb-4056-96e9-61c1dd25fcc2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:41:01 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-f8a50091-7ebb-4056-96e9-61c1dd25fcc2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:41:01 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] barbican.insecure = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:01 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] barbican.keyfile = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:01 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] barbican.number_of_retries = 60 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:01 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] barbican.retry_delay = 1 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:01 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] barbican.send_service_user_token = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:01 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] barbican.split_loggers = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:01 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] barbican.timeout = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:01 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] barbican.tls_ciphers = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:01 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] barbican.tls_min_version = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:01 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] barbican.verify_ssl = True {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:01 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] barbican.verify_ssl_path = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:01 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] barbican_service_user.auth_section = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:01 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] barbican_service_user.auth_type = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:01 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] barbican_service_user.cafile = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:01 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] barbican_service_user.certfile = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:01 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] barbican_service_user.collect_timing = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:01 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] barbican_service_user.insecure = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:01 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] barbican_service_user.keyfile = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:01 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] barbican_service_user.split_loggers = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:01 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] barbican_service_user.timeout = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:01 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] barbican_service_user.tls_ciphers = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:01 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] barbican_service_user.tls_min_version = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:01 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] vault.approle_role_id = **** {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:01 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] vault.approle_secret_id = **** {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:01 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-f8a50091-7ebb-4056-96e9-61c1dd25fcc2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:41:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-f8a50091-7ebb-4056-96e9-61c1dd25fcc2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:41:01 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] vault.auth_method = approle {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f8a50091-7ebb-4056-96e9-61c1dd25fcc2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:41:01 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] vault.auth_path = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:01 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] vault.kv_mountpoint = secret {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:01 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] vault.kv_path = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:01 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] vault.kv_version = 2 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:01 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] vault.namespace = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:01 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] vault.root_token_id = **** {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:01 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] vault.ssl_ca_crt_file = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:01 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] vault.timeout = 60.0 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:01 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] vault.token_file = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:01 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] vault.token_role = None {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:01 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] vault.use_ssl = False {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:01 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 06:41:01 devstack cinder-volume[87208]: DEBUG oslo_service.backend._eventlet.service [None req-bac74fd1-fc0e-4106-a81e-705881ef4690 None None] ******************************************************************************** {{(pid=87208) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 08 06:41:01 devstack sudo[87517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:41:01 devstack sudo[87517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:41:01 devstack sudo[87517]: pam_unix(sudo:session): session closed for user root Sep 08 06:41:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f8a50091-7ebb-4056-96e9-61c1dd25fcc2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.254s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:41:01 devstack cinder-volume[87507]: INFO cinder.volume.driver [None req-f8a50091-7ebb-4056-96e9-61c1dd25fcc2 None None] Driver hasn't implemented _init_vendor_properties() Sep 08 06:41:01 devstack cinder-volume[87507]: DEBUG cinder.volume.driver [None req-f8a50091-7ebb-4056-96e9-61c1dd25fcc2 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5347785949707, 'free_capacity_gb': 1773.5347785949707, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87507) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 08 06:41:01 devstack cinder-volume[87507]: DEBUG oslo_db.sqlalchemy.engines [None req-f8a50091-7ebb-4056-96e9-61c1dd25fcc2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87507) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 08 06:41:01 devstack cinder-volume[87507]: DEBUG dbcounter [-] [87507] Writer thread running {{(pid=87507) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 08 06:41:01 devstack cinder-volume[87507]: DEBUG cinder.db.api [None req-f8a50091-7ebb-4056-96e9-61c1dd25fcc2 None None] Building query based on filter {{(pid=87507) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 08 06:41:01 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-f8a50091-7ebb-4056-96e9-61c1dd25fcc2 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87507) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 08 06:41:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-f8a50091-7ebb-4056-96e9-61c1dd25fcc2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:41:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-f8a50091-7ebb-4056-96e9-61c1dd25fcc2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:41:01 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-f8a50091-7ebb-4056-96e9-61c1dd25fcc2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:41:01 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-f8a50091-7ebb-4056-96e9-61c1dd25fcc2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:41:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-f8a50091-7ebb-4056-96e9-61c1dd25fcc2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:41:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f8a50091-7ebb-4056-96e9-61c1dd25fcc2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:41:01 devstack cinder-volume[87507]: INFO cinder.keymgr.migration [None req-c0ec336c-4f5b-4190-894d-914883c1805e None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 08 06:41:01 devstack sudo[87528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:41:01 devstack sudo[87528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:41:01 devstack sudo[87528]: pam_unix(sudo:session): session closed for user root Sep 08 06:41:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f8a50091-7ebb-4056-96e9-61c1dd25fcc2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.241s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:41:01 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-f8a50091-7ebb-4056-96e9-61c1dd25fcc2 None None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:41:01 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-f8a50091-7ebb-4056-96e9-61c1dd25fcc2 None None] Driver initialization completed successfully. Sep 08 06:41:01 devstack cinder-volume[87507]: INFO cinder.manager [None req-f8a50091-7ebb-4056-96e9-61c1dd25fcc2 None None] Initiating service 3 cleanup Sep 08 06:41:01 devstack cinder-volume[87507]: INFO cinder.manager [None req-f8a50091-7ebb-4056-96e9-61c1dd25fcc2 None None] Service 3 cleanup completed. Sep 08 06:41:01 devstack cinder-volume[87507]: DEBUG cinder.service [None req-f8a50091-7ebb-4056-96e9-61c1dd25fcc2 None None] Creating RPC server for service cinder-volume {{(pid=87507) start /opt/stack/cinder/cinder/service.py:231}} Sep 08 06:41:01 devstack cinder-volume[87507]: DEBUG cinder.service [None req-f8a50091-7ebb-4056-96e9-61c1dd25fcc2 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87507) start /opt/stack/cinder/cinder/service.py:237}} Sep 08 06:41:01 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-f8a50091-7ebb-4056-96e9-61c1dd25fcc2 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 08 06:41:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-f8a50091-7ebb-4056-96e9-61c1dd25fcc2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:41:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-f8a50091-7ebb-4056-96e9-61c1dd25fcc2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:41:01 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-f8a50091-7ebb-4056-96e9-61c1dd25fcc2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:41:01 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-f8a50091-7ebb-4056-96e9-61c1dd25fcc2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:41:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-f8a50091-7ebb-4056-96e9-61c1dd25fcc2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:41:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f8a50091-7ebb-4056-96e9-61c1dd25fcc2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:41:01 devstack sudo[87541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:41:01 devstack sudo[87541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:41:02 devstack sudo[87541]: pam_unix(sudo:session): session closed for user root Sep 08 06:41:02 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f8a50091-7ebb-4056-96e9-61c1dd25fcc2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.239s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:41:02 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-f8a50091-7ebb-4056-96e9-61c1dd25fcc2 None None] Driver post RPC initialization completed successfully. Sep 08 06:41:10 devstack cinder-volume[87208]: DEBUG dbcounter [-] [87208] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87208) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 06:41:11 devstack cinder-volume[87507]: DEBUG dbcounter [-] [87507] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87507) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 06:41:12 devstack cinder-volume[87507]: DEBUG dbcounter [-] [87507] Writing DB stats cinder:SELECT=2 {{(pid=87507) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 06:41:20 devstack cinder-volume[87507]: DEBUG oslo_service.periodic_task [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Running periodic task VolumeManager._thread_info {{(pid=87507) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 06:41:20 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] thread count: 6 {{(pid=87507) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 06:41:20 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] thread info: [<_MainThread(MainThread, started 127913129345152)>, , , , , ] {{(pid=87507) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 06:42:00 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bf80574-152f-4499-9d2c-db15be13832e tempest-VolumesTestJSON-1101720796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:42:00 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0bf80574-152f-4499-9d2c-db15be13832e tempest-VolumesTestJSON-1101720796 None] Flow 'volume_create_manager' (7df261d5-536c-4bc3-8a8b-36e8f8d9e60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:42:00 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0bf80574-152f-4499-9d2c-db15be13832e tempest-VolumesTestJSON-1101720796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21cf10fb-f632-43b4-ab57-3b3dca5d6708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:42:00 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0bf80574-152f-4499-9d2c-db15be13832e tempest-VolumesTestJSON-1101720796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21cf10fb-f632-43b4-ab57-3b3dca5d6708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:41:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-105218495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbeb3c84-727e-480f-a1b9-7403737d7774,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bc339130ea3f4e8a9a05845ec37c47a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:42:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:42:00Z,use_quota=True,user_id='c67116eb4d0e410aad96af8c7398aad9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:42:00 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0bf80574-152f-4499-9d2c-db15be13832e tempest-VolumesTestJSON-1101720796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60eafb7d-cbca-4f9f-9999-bac98702943a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:42:00 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0bf80574-152f-4499-9d2c-db15be13832e tempest-VolumesTestJSON-1101720796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60eafb7d-cbca-4f9f-9999-bac98702943a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:42:00 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0bf80574-152f-4499-9d2c-db15be13832e tempest-VolumesTestJSON-1101720796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0434a9d4-5aad-4afe-859a-997b17456532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:42:00 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0bf80574-152f-4499-9d2c-db15be13832e tempest-VolumesTestJSON-1101720796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0434a9d4-5aad-4afe-859a-997b17456532) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbeb3c84-727e-480f-a1b9-7403737d7774', 'volume_name': 'volume-cbeb3c84-727e-480f-a1b9-7403737d7774', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:42:00 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0bf80574-152f-4499-9d2c-db15be13832e tempest-VolumesTestJSON-1101720796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d37a93a-14c4-4d72-ae44-ea9e11be1f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:42:00 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0bf80574-152f-4499-9d2c-db15be13832e tempest-VolumesTestJSON-1101720796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d37a93a-14c4-4d72-ae44-ea9e11be1f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:42:00 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0bf80574-152f-4499-9d2c-db15be13832e tempest-VolumesTestJSON-1101720796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (215e33d8-e5b6-4906-9ac6-91d12c840f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:42:00 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-0bf80574-152f-4499-9d2c-db15be13832e tempest-VolumesTestJSON-1101720796 None] Volume cbeb3c84-727e-480f-a1b9-7403737d7774: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbeb3c84-727e-480f-a1b9-7403737d7774', 'volume_size': 1} Sep 08 06:42:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-0bf80574-152f-4499-9d2c-db15be13832e tempest-VolumesTestJSON-1101720796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:42:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-0bf80574-152f-4499-9d2c-db15be13832e tempest-VolumesTestJSON-1101720796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:42:00 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-0bf80574-152f-4499-9d2c-db15be13832e tempest-VolumesTestJSON-1101720796 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:41:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-105218495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbeb3c84-727e-480f-a1b9-7403737d7774,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bc339130ea3f4e8a9a05845ec37c47a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:42:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:42:00Z,use_quota=True,user_id='c67116eb4d0e410aad96af8c7398aad9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:42:00 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-0bf80574-152f-4499-9d2c-db15be13832e tempest-VolumesTestJSON-1101720796 None] Creating volume cbeb3c84-727e-480f-a1b9-7403737d7774 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:42:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-0bf80574-152f-4499-9d2c-db15be13832e tempest-VolumesTestJSON-1101720796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:42:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-0bf80574-152f-4499-9d2c-db15be13832e tempest-VolumesTestJSON-1101720796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:42:00 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-0bf80574-152f-4499-9d2c-db15be13832e tempest-VolumesTestJSON-1101720796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:42:00 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-0bf80574-152f-4499-9d2c-db15be13832e tempest-VolumesTestJSON-1101720796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:42:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-0bf80574-152f-4499-9d2c-db15be13832e tempest-VolumesTestJSON-1101720796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:42:00 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-0bf80574-152f-4499-9d2c-db15be13832e tempest-VolumesTestJSON-1101720796 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:42:00 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-0bf80574-152f-4499-9d2c-db15be13832e tempest-VolumesTestJSON-1101720796 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:42:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0bf80574-152f-4499-9d2c-db15be13832e tempest-VolumesTestJSON-1101720796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cbeb3c84-727e-480f-a1b9-7403737d7774 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:42:00 devstack sudo[88140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cbeb3c84-727e-480f-a1b9-7403737d7774 1073741824 Sep 08 06:42:00 devstack sudo[88140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:42:02 devstack sudo[88140]: pam_unix(sudo:session): session closed for user root Sep 08 06:42:02 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0bf80574-152f-4499-9d2c-db15be13832e tempest-VolumesTestJSON-1101720796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cbeb3c84-727e-480f-a1b9-7403737d7774 1073741824" returned: 0 in 1.241s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:42:02 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0bf80574-152f-4499-9d2c-db15be13832e tempest-VolumesTestJSON-1101720796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cbeb3c84-727e-480f-a1b9-7403737d7774 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:42:02 devstack sudo[88495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cbeb3c84-727e-480f-a1b9-7403737d7774 Sep 08 06:42:02 devstack sudo[88495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:42:02 devstack sudo[88495]: pam_unix(sudo:session): session closed for user root Sep 08 06:42:02 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0bf80574-152f-4499-9d2c-db15be13832e tempest-VolumesTestJSON-1101720796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cbeb3c84-727e-480f-a1b9-7403737d7774" returned: 0 in 0.444s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:42:02 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-0bf80574-152f-4499-9d2c-db15be13832e tempest-VolumesTestJSON-1101720796 None] <== create_volume: return (1778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:42:02 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-0bf80574-152f-4499-9d2c-db15be13832e tempest-VolumesTestJSON-1101720796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.782s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:42:02 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0bf80574-152f-4499-9d2c-db15be13832e tempest-VolumesTestJSON-1101720796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (215e33d8-e5b6-4906-9ac6-91d12c840f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbeb3c84-727e-480f-a1b9-7403737d7774', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:42:02 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0bf80574-152f-4499-9d2c-db15be13832e tempest-VolumesTestJSON-1101720796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a02ceb14-a535-4def-b465-f54de7fd3ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:42:02 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-0bf80574-152f-4499-9d2c-db15be13832e tempest-VolumesTestJSON-1101720796 None] Volume volume-cbeb3c84-727e-480f-a1b9-7403737d7774 (cbeb3c84-727e-480f-a1b9-7403737d7774): created successfully Sep 08 06:42:02 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0bf80574-152f-4499-9d2c-db15be13832e tempest-VolumesTestJSON-1101720796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a02ceb14-a535-4def-b465-f54de7fd3ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:42:02 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0bf80574-152f-4499-9d2c-db15be13832e tempest-VolumesTestJSON-1101720796 None] Flow 'volume_create_manager' (7df261d5-536c-4bc3-8a8b-36e8f8d9e60d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:42:02 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-0bf80574-152f-4499-9d2c-db15be13832e tempest-VolumesTestJSON-1101720796 None] Created volume successfully. Sep 08 06:42:05 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-13793a89-a8a5-4424-b7d7-960f5bc54af8 tempest-VolumesTestJSON-1101720796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:42:05 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-13793a89-a8a5-4424-b7d7-960f5bc54af8 tempest-VolumesTestJSON-1101720796 None] Flow 'volume_create_manager' (d9255dba-752d-45b5-8c3d-ca64595c6659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:42:05 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-13793a89-a8a5-4424-b7d7-960f5bc54af8 tempest-VolumesTestJSON-1101720796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d826129-75cd-44b3-9030-7bea8ddf6add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:42:05 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-13793a89-a8a5-4424-b7d7-960f5bc54af8 tempest-VolumesTestJSON-1101720796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d826129-75cd-44b3-9030-7bea8ddf6add) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:42:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1935461633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6cda441-6db9-4f9f-8776-6248f217fafd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bc339130ea3f4e8a9a05845ec37c47a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:42:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:42:05Z,use_quota=True,user_id='c67116eb4d0e410aad96af8c7398aad9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:42:05 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-13793a89-a8a5-4424-b7d7-960f5bc54af8 tempest-VolumesTestJSON-1101720796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e38101e-ee98-415e-aa8f-f5f76c08f9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:42:05 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-13793a89-a8a5-4424-b7d7-960f5bc54af8 tempest-VolumesTestJSON-1101720796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e38101e-ee98-415e-aa8f-f5f76c08f9eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:42:05 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-13793a89-a8a5-4424-b7d7-960f5bc54af8 tempest-VolumesTestJSON-1101720796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d166483f-37a0-4145-97ff-3cb50082a18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:42:05 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-13793a89-a8a5-4424-b7d7-960f5bc54af8 tempest-VolumesTestJSON-1101720796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d166483f-37a0-4145-97ff-3cb50082a18a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6cda441-6db9-4f9f-8776-6248f217fafd', 'volume_name': 'volume-f6cda441-6db9-4f9f-8776-6248f217fafd', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:42:05 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-13793a89-a8a5-4424-b7d7-960f5bc54af8 tempest-VolumesTestJSON-1101720796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aed9f5b-9296-4c31-b41d-ac927f887b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:42:05 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-13793a89-a8a5-4424-b7d7-960f5bc54af8 tempest-VolumesTestJSON-1101720796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aed9f5b-9296-4c31-b41d-ac927f887b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:42:05 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-13793a89-a8a5-4424-b7d7-960f5bc54af8 tempest-VolumesTestJSON-1101720796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae637fb1-ee79-4d76-b227-f67d4e21495c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:42:05 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-13793a89-a8a5-4424-b7d7-960f5bc54af8 tempest-VolumesTestJSON-1101720796 None] Volume f6cda441-6db9-4f9f-8776-6248f217fafd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6cda441-6db9-4f9f-8776-6248f217fafd', 'volume_size': 1} Sep 08 06:42:05 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-13793a89-a8a5-4424-b7d7-960f5bc54af8 tempest-VolumesTestJSON-1101720796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:42:05 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-13793a89-a8a5-4424-b7d7-960f5bc54af8 tempest-VolumesTestJSON-1101720796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:42:05 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-13793a89-a8a5-4424-b7d7-960f5bc54af8 tempest-VolumesTestJSON-1101720796 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:42:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1935461633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6cda441-6db9-4f9f-8776-6248f217fafd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bc339130ea3f4e8a9a05845ec37c47a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:42:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:42:05Z,use_quota=True,user_id='c67116eb4d0e410aad96af8c7398aad9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:42:05 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-13793a89-a8a5-4424-b7d7-960f5bc54af8 tempest-VolumesTestJSON-1101720796 None] Creating volume f6cda441-6db9-4f9f-8776-6248f217fafd {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:42:05 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-13793a89-a8a5-4424-b7d7-960f5bc54af8 tempest-VolumesTestJSON-1101720796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:42:05 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-13793a89-a8a5-4424-b7d7-960f5bc54af8 tempest-VolumesTestJSON-1101720796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:42:05 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-13793a89-a8a5-4424-b7d7-960f5bc54af8 tempest-VolumesTestJSON-1101720796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:42:05 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-13793a89-a8a5-4424-b7d7-960f5bc54af8 tempest-VolumesTestJSON-1101720796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:42:05 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-13793a89-a8a5-4424-b7d7-960f5bc54af8 tempest-VolumesTestJSON-1101720796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:42:05 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-13793a89-a8a5-4424-b7d7-960f5bc54af8 tempest-VolumesTestJSON-1101720796 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:42:05 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-13793a89-a8a5-4424-b7d7-960f5bc54af8 tempest-VolumesTestJSON-1101720796 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:42:05 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-13793a89-a8a5-4424-b7d7-960f5bc54af8 tempest-VolumesTestJSON-1101720796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f6cda441-6db9-4f9f-8776-6248f217fafd 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:42:05 devstack sudo[88545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f6cda441-6db9-4f9f-8776-6248f217fafd 1073741824 Sep 08 06:42:05 devstack sudo[88545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:42:06 devstack sudo[88545]: pam_unix(sudo:session): session closed for user root Sep 08 06:42:06 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-13793a89-a8a5-4424-b7d7-960f5bc54af8 tempest-VolumesTestJSON-1101720796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f6cda441-6db9-4f9f-8776-6248f217fafd 1073741824" returned: 0 in 0.966s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:42:06 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-13793a89-a8a5-4424-b7d7-960f5bc54af8 tempest-VolumesTestJSON-1101720796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f6cda441-6db9-4f9f-8776-6248f217fafd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:42:06 devstack sudo[88555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f6cda441-6db9-4f9f-8776-6248f217fafd Sep 08 06:42:06 devstack sudo[88555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:42:07 devstack sudo[88555]: pam_unix(sudo:session): session closed for user root Sep 08 06:42:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-13793a89-a8a5-4424-b7d7-960f5bc54af8 tempest-VolumesTestJSON-1101720796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f6cda441-6db9-4f9f-8776-6248f217fafd" returned: 0 in 0.335s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:42:07 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-13793a89-a8a5-4424-b7d7-960f5bc54af8 tempest-VolumesTestJSON-1101720796 None] <== create_volume: return (1407ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:42:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-13793a89-a8a5-4424-b7d7-960f5bc54af8 tempest-VolumesTestJSON-1101720796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.419s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:42:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-13793a89-a8a5-4424-b7d7-960f5bc54af8 tempest-VolumesTestJSON-1101720796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae637fb1-ee79-4d76-b227-f67d4e21495c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6cda441-6db9-4f9f-8776-6248f217fafd', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:42:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-13793a89-a8a5-4424-b7d7-960f5bc54af8 tempest-VolumesTestJSON-1101720796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69224351-bb36-43e0-b709-f32d2891d496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:42:07 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-13793a89-a8a5-4424-b7d7-960f5bc54af8 tempest-VolumesTestJSON-1101720796 None] Volume volume-f6cda441-6db9-4f9f-8776-6248f217fafd (f6cda441-6db9-4f9f-8776-6248f217fafd): created successfully Sep 08 06:42:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-13793a89-a8a5-4424-b7d7-960f5bc54af8 tempest-VolumesTestJSON-1101720796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69224351-bb36-43e0-b709-f32d2891d496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:42:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-13793a89-a8a5-4424-b7d7-960f5bc54af8 tempest-VolumesTestJSON-1101720796 None] Flow 'volume_create_manager' (d9255dba-752d-45b5-8c3d-ca64595c6659) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:42:07 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-13793a89-a8a5-4424-b7d7-960f5bc54af8 tempest-VolumesTestJSON-1101720796 None] Created volume successfully. Sep 08 06:42:08 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-4caa33d7-8e44-4c7e-a96a-e040eddd00f7 tempest-VolumesTestJSON-1101720796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:42:08 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4caa33d7-8e44-4c7e-a96a-e040eddd00f7 tempest-VolumesTestJSON-1101720796 None] Flow 'volume_create_manager' (23592eb5-85e5-4ab6-ab02-5637ee5e0c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:42:08 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4caa33d7-8e44-4c7e-a96a-e040eddd00f7 tempest-VolumesTestJSON-1101720796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (724cfc55-926e-4882-b4dd-fba2332f10ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:42:08 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4caa33d7-8e44-4c7e-a96a-e040eddd00f7 tempest-VolumesTestJSON-1101720796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (724cfc55-926e-4882-b4dd-fba2332f10ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:42:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-334206066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f28ab74-9a20-4202-92e4-e935cd823280,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bc339130ea3f4e8a9a05845ec37c47a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:42:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:42:09Z,use_quota=True,user_id='c67116eb4d0e410aad96af8c7398aad9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:42:08 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4caa33d7-8e44-4c7e-a96a-e040eddd00f7 tempest-VolumesTestJSON-1101720796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42974c42-43bf-4c96-bc3f-fef7c0a24c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:42:08 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4caa33d7-8e44-4c7e-a96a-e040eddd00f7 tempest-VolumesTestJSON-1101720796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42974c42-43bf-4c96-bc3f-fef7c0a24c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:42:08 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4caa33d7-8e44-4c7e-a96a-e040eddd00f7 tempest-VolumesTestJSON-1101720796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (323fee27-e274-4940-bfd2-cfa428a296ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:42:08 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4caa33d7-8e44-4c7e-a96a-e040eddd00f7 tempest-VolumesTestJSON-1101720796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (323fee27-e274-4940-bfd2-cfa428a296ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f28ab74-9a20-4202-92e4-e935cd823280', 'volume_name': 'volume-9f28ab74-9a20-4202-92e4-e935cd823280', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:42:08 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4caa33d7-8e44-4c7e-a96a-e040eddd00f7 tempest-VolumesTestJSON-1101720796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0fd1aca-178a-4ff8-b070-15e6b23485f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:42:08 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4caa33d7-8e44-4c7e-a96a-e040eddd00f7 tempest-VolumesTestJSON-1101720796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0fd1aca-178a-4ff8-b070-15e6b23485f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:42:08 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4caa33d7-8e44-4c7e-a96a-e040eddd00f7 tempest-VolumesTestJSON-1101720796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ff01f32-09e6-4b93-9fd6-38d66aa5bd90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:42:08 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-4caa33d7-8e44-4c7e-a96a-e040eddd00f7 tempest-VolumesTestJSON-1101720796 None] Volume 9f28ab74-9a20-4202-92e4-e935cd823280: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f28ab74-9a20-4202-92e4-e935cd823280', 'volume_size': 1} Sep 08 06:42:08 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4caa33d7-8e44-4c7e-a96a-e040eddd00f7 tempest-VolumesTestJSON-1101720796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:42:08 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4caa33d7-8e44-4c7e-a96a-e040eddd00f7 tempest-VolumesTestJSON-1101720796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:42:08 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-4caa33d7-8e44-4c7e-a96a-e040eddd00f7 tempest-VolumesTestJSON-1101720796 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:42:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-334206066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f28ab74-9a20-4202-92e4-e935cd823280,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bc339130ea3f4e8a9a05845ec37c47a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:42:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:42:09Z,use_quota=True,user_id='c67116eb4d0e410aad96af8c7398aad9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:42:08 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-4caa33d7-8e44-4c7e-a96a-e040eddd00f7 tempest-VolumesTestJSON-1101720796 None] Creating volume 9f28ab74-9a20-4202-92e4-e935cd823280 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:42:08 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4caa33d7-8e44-4c7e-a96a-e040eddd00f7 tempest-VolumesTestJSON-1101720796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:42:08 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4caa33d7-8e44-4c7e-a96a-e040eddd00f7 tempest-VolumesTestJSON-1101720796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:42:08 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-4caa33d7-8e44-4c7e-a96a-e040eddd00f7 tempest-VolumesTestJSON-1101720796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:42:08 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-4caa33d7-8e44-4c7e-a96a-e040eddd00f7 tempest-VolumesTestJSON-1101720796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:42:08 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4caa33d7-8e44-4c7e-a96a-e040eddd00f7 tempest-VolumesTestJSON-1101720796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:42:08 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-4caa33d7-8e44-4c7e-a96a-e040eddd00f7 tempest-VolumesTestJSON-1101720796 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:42:08 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-4caa33d7-8e44-4c7e-a96a-e040eddd00f7 tempest-VolumesTestJSON-1101720796 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:42:08 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4caa33d7-8e44-4c7e-a96a-e040eddd00f7 tempest-VolumesTestJSON-1101720796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9f28ab74-9a20-4202-92e4-e935cd823280 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:42:08 devstack sudo[88585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9f28ab74-9a20-4202-92e4-e935cd823280 1073741824 Sep 08 06:42:08 devstack sudo[88585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:42:09 devstack sudo[88585]: pam_unix(sudo:session): session closed for user root Sep 08 06:42:09 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4caa33d7-8e44-4c7e-a96a-e040eddd00f7 tempest-VolumesTestJSON-1101720796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9f28ab74-9a20-4202-92e4-e935cd823280 1073741824" returned: 0 in 0.940s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:42:09 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4caa33d7-8e44-4c7e-a96a-e040eddd00f7 tempest-VolumesTestJSON-1101720796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9f28ab74-9a20-4202-92e4-e935cd823280 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:42:10 devstack sudo[88629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9f28ab74-9a20-4202-92e4-e935cd823280 Sep 08 06:42:10 devstack sudo[88629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:42:10 devstack sudo[88629]: pam_unix(sudo:session): session closed for user root Sep 08 06:42:10 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4caa33d7-8e44-4c7e-a96a-e040eddd00f7 tempest-VolumesTestJSON-1101720796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9f28ab74-9a20-4202-92e4-e935cd823280" returned: 0 in 0.648s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:42:10 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-4caa33d7-8e44-4c7e-a96a-e040eddd00f7 tempest-VolumesTestJSON-1101720796 None] <== create_volume: return (1736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:42:10 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4caa33d7-8e44-4c7e-a96a-e040eddd00f7 tempest-VolumesTestJSON-1101720796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.739s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:42:10 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4caa33d7-8e44-4c7e-a96a-e040eddd00f7 tempest-VolumesTestJSON-1101720796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ff01f32-09e6-4b93-9fd6-38d66aa5bd90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f28ab74-9a20-4202-92e4-e935cd823280', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:42:10 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4caa33d7-8e44-4c7e-a96a-e040eddd00f7 tempest-VolumesTestJSON-1101720796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2836bfe1-eb9e-46b2-aeb9-628eef7fbb06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:42:10 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-4caa33d7-8e44-4c7e-a96a-e040eddd00f7 tempest-VolumesTestJSON-1101720796 None] Volume volume-9f28ab74-9a20-4202-92e4-e935cd823280 (9f28ab74-9a20-4202-92e4-e935cd823280): created successfully Sep 08 06:42:10 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4caa33d7-8e44-4c7e-a96a-e040eddd00f7 tempest-VolumesTestJSON-1101720796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2836bfe1-eb9e-46b2-aeb9-628eef7fbb06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:42:10 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4caa33d7-8e44-4c7e-a96a-e040eddd00f7 tempest-VolumesTestJSON-1101720796 None] Flow 'volume_create_manager' (23592eb5-85e5-4ab6-ab02-5637ee5e0c6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:42:11 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-4caa33d7-8e44-4c7e-a96a-e040eddd00f7 tempest-VolumesTestJSON-1101720796 None] Created volume successfully. Sep 08 06:42:11 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b64d82c-2186-4308-8f5b-c1206b69c9ef tempest-VolumesAdminNegativeTest-122789996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:42:11 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4b64d82c-2186-4308-8f5b-c1206b69c9ef tempest-VolumesAdminNegativeTest-122789996 None] Flow 'volume_create_manager' (5f2a35f6-6b74-4d49-bf2a-4630e5e0a53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:42:11 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4b64d82c-2186-4308-8f5b-c1206b69c9ef tempest-VolumesAdminNegativeTest-122789996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (150b0d5f-f53b-4b8c-bc8d-58a249cd1c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:42:11 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4b64d82c-2186-4308-8f5b-c1206b69c9ef tempest-VolumesAdminNegativeTest-122789996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (150b0d5f-f53b-4b8c-bc8d-58a249cd1c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:42:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1014140630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=676b5098-2673-4255-acf0-b554c2b31425,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d8000fe9ea24da58acb4f0a98957f2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:42:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:42:11Z,use_quota=True,user_id='c1fecc9637344c8499f2776a36e4b9ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:42:11 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4b64d82c-2186-4308-8f5b-c1206b69c9ef tempest-VolumesAdminNegativeTest-122789996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc2ad15f-3566-473f-8872-021b24b0b74d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:42:11 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4b64d82c-2186-4308-8f5b-c1206b69c9ef tempest-VolumesAdminNegativeTest-122789996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc2ad15f-3566-473f-8872-021b24b0b74d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:42:11 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4b64d82c-2186-4308-8f5b-c1206b69c9ef tempest-VolumesAdminNegativeTest-122789996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84d83884-739e-498e-b7b9-01aec592fddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:42:11 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4b64d82c-2186-4308-8f5b-c1206b69c9ef tempest-VolumesAdminNegativeTest-122789996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84d83884-739e-498e-b7b9-01aec592fddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '676b5098-2673-4255-acf0-b554c2b31425', 'volume_name': 'volume-676b5098-2673-4255-acf0-b554c2b31425', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:42:11 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4b64d82c-2186-4308-8f5b-c1206b69c9ef tempest-VolumesAdminNegativeTest-122789996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (935b02db-b675-4ab3-aff4-dfa0db869142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:42:11 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4b64d82c-2186-4308-8f5b-c1206b69c9ef tempest-VolumesAdminNegativeTest-122789996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (935b02db-b675-4ab3-aff4-dfa0db869142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:42:11 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4b64d82c-2186-4308-8f5b-c1206b69c9ef tempest-VolumesAdminNegativeTest-122789996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7011a454-98aa-4b44-b47f-716405d70052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:42:11 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-4b64d82c-2186-4308-8f5b-c1206b69c9ef tempest-VolumesAdminNegativeTest-122789996 None] Volume 676b5098-2673-4255-acf0-b554c2b31425: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-676b5098-2673-4255-acf0-b554c2b31425', 'volume_size': 1} Sep 08 06:42:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4b64d82c-2186-4308-8f5b-c1206b69c9ef tempest-VolumesAdminNegativeTest-122789996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:42:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4b64d82c-2186-4308-8f5b-c1206b69c9ef tempest-VolumesAdminNegativeTest-122789996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:42:11 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-4b64d82c-2186-4308-8f5b-c1206b69c9ef tempest-VolumesAdminNegativeTest-122789996 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:42:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1014140630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=676b5098-2673-4255-acf0-b554c2b31425,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d8000fe9ea24da58acb4f0a98957f2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:42:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:42:11Z,use_quota=True,user_id='c1fecc9637344c8499f2776a36e4b9ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:42:11 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-4b64d82c-2186-4308-8f5b-c1206b69c9ef tempest-VolumesAdminNegativeTest-122789996 None] Creating volume 676b5098-2673-4255-acf0-b554c2b31425 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:42:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4b64d82c-2186-4308-8f5b-c1206b69c9ef tempest-VolumesAdminNegativeTest-122789996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:42:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4b64d82c-2186-4308-8f5b-c1206b69c9ef tempest-VolumesAdminNegativeTest-122789996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:42:11 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-4b64d82c-2186-4308-8f5b-c1206b69c9ef tempest-VolumesAdminNegativeTest-122789996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:42:11 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-4b64d82c-2186-4308-8f5b-c1206b69c9ef tempest-VolumesAdminNegativeTest-122789996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:42:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4b64d82c-2186-4308-8f5b-c1206b69c9ef tempest-VolumesAdminNegativeTest-122789996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:42:11 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-4b64d82c-2186-4308-8f5b-c1206b69c9ef tempest-VolumesAdminNegativeTest-122789996 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:42:11 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-4b64d82c-2186-4308-8f5b-c1206b69c9ef tempest-VolumesAdminNegativeTest-122789996 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:42:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4b64d82c-2186-4308-8f5b-c1206b69c9ef tempest-VolumesAdminNegativeTest-122789996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-676b5098-2673-4255-acf0-b554c2b31425 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:42:11 devstack sudo[88673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-676b5098-2673-4255-acf0-b554c2b31425 1073741824 Sep 08 06:42:11 devstack sudo[88673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:42:12 devstack sudo[88673]: pam_unix(sudo:session): session closed for user root Sep 08 06:42:12 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4b64d82c-2186-4308-8f5b-c1206b69c9ef tempest-VolumesAdminNegativeTest-122789996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-676b5098-2673-4255-acf0-b554c2b31425 1073741824" returned: 0 in 0.965s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:42:12 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4b64d82c-2186-4308-8f5b-c1206b69c9ef tempest-VolumesAdminNegativeTest-122789996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-676b5098-2673-4255-acf0-b554c2b31425 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:42:12 devstack sudo[88681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-676b5098-2673-4255-acf0-b554c2b31425 Sep 08 06:42:12 devstack sudo[88681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:42:12 devstack sudo[88681]: pam_unix(sudo:session): session closed for user root Sep 08 06:42:12 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4b64d82c-2186-4308-8f5b-c1206b69c9ef tempest-VolumesAdminNegativeTest-122789996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-676b5098-2673-4255-acf0-b554c2b31425" returned: 0 in 0.644s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:42:12 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-4b64d82c-2186-4308-8f5b-c1206b69c9ef tempest-VolumesAdminNegativeTest-122789996 None] <== create_volume: return (1698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:42:12 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4b64d82c-2186-4308-8f5b-c1206b69c9ef tempest-VolumesAdminNegativeTest-122789996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.701s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:42:12 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4b64d82c-2186-4308-8f5b-c1206b69c9ef tempest-VolumesAdminNegativeTest-122789996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7011a454-98aa-4b44-b47f-716405d70052) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-676b5098-2673-4255-acf0-b554c2b31425', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:42:12 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4b64d82c-2186-4308-8f5b-c1206b69c9ef tempest-VolumesAdminNegativeTest-122789996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5a43431-a834-46f7-8b92-98edb7d7e7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:42:13 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-4b64d82c-2186-4308-8f5b-c1206b69c9ef tempest-VolumesAdminNegativeTest-122789996 None] Volume volume-676b5098-2673-4255-acf0-b554c2b31425 (676b5098-2673-4255-acf0-b554c2b31425): created successfully Sep 08 06:42:13 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4b64d82c-2186-4308-8f5b-c1206b69c9ef tempest-VolumesAdminNegativeTest-122789996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5a43431-a834-46f7-8b92-98edb7d7e7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:42:13 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4b64d82c-2186-4308-8f5b-c1206b69c9ef tempest-VolumesAdminNegativeTest-122789996 None] Flow 'volume_create_manager' (5f2a35f6-6b74-4d49-bf2a-4630e5e0a53a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:42:13 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-4b64d82c-2186-4308-8f5b-c1206b69c9ef tempest-VolumesAdminNegativeTest-122789996 None] Created volume successfully. Sep 08 06:42:13 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-a05c93fb-317b-42b7-8aa8-9d5476bd7669 tempest-VolumesTestJSON-1101720796 None] Acquiring lock "cinder-9f28ab74-9a20-4202-92e4-e935cd823280-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:42:13 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-a05c93fb-317b-42b7-8aa8-9d5476bd7669 tempest-VolumesTestJSON-1101720796 None] Lock "cinder-9f28ab74-9a20-4202-92e4-e935cd823280-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:42:13 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-a05c93fb-317b-42b7-8aa8-9d5476bd7669 tempest-VolumesTestJSON-1101720796 None] Acquiring lock "cinder-quobyte-9f28ab74-9a20-4202-92e4-e935cd823280" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:42:13 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-a05c93fb-317b-42b7-8aa8-9d5476bd7669 tempest-VolumesTestJSON-1101720796 None] Lock "cinder-quobyte-9f28ab74-9a20-4202-92e4-e935cd823280" acquired by "delete_volume" :: waited 0.030s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:42:13 devstack cinder-volume[87507]: INFO oslo.privsep.daemon [None req-a05c93fb-317b-42b7-8aa8-9d5476bd7669 tempest-VolumesTestJSON-1101720796 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpz0pj3zww/privsep.sock'] Sep 08 06:42:13 devstack sudo[88688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpz0pj3zww/privsep.sock Sep 08 06:42:13 devstack sudo[88688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:42:14 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-4352b08f-dfda-4f2d-9205-bc2e44e110c6 tempest-VolumesAdminNegativeTest-122789996 None] Acquiring lock "cinder-676b5098-2673-4255-acf0-b554c2b31425-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:42:14 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-4352b08f-dfda-4f2d-9205-bc2e44e110c6 tempest-VolumesAdminNegativeTest-122789996 None] Lock "cinder-676b5098-2673-4255-acf0-b554c2b31425-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:42:14 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-4352b08f-dfda-4f2d-9205-bc2e44e110c6 tempest-VolumesAdminNegativeTest-122789996 None] Acquiring lock "cinder-quobyte-676b5098-2673-4255-acf0-b554c2b31425" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:42:14 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-4352b08f-dfda-4f2d-9205-bc2e44e110c6 tempest-VolumesAdminNegativeTest-122789996 None] Lock "cinder-quobyte-676b5098-2673-4255-acf0-b554c2b31425" acquired by "delete_volume" :: waited 0.075s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:42:16 devstack cinder-volume[87507]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 08 06:42:16 devstack cinder-volume[87507]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 08 06:42:16 devstack cinder-volume[87507]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 08 06:42:16 devstack cinder-volume[87507]: WARNING oslo.privsep.daemon [-] privsep log: Sep 08 06:42:16 devstack cinder-volume[87507]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 08 06:42:16 devstack cinder-volume[87507]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 08 06:42:16 devstack cinder-volume[87507]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 08 06:42:16 devstack cinder-volume[87507]: WARNING oslo.privsep.daemon [-] privsep log: Sep 08 06:42:16 devstack cinder-volume[87507]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 08 06:42:16 devstack sudo[88688]: pam_unix(sudo:session): session closed for user root Sep 08 06:42:16 devstack cinder-volume[87507]: INFO oslo.privsep.daemon [None req-a05c93fb-317b-42b7-8aa8-9d5476bd7669 tempest-VolumesTestJSON-1101720796 None] Spawned new privsep daemon via rootwrap Sep 08 06:42:16 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [None req-a05c93fb-317b-42b7-8aa8-9d5476bd7669 tempest-VolumesTestJSON-1101720796 None] Accepted privsep connection to /tmp/tmpz0pj3zww/privsep.sock {{(pid=87507) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 08 06:42:16 devstack cinder-volume[87507]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 08 06:42:16 devstack cinder-volume[87507]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 08 06:42:16 devstack cinder-volume[87507]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 08 06:42:16 devstack cinder-volume[87507]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88698 Sep 08 06:42:16 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d40f91-ee16-4648-bff4-6a0ac0de1ad4]: (2,) {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:42:16 devstack cinder-volume[87507]: WARNING oslo_privsep.priv_context [None req-4352b08f-dfda-4f2d-9205-bc2e44e110c6 tempest-VolumesAdminNegativeTest-122789996 None] privsep daemon already running Sep 08 06:42:16 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aeb76c1-8471-4642-a6fc-b573e316a5db]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:42:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a05c93fb-317b-42b7-8aa8-9d5476bd7669 tempest-VolumesTestJSON-1101720796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9f28ab74-9a20-4202-92e4-e935cd823280 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:42:16 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42cfde0-8175-4bfe-b3b0-099a8b1f27e5]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:42:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4352b08f-dfda-4f2d-9205-bc2e44e110c6 tempest-VolumesAdminNegativeTest-122789996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-676b5098-2673-4255-acf0-b554c2b31425 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:42:16 devstack sudo[88716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-676b5098-2673-4255-acf0-b554c2b31425 Sep 08 06:42:16 devstack sudo[88716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:42:17 devstack sudo[88714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9f28ab74-9a20-4202-92e4-e935cd823280 Sep 08 06:42:17 devstack sudo[88714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:42:17 devstack sudo[88716]: pam_unix(sudo:session): session closed for user root Sep 08 06:42:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4352b08f-dfda-4f2d-9205-bc2e44e110c6 tempest-VolumesAdminNegativeTest-122789996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-676b5098-2673-4255-acf0-b554c2b31425" returned: 0 in 0.774s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:42:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4352b08f-dfda-4f2d-9205-bc2e44e110c6 tempest-VolumesAdminNegativeTest-122789996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-676b5098-2673-4255-acf0-b554c2b31425 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:42:17 devstack sudo[88729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-676b5098-2673-4255-acf0-b554c2b31425 Sep 08 06:42:17 devstack sudo[88729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:42:17 devstack sudo[88714]: pam_unix(sudo:session): session closed for user root Sep 08 06:42:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a05c93fb-317b-42b7-8aa8-9d5476bd7669 tempest-VolumesTestJSON-1101720796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9f28ab74-9a20-4202-92e4-e935cd823280" returned: 0 in 1.316s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:42:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a05c93fb-317b-42b7-8aa8-9d5476bd7669 tempest-VolumesTestJSON-1101720796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9f28ab74-9a20-4202-92e4-e935cd823280 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:42:18 devstack sudo[88737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9f28ab74-9a20-4202-92e4-e935cd823280 Sep 08 06:42:18 devstack sudo[88737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:42:18 devstack sudo[88729]: pam_unix(sudo:session): session closed for user root Sep 08 06:42:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4352b08f-dfda-4f2d-9205-bc2e44e110c6 tempest-VolumesAdminNegativeTest-122789996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-676b5098-2673-4255-acf0-b554c2b31425" returned: 0 in 0.654s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:42:18 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-4352b08f-dfda-4f2d-9205-bc2e44e110c6 tempest-VolumesAdminNegativeTest-122789996 None] Lock "cinder-quobyte-676b5098-2673-4255-acf0-b554c2b31425" released by "delete_volume" :: held 3.523s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:42:18 devstack cinder-volume[87507]: WARNING cinder.quota [None req-4352b08f-dfda-4f2d-9205-bc2e44e110c6 tempest-VolumesAdminNegativeTest-122789996 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 08 06:42:18 devstack cinder-volume[87507]: WARNING cinder.quota [None req-4352b08f-dfda-4f2d-9205-bc2e44e110c6 tempest-VolumesAdminNegativeTest-122789996 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 08 06:42:18 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-4352b08f-dfda-4f2d-9205-bc2e44e110c6 tempest-VolumesAdminNegativeTest-122789996 None] Created reservations ['61036b2d-9593-445b-a05f-f48800a0f414', 'a3df0fed-3c35-42e8-96d4-151ae95035d4', 'ee987c51-3b59-4e0a-b8da-1e603ac0b2ed', '144d7638-22fa-46a6-a8a3-433295a4312f'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:42:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4352b08f-dfda-4f2d-9205-bc2e44e110c6 tempest-VolumesAdminNegativeTest-122789996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:42:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4352b08f-dfda-4f2d-9205-bc2e44e110c6 tempest-VolumesAdminNegativeTest-122789996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:42:18 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-4352b08f-dfda-4f2d-9205-bc2e44e110c6 tempest-VolumesAdminNegativeTest-122789996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:42:18 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-4352b08f-dfda-4f2d-9205-bc2e44e110c6 tempest-VolumesAdminNegativeTest-122789996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:42:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4352b08f-dfda-4f2d-9205-bc2e44e110c6 tempest-VolumesAdminNegativeTest-122789996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:42:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4352b08f-dfda-4f2d-9205-bc2e44e110c6 tempest-VolumesAdminNegativeTest-122789996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:42:18 devstack sudo[88737]: pam_unix(sudo:session): session closed for user root Sep 08 06:42:18 devstack sudo[88740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:42:18 devstack sudo[88740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:42:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a05c93fb-317b-42b7-8aa8-9d5476bd7669 tempest-VolumesTestJSON-1101720796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9f28ab74-9a20-4202-92e4-e935cd823280" returned: 0 in 0.558s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:42:18 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-a05c93fb-317b-42b7-8aa8-9d5476bd7669 tempest-VolumesTestJSON-1101720796 None] Lock "cinder-quobyte-9f28ab74-9a20-4202-92e4-e935cd823280" released by "delete_volume" :: held 4.598s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:42:18 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-a05c93fb-317b-42b7-8aa8-9d5476bd7669 tempest-VolumesTestJSON-1101720796 None] Created reservations ['56a7afa0-7ea2-4ffc-bffd-22ab5b32c2a0', '83f2d672-a581-4c46-b64f-6b781669c679', '8125215e-54c6-43b1-b21e-22d57e3d0d3a', 'd9227e27-81d4-454b-8e3d-d5e5ae1061df'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:42:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a05c93fb-317b-42b7-8aa8-9d5476bd7669 tempest-VolumesTestJSON-1101720796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:42:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a05c93fb-317b-42b7-8aa8-9d5476bd7669 tempest-VolumesTestJSON-1101720796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:42:18 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-a05c93fb-317b-42b7-8aa8-9d5476bd7669 tempest-VolumesTestJSON-1101720796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:42:18 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-a05c93fb-317b-42b7-8aa8-9d5476bd7669 tempest-VolumesTestJSON-1101720796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:42:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a05c93fb-317b-42b7-8aa8-9d5476bd7669 tempest-VolumesTestJSON-1101720796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:42:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a05c93fb-317b-42b7-8aa8-9d5476bd7669 tempest-VolumesTestJSON-1101720796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:42:18 devstack sudo[88742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:42:18 devstack sudo[88742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:42:19 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-766d6e77-b8bb-48f3-8dd3-04ded810778d tempest-VolumesTestJSON-1101720796 None] Acquiring lock "cinder-f6cda441-6db9-4f9f-8776-6248f217fafd-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:42:19 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-766d6e77-b8bb-48f3-8dd3-04ded810778d tempest-VolumesTestJSON-1101720796 None] Lock "cinder-f6cda441-6db9-4f9f-8776-6248f217fafd-delete_volume" acquired by "delete_volume" :: waited 0.094s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:42:19 devstack sudo[88740]: pam_unix(sudo:session): session closed for user root Sep 08 06:42:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4352b08f-dfda-4f2d-9205-bc2e44e110c6 tempest-VolumesAdminNegativeTest-122789996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.982s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:42:19 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-4352b08f-dfda-4f2d-9205-bc2e44e110c6 tempest-VolumesAdminNegativeTest-122789996 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:42:19 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-4352b08f-dfda-4f2d-9205-bc2e44e110c6 tempest-VolumesAdminNegativeTest-122789996 None] Deleted volume successfully. Sep 08 06:42:19 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-766d6e77-b8bb-48f3-8dd3-04ded810778d tempest-VolumesTestJSON-1101720796 None] Acquiring lock "cinder-quobyte-f6cda441-6db9-4f9f-8776-6248f217fafd" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:42:19 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-766d6e77-b8bb-48f3-8dd3-04ded810778d tempest-VolumesTestJSON-1101720796 None] Lock "cinder-quobyte-f6cda441-6db9-4f9f-8776-6248f217fafd" acquired by "delete_volume" :: waited 0.063s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:42:19 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-4352b08f-dfda-4f2d-9205-bc2e44e110c6 tempest-VolumesAdminNegativeTest-122789996 None] Lock "cinder-676b5098-2673-4255-acf0-b554c2b31425-delete_volume" released by "delete_volume" :: held 5.190s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:42:19 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[af281090-114f-42ac-9eed-25373528cd4d]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:42:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-766d6e77-b8bb-48f3-8dd3-04ded810778d tempest-VolumesTestJSON-1101720796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f6cda441-6db9-4f9f-8776-6248f217fafd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:42:19 devstack sudo[88742]: pam_unix(sudo:session): session closed for user root Sep 08 06:42:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a05c93fb-317b-42b7-8aa8-9d5476bd7669 tempest-VolumesTestJSON-1101720796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.911s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:42:19 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-a05c93fb-317b-42b7-8aa8-9d5476bd7669 tempest-VolumesTestJSON-1101720796 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:42:19 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-a05c93fb-317b-42b7-8aa8-9d5476bd7669 tempest-VolumesTestJSON-1101720796 None] Deleted volume successfully. Sep 08 06:42:19 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-a05c93fb-317b-42b7-8aa8-9d5476bd7669 tempest-VolumesTestJSON-1101720796 None] Lock "cinder-9f28ab74-9a20-4202-92e4-e935cd823280-delete_volume" released by "delete_volume" :: held 5.902s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:42:19 devstack sudo[88749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f6cda441-6db9-4f9f-8776-6248f217fafd Sep 08 06:42:19 devstack sudo[88749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:42:20 devstack cinder-volume[87507]: DEBUG oslo_service.periodic_task [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87507) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 06:42:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:42:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:42:20 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:42:20 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:42:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:42:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:42:20 devstack sudo[88765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:42:20 devstack sudo[88765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:42:20 devstack sudo[88765]: pam_unix(sudo:session): session closed for user root Sep 08 06:42:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.506s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:42:20 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:42:20 devstack cinder-volume[87507]: DEBUG oslo_service.periodic_task [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Running periodic task VolumeManager._thread_info {{(pid=87507) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 06:42:20 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] thread count: 8 {{(pid=87507) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 06:42:20 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] thread info: [<_MainThread(MainThread, started 127913129345152)>, , , , , , , ] {{(pid=87507) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 06:42:20 devstack sudo[88749]: pam_unix(sudo:session): session closed for user root Sep 08 06:42:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-766d6e77-b8bb-48f3-8dd3-04ded810778d tempest-VolumesTestJSON-1101720796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f6cda441-6db9-4f9f-8776-6248f217fafd" returned: 0 in 1.107s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:42:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-766d6e77-b8bb-48f3-8dd3-04ded810778d tempest-VolumesTestJSON-1101720796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f6cda441-6db9-4f9f-8776-6248f217fafd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:42:20 devstack sudo[88779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f6cda441-6db9-4f9f-8776-6248f217fafd Sep 08 06:42:20 devstack sudo[88779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:42:21 devstack sudo[88779]: pam_unix(sudo:session): session closed for user root Sep 08 06:42:21 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-766d6e77-b8bb-48f3-8dd3-04ded810778d tempest-VolumesTestJSON-1101720796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f6cda441-6db9-4f9f-8776-6248f217fafd" returned: 0 in 0.381s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:42:21 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-766d6e77-b8bb-48f3-8dd3-04ded810778d tempest-VolumesTestJSON-1101720796 None] Lock "cinder-quobyte-f6cda441-6db9-4f9f-8776-6248f217fafd" released by "delete_volume" :: held 1.585s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:42:21 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-766d6e77-b8bb-48f3-8dd3-04ded810778d tempest-VolumesTestJSON-1101720796 None] Created reservations ['8614cc45-e0fd-4bd9-88c1-c482c8e210fd', '9fd2017f-72ab-4dac-bdeb-e524360be9a2', '6cb0d275-376c-4955-b8c5-4bf9ed1f89a3', '5bbccdfa-3bd0-4b20-8541-f249f9333bba'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:42:21 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-766d6e77-b8bb-48f3-8dd3-04ded810778d tempest-VolumesTestJSON-1101720796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:42:21 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-766d6e77-b8bb-48f3-8dd3-04ded810778d tempest-VolumesTestJSON-1101720796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:42:21 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-766d6e77-b8bb-48f3-8dd3-04ded810778d tempest-VolumesTestJSON-1101720796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:42:21 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-766d6e77-b8bb-48f3-8dd3-04ded810778d tempest-VolumesTestJSON-1101720796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:42:21 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-766d6e77-b8bb-48f3-8dd3-04ded810778d tempest-VolumesTestJSON-1101720796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:42:21 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-766d6e77-b8bb-48f3-8dd3-04ded810778d tempest-VolumesTestJSON-1101720796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:42:21 devstack sudo[88784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:42:21 devstack sudo[88784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:42:21 devstack sudo[88784]: pam_unix(sudo:session): session closed for user root Sep 08 06:42:21 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-766d6e77-b8bb-48f3-8dd3-04ded810778d tempest-VolumesTestJSON-1101720796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.275s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:42:21 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-766d6e77-b8bb-48f3-8dd3-04ded810778d tempest-VolumesTestJSON-1101720796 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:42:21 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-766d6e77-b8bb-48f3-8dd3-04ded810778d tempest-VolumesTestJSON-1101720796 None] Deleted volume successfully. Sep 08 06:42:21 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-766d6e77-b8bb-48f3-8dd3-04ded810778d tempest-VolumesTestJSON-1101720796 None] Lock "cinder-f6cda441-6db9-4f9f-8776-6248f217fafd-delete_volume" released by "delete_volume" :: held 2.455s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:42:21 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-cfe87334-6bbf-4cc0-b680-74f88b99d4ac tempest-VolumesTestJSON-1101720796 None] Acquiring lock "cinder-cbeb3c84-727e-480f-a1b9-7403737d7774-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:42:21 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-cfe87334-6bbf-4cc0-b680-74f88b99d4ac tempest-VolumesTestJSON-1101720796 None] Lock "cinder-cbeb3c84-727e-480f-a1b9-7403737d7774-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:42:21 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-cfe87334-6bbf-4cc0-b680-74f88b99d4ac tempest-VolumesTestJSON-1101720796 None] Acquiring lock "cinder-quobyte-cbeb3c84-727e-480f-a1b9-7403737d7774" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:42:21 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-cfe87334-6bbf-4cc0-b680-74f88b99d4ac tempest-VolumesTestJSON-1101720796 None] Lock "cinder-quobyte-cbeb3c84-727e-480f-a1b9-7403737d7774" acquired by "delete_volume" :: waited 0.021s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:42:21 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53f4391-d81d-436f-a018-db48b843a187]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:42:21 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-cfe87334-6bbf-4cc0-b680-74f88b99d4ac tempest-VolumesTestJSON-1101720796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cbeb3c84-727e-480f-a1b9-7403737d7774 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:42:22 devstack sudo[88788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cbeb3c84-727e-480f-a1b9-7403737d7774 Sep 08 06:42:22 devstack sudo[88788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:42:22 devstack sudo[88788]: pam_unix(sudo:session): session closed for user root Sep 08 06:42:22 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-cfe87334-6bbf-4cc0-b680-74f88b99d4ac tempest-VolumesTestJSON-1101720796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cbeb3c84-727e-480f-a1b9-7403737d7774" returned: 0 in 0.522s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:42:22 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-cfe87334-6bbf-4cc0-b680-74f88b99d4ac tempest-VolumesTestJSON-1101720796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cbeb3c84-727e-480f-a1b9-7403737d7774 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:42:22 devstack sudo[88794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cbeb3c84-727e-480f-a1b9-7403737d7774 Sep 08 06:42:22 devstack sudo[88794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:42:22 devstack sudo[88794]: pam_unix(sudo:session): session closed for user root Sep 08 06:42:22 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-cfe87334-6bbf-4cc0-b680-74f88b99d4ac tempest-VolumesTestJSON-1101720796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cbeb3c84-727e-480f-a1b9-7403737d7774" returned: 0 in 0.324s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:42:22 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-cfe87334-6bbf-4cc0-b680-74f88b99d4ac tempest-VolumesTestJSON-1101720796 None] Lock "cinder-quobyte-cbeb3c84-727e-480f-a1b9-7403737d7774" released by "delete_volume" :: held 0.919s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:42:22 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-cfe87334-6bbf-4cc0-b680-74f88b99d4ac tempest-VolumesTestJSON-1101720796 None] Created reservations ['7b6d1b56-0f11-423e-a9d6-2f1beddab628', '6f0d9979-8208-41bd-b7a5-a6fefa69edf3', '50089b35-6275-4110-96be-0f4f043b252a', 'e4e2b037-3a1c-470a-ba5d-bfe8d99a607b'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:42:22 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-cfe87334-6bbf-4cc0-b680-74f88b99d4ac tempest-VolumesTestJSON-1101720796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:42:22 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-cfe87334-6bbf-4cc0-b680-74f88b99d4ac tempest-VolumesTestJSON-1101720796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:42:22 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-cfe87334-6bbf-4cc0-b680-74f88b99d4ac tempest-VolumesTestJSON-1101720796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:42:22 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-cfe87334-6bbf-4cc0-b680-74f88b99d4ac tempest-VolumesTestJSON-1101720796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:42:22 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-cfe87334-6bbf-4cc0-b680-74f88b99d4ac tempest-VolumesTestJSON-1101720796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:42:22 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-cfe87334-6bbf-4cc0-b680-74f88b99d4ac tempest-VolumesTestJSON-1101720796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:42:23 devstack sudo[88799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:42:23 devstack sudo[88799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:42:23 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-08d95ef5-4e53-4b48-926a-929841682ef7 tempest-ServersNegativeTestJSON-1733895649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:42:23 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-08d95ef5-4e53-4b48-926a-929841682ef7 tempest-ServersNegativeTestJSON-1733895649 None] Flow 'volume_create_manager' (5323fdde-bb75-4a80-b131-06353a9dcd38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:42:23 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-08d95ef5-4e53-4b48-926a-929841682ef7 tempest-ServersNegativeTestJSON-1733895649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ab179f7-9cce-44d9-b74c-e86753d94e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:42:23 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-08d95ef5-4e53-4b48-926a-929841682ef7 tempest-ServersNegativeTestJSON-1733895649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ab179f7-9cce-44d9-b74c-e86753d94e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:42:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1185634983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ec61249-429a-486a-8262-d2917ff2ad44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b9e89d1c2c4f91bfc72a8ae8326f0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:42:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:42:23Z,use_quota=True,user_id='e7b691cbb9dd4a8cb86307dd8d850756',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:42:23 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-08d95ef5-4e53-4b48-926a-929841682ef7 tempest-ServersNegativeTestJSON-1733895649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e05213ba-cf4f-4f77-be80-780732718704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:42:23 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-08d95ef5-4e53-4b48-926a-929841682ef7 tempest-ServersNegativeTestJSON-1733895649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e05213ba-cf4f-4f77-be80-780732718704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:42:23 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-08d95ef5-4e53-4b48-926a-929841682ef7 tempest-ServersNegativeTestJSON-1733895649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d32b8fdd-b8d8-44d8-9c33-66ecbe528890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:42:23 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-08d95ef5-4e53-4b48-926a-929841682ef7 tempest-ServersNegativeTestJSON-1733895649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d32b8fdd-b8d8-44d8-9c33-66ecbe528890) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ec61249-429a-486a-8262-d2917ff2ad44', 'volume_name': 'volume-8ec61249-429a-486a-8262-d2917ff2ad44', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:42:23 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-08d95ef5-4e53-4b48-926a-929841682ef7 tempest-ServersNegativeTestJSON-1733895649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f22042b-4a96-412c-beb1-274ddaf47b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:42:23 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-08d95ef5-4e53-4b48-926a-929841682ef7 tempest-ServersNegativeTestJSON-1733895649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f22042b-4a96-412c-beb1-274ddaf47b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:42:23 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-08d95ef5-4e53-4b48-926a-929841682ef7 tempest-ServersNegativeTestJSON-1733895649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57e8615a-c097-41d6-9cfb-20fb60e9a168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:42:23 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-08d95ef5-4e53-4b48-926a-929841682ef7 tempest-ServersNegativeTestJSON-1733895649 None] Volume 8ec61249-429a-486a-8262-d2917ff2ad44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ec61249-429a-486a-8262-d2917ff2ad44', 'volume_size': 1} Sep 08 06:42:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-08d95ef5-4e53-4b48-926a-929841682ef7 tempest-ServersNegativeTestJSON-1733895649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:42:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-08d95ef5-4e53-4b48-926a-929841682ef7 tempest-ServersNegativeTestJSON-1733895649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:42:23 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-08d95ef5-4e53-4b48-926a-929841682ef7 tempest-ServersNegativeTestJSON-1733895649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:42:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1185634983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ec61249-429a-486a-8262-d2917ff2ad44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b9e89d1c2c4f91bfc72a8ae8326f0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:42:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:42:23Z,use_quota=True,user_id='e7b691cbb9dd4a8cb86307dd8d850756',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:42:23 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-08d95ef5-4e53-4b48-926a-929841682ef7 tempest-ServersNegativeTestJSON-1733895649 None] Creating volume 8ec61249-429a-486a-8262-d2917ff2ad44 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:42:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-08d95ef5-4e53-4b48-926a-929841682ef7 tempest-ServersNegativeTestJSON-1733895649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:42:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-08d95ef5-4e53-4b48-926a-929841682ef7 tempest-ServersNegativeTestJSON-1733895649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:42:23 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-08d95ef5-4e53-4b48-926a-929841682ef7 tempest-ServersNegativeTestJSON-1733895649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:42:23 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-08d95ef5-4e53-4b48-926a-929841682ef7 tempest-ServersNegativeTestJSON-1733895649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:42:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-08d95ef5-4e53-4b48-926a-929841682ef7 tempest-ServersNegativeTestJSON-1733895649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:42:23 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-08d95ef5-4e53-4b48-926a-929841682ef7 tempest-ServersNegativeTestJSON-1733895649 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:42:23 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-08d95ef5-4e53-4b48-926a-929841682ef7 tempest-ServersNegativeTestJSON-1733895649 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:42:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-08d95ef5-4e53-4b48-926a-929841682ef7 tempest-ServersNegativeTestJSON-1733895649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8ec61249-429a-486a-8262-d2917ff2ad44 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:42:23 devstack sudo[88801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8ec61249-429a-486a-8262-d2917ff2ad44 1073741824 Sep 08 06:42:23 devstack sudo[88801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:42:23 devstack sudo[88799]: pam_unix(sudo:session): session closed for user root Sep 08 06:42:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-cfe87334-6bbf-4cc0-b680-74f88b99d4ac tempest-VolumesTestJSON-1101720796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.283s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:42:23 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-cfe87334-6bbf-4cc0-b680-74f88b99d4ac tempest-VolumesTestJSON-1101720796 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:42:23 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-cfe87334-6bbf-4cc0-b680-74f88b99d4ac tempest-VolumesTestJSON-1101720796 None] Deleted volume successfully. Sep 08 06:42:23 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-cfe87334-6bbf-4cc0-b680-74f88b99d4ac tempest-VolumesTestJSON-1101720796 None] Lock "cinder-cbeb3c84-727e-480f-a1b9-7403737d7774-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:42:23 devstack sudo[88801]: pam_unix(sudo:session): session closed for user root Sep 08 06:42:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-08d95ef5-4e53-4b48-926a-929841682ef7 tempest-ServersNegativeTestJSON-1733895649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8ec61249-429a-486a-8262-d2917ff2ad44 1073741824" returned: 0 in 0.506s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:42:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-08d95ef5-4e53-4b48-926a-929841682ef7 tempest-ServersNegativeTestJSON-1733895649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8ec61249-429a-486a-8262-d2917ff2ad44 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:42:23 devstack sudo[88808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8ec61249-429a-486a-8262-d2917ff2ad44 Sep 08 06:42:23 devstack sudo[88808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:42:24 devstack sudo[88808]: pam_unix(sudo:session): session closed for user root Sep 08 06:42:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-08d95ef5-4e53-4b48-926a-929841682ef7 tempest-ServersNegativeTestJSON-1733895649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8ec61249-429a-486a-8262-d2917ff2ad44" returned: 0 in 0.418s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:42:24 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-08d95ef5-4e53-4b48-926a-929841682ef7 tempest-ServersNegativeTestJSON-1733895649 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:42:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-08d95ef5-4e53-4b48-926a-929841682ef7 tempest-ServersNegativeTestJSON-1733895649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:42:24 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-08d95ef5-4e53-4b48-926a-929841682ef7 tempest-ServersNegativeTestJSON-1733895649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57e8615a-c097-41d6-9cfb-20fb60e9a168) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ec61249-429a-486a-8262-d2917ff2ad44', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:42:24 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-08d95ef5-4e53-4b48-926a-929841682ef7 tempest-ServersNegativeTestJSON-1733895649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9c9e9e4-0ee2-4df7-9e5a-e223024546f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:42:24 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-08d95ef5-4e53-4b48-926a-929841682ef7 tempest-ServersNegativeTestJSON-1733895649 None] Volume volume-8ec61249-429a-486a-8262-d2917ff2ad44 (8ec61249-429a-486a-8262-d2917ff2ad44): created successfully Sep 08 06:42:24 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-08d95ef5-4e53-4b48-926a-929841682ef7 tempest-ServersNegativeTestJSON-1733895649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9c9e9e4-0ee2-4df7-9e5a-e223024546f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:42:24 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-08d95ef5-4e53-4b48-926a-929841682ef7 tempest-ServersNegativeTestJSON-1733895649 None] Flow 'volume_create_manager' (5323fdde-bb75-4a80-b131-06353a9dcd38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:42:24 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-08d95ef5-4e53-4b48-926a-929841682ef7 tempest-ServersNegativeTestJSON-1733895649 None] Created volume successfully. Sep 08 06:42:29 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-f50cb093-2cc7-4a50-91a1-2d57383f724e tempest-ServersNegativeTestJSON-1733895649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:42:29 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-f50cb093-2cc7-4a50-91a1-2d57383f724e tempest-ServersNegativeTestJSON-1733895649 None] Flow 'volume_create_manager' (f47503f8-cbfc-48e4-a5f1-e98d338bc38b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:42:29 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-f50cb093-2cc7-4a50-91a1-2d57383f724e tempest-ServersNegativeTestJSON-1733895649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4faa7353-4f23-4321-8505-a3c1f155e558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:42:29 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-f50cb093-2cc7-4a50-91a1-2d57383f724e tempest-ServersNegativeTestJSON-1733895649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4faa7353-4f23-4321-8505-a3c1f155e558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:42:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1872310425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98907d88-5bba-48a7-9dae-31462f308e5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b9e89d1c2c4f91bfc72a8ae8326f0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:42:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:42:29Z,use_quota=True,user_id='e7b691cbb9dd4a8cb86307dd8d850756',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:42:29 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-f50cb093-2cc7-4a50-91a1-2d57383f724e tempest-ServersNegativeTestJSON-1733895649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ab9cd26-6dc9-48c7-90c6-96dc9dc86783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:42:29 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-f50cb093-2cc7-4a50-91a1-2d57383f724e tempest-ServersNegativeTestJSON-1733895649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ab9cd26-6dc9-48c7-90c6-96dc9dc86783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:42:29 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-f50cb093-2cc7-4a50-91a1-2d57383f724e tempest-ServersNegativeTestJSON-1733895649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca71f9df-d640-4131-af33-9dbdb228ed0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:42:29 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-f50cb093-2cc7-4a50-91a1-2d57383f724e tempest-ServersNegativeTestJSON-1733895649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca71f9df-d640-4131-af33-9dbdb228ed0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98907d88-5bba-48a7-9dae-31462f308e5f', 'volume_name': 'volume-98907d88-5bba-48a7-9dae-31462f308e5f', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:42:29 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-f50cb093-2cc7-4a50-91a1-2d57383f724e tempest-ServersNegativeTestJSON-1733895649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cdd1373-95e5-4e62-9d4b-d32f40b486e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:42:29 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-f50cb093-2cc7-4a50-91a1-2d57383f724e tempest-ServersNegativeTestJSON-1733895649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cdd1373-95e5-4e62-9d4b-d32f40b486e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:42:29 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-f50cb093-2cc7-4a50-91a1-2d57383f724e tempest-ServersNegativeTestJSON-1733895649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5774911-83d4-454f-b68d-bebe56ad87f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:42:29 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-f50cb093-2cc7-4a50-91a1-2d57383f724e tempest-ServersNegativeTestJSON-1733895649 None] Volume 98907d88-5bba-48a7-9dae-31462f308e5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98907d88-5bba-48a7-9dae-31462f308e5f', 'volume_size': 1} Sep 08 06:42:29 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-f50cb093-2cc7-4a50-91a1-2d57383f724e tempest-ServersNegativeTestJSON-1733895649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:42:29 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-f50cb093-2cc7-4a50-91a1-2d57383f724e tempest-ServersNegativeTestJSON-1733895649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:42:29 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-f50cb093-2cc7-4a50-91a1-2d57383f724e tempest-ServersNegativeTestJSON-1733895649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:42:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1872310425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98907d88-5bba-48a7-9dae-31462f308e5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b9e89d1c2c4f91bfc72a8ae8326f0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:42:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:42:29Z,use_quota=True,user_id='e7b691cbb9dd4a8cb86307dd8d850756',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:42:29 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-f50cb093-2cc7-4a50-91a1-2d57383f724e tempest-ServersNegativeTestJSON-1733895649 None] Creating volume 98907d88-5bba-48a7-9dae-31462f308e5f {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:42:29 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-f50cb093-2cc7-4a50-91a1-2d57383f724e tempest-ServersNegativeTestJSON-1733895649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:42:29 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-f50cb093-2cc7-4a50-91a1-2d57383f724e tempest-ServersNegativeTestJSON-1733895649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:42:29 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-f50cb093-2cc7-4a50-91a1-2d57383f724e tempest-ServersNegativeTestJSON-1733895649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:42:29 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-f50cb093-2cc7-4a50-91a1-2d57383f724e tempest-ServersNegativeTestJSON-1733895649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:42:29 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-f50cb093-2cc7-4a50-91a1-2d57383f724e tempest-ServersNegativeTestJSON-1733895649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:42:29 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-f50cb093-2cc7-4a50-91a1-2d57383f724e tempest-ServersNegativeTestJSON-1733895649 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:42:29 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-f50cb093-2cc7-4a50-91a1-2d57383f724e tempest-ServersNegativeTestJSON-1733895649 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:42:29 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f50cb093-2cc7-4a50-91a1-2d57383f724e tempest-ServersNegativeTestJSON-1733895649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-98907d88-5bba-48a7-9dae-31462f308e5f 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:42:29 devstack sudo[88816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-98907d88-5bba-48a7-9dae-31462f308e5f 1073741824 Sep 08 06:42:29 devstack sudo[88816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:42:29 devstack sudo[88816]: pam_unix(sudo:session): session closed for user root Sep 08 06:42:29 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f50cb093-2cc7-4a50-91a1-2d57383f724e tempest-ServersNegativeTestJSON-1733895649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-98907d88-5bba-48a7-9dae-31462f308e5f 1073741824" returned: 0 in 0.532s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:42:29 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f50cb093-2cc7-4a50-91a1-2d57383f724e tempest-ServersNegativeTestJSON-1733895649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-98907d88-5bba-48a7-9dae-31462f308e5f {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:42:29 devstack sudo[88822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-98907d88-5bba-48a7-9dae-31462f308e5f Sep 08 06:42:29 devstack sudo[88822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:42:30 devstack sudo[88822]: pam_unix(sudo:session): session closed for user root Sep 08 06:42:30 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f50cb093-2cc7-4a50-91a1-2d57383f724e tempest-ServersNegativeTestJSON-1733895649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-98907d88-5bba-48a7-9dae-31462f308e5f" returned: 0 in 0.335s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:42:30 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-f50cb093-2cc7-4a50-91a1-2d57383f724e tempest-ServersNegativeTestJSON-1733895649 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:42:30 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-f50cb093-2cc7-4a50-91a1-2d57383f724e tempest-ServersNegativeTestJSON-1733895649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:42:30 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-f50cb093-2cc7-4a50-91a1-2d57383f724e tempest-ServersNegativeTestJSON-1733895649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5774911-83d4-454f-b68d-bebe56ad87f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98907d88-5bba-48a7-9dae-31462f308e5f', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:42:30 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-f50cb093-2cc7-4a50-91a1-2d57383f724e tempest-ServersNegativeTestJSON-1733895649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9183578-a3b8-420e-abdf-22edc915e348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:42:30 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-f50cb093-2cc7-4a50-91a1-2d57383f724e tempest-ServersNegativeTestJSON-1733895649 None] Volume volume-98907d88-5bba-48a7-9dae-31462f308e5f (98907d88-5bba-48a7-9dae-31462f308e5f): created successfully Sep 08 06:42:30 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-f50cb093-2cc7-4a50-91a1-2d57383f724e tempest-ServersNegativeTestJSON-1733895649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9183578-a3b8-420e-abdf-22edc915e348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:42:30 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-f50cb093-2cc7-4a50-91a1-2d57383f724e tempest-ServersNegativeTestJSON-1733895649 None] Flow 'volume_create_manager' (f47503f8-cbfc-48e4-a5f1-e98d338bc38b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:42:30 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-f50cb093-2cc7-4a50-91a1-2d57383f724e tempest-ServersNegativeTestJSON-1733895649 None] Created volume successfully. Sep 08 06:42:32 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-bfe6e9ba-1af1-4f04-a8ac-93b9a1c4a9e1 tempest-ServersNegativeTestJSON-1733895649 None] Acquiring lock "cinder-98907d88-5bba-48a7-9dae-31462f308e5f-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:42:32 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-bfe6e9ba-1af1-4f04-a8ac-93b9a1c4a9e1 tempest-ServersNegativeTestJSON-1733895649 None] Lock "cinder-98907d88-5bba-48a7-9dae-31462f308e5f-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:42:32 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-bfe6e9ba-1af1-4f04-a8ac-93b9a1c4a9e1 tempest-ServersNegativeTestJSON-1733895649 None] Acquiring lock "cinder-quobyte-98907d88-5bba-48a7-9dae-31462f308e5f" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:42:32 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-bfe6e9ba-1af1-4f04-a8ac-93b9a1c4a9e1 tempest-ServersNegativeTestJSON-1733895649 None] Lock "cinder-quobyte-98907d88-5bba-48a7-9dae-31462f308e5f" acquired by "delete_volume" :: waited 0.028s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:42:32 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2602d479-70f8-4571-8001-197a137713bb]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:42:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bfe6e9ba-1af1-4f04-a8ac-93b9a1c4a9e1 tempest-ServersNegativeTestJSON-1733895649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-98907d88-5bba-48a7-9dae-31462f308e5f {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:42:32 devstack sudo[88828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-98907d88-5bba-48a7-9dae-31462f308e5f Sep 08 06:42:32 devstack sudo[88828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:42:32 devstack sudo[88828]: pam_unix(sudo:session): session closed for user root Sep 08 06:42:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bfe6e9ba-1af1-4f04-a8ac-93b9a1c4a9e1 tempest-ServersNegativeTestJSON-1733895649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-98907d88-5bba-48a7-9dae-31462f308e5f" returned: 0 in 0.434s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:42:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bfe6e9ba-1af1-4f04-a8ac-93b9a1c4a9e1 tempest-ServersNegativeTestJSON-1733895649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-98907d88-5bba-48a7-9dae-31462f308e5f {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:42:32 devstack sudo[88833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-98907d88-5bba-48a7-9dae-31462f308e5f Sep 08 06:42:32 devstack sudo[88833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:42:32 devstack sudo[88833]: pam_unix(sudo:session): session closed for user root Sep 08 06:42:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bfe6e9ba-1af1-4f04-a8ac-93b9a1c4a9e1 tempest-ServersNegativeTestJSON-1733895649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-98907d88-5bba-48a7-9dae-31462f308e5f" returned: 0 in 0.254s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:42:32 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-bfe6e9ba-1af1-4f04-a8ac-93b9a1c4a9e1 tempest-ServersNegativeTestJSON-1733895649 None] Lock "cinder-quobyte-98907d88-5bba-48a7-9dae-31462f308e5f" released by "delete_volume" :: held 0.744s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:42:32 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-bfe6e9ba-1af1-4f04-a8ac-93b9a1c4a9e1 tempest-ServersNegativeTestJSON-1733895649 None] Created reservations ['f6cad0a0-3ea8-42e2-a88f-ab8d233aed2e', 'b6802b34-3abe-418d-86e5-29af4c4983e7', '97c85a9a-c024-4576-a3d3-801a0a7fe07b', '79641d80-1d9d-482a-a757-49017bf7be1a'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:42:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-bfe6e9ba-1af1-4f04-a8ac-93b9a1c4a9e1 tempest-ServersNegativeTestJSON-1733895649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:42:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-bfe6e9ba-1af1-4f04-a8ac-93b9a1c4a9e1 tempest-ServersNegativeTestJSON-1733895649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:42:33 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-bfe6e9ba-1af1-4f04-a8ac-93b9a1c4a9e1 tempest-ServersNegativeTestJSON-1733895649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:42:33 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-bfe6e9ba-1af1-4f04-a8ac-93b9a1c4a9e1 tempest-ServersNegativeTestJSON-1733895649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:42:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-bfe6e9ba-1af1-4f04-a8ac-93b9a1c4a9e1 tempest-ServersNegativeTestJSON-1733895649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:42:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bfe6e9ba-1af1-4f04-a8ac-93b9a1c4a9e1 tempest-ServersNegativeTestJSON-1733895649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:42:33 devstack sudo[88842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:42:33 devstack sudo[88842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:42:33 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-5d006e37-098a-4a9c-be5f-ee5cea8bea2f tempest-ServersNegativeTestJSON-1733895649 None] Acquiring lock "cinder-8ec61249-429a-486a-8262-d2917ff2ad44-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:42:33 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-5d006e37-098a-4a9c-be5f-ee5cea8bea2f tempest-ServersNegativeTestJSON-1733895649 None] Lock "cinder-8ec61249-429a-486a-8262-d2917ff2ad44-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:42:33 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-5d006e37-098a-4a9c-be5f-ee5cea8bea2f tempest-ServersNegativeTestJSON-1733895649 None] Acquiring lock "cinder-quobyte-8ec61249-429a-486a-8262-d2917ff2ad44" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:42:33 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-5d006e37-098a-4a9c-be5f-ee5cea8bea2f tempest-ServersNegativeTestJSON-1733895649 None] Lock "cinder-quobyte-8ec61249-429a-486a-8262-d2917ff2ad44" acquired by "delete_volume" :: waited 0.047s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:42:33 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1923a7-9126-43a2-ab11-a8e53070509d]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:42:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5d006e37-098a-4a9c-be5f-ee5cea8bea2f tempest-ServersNegativeTestJSON-1733895649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8ec61249-429a-486a-8262-d2917ff2ad44 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:42:33 devstack sudo[88842]: pam_unix(sudo:session): session closed for user root Sep 08 06:42:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bfe6e9ba-1af1-4f04-a8ac-93b9a1c4a9e1 tempest-ServersNegativeTestJSON-1733895649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.513s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:42:33 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-bfe6e9ba-1af1-4f04-a8ac-93b9a1c4a9e1 tempest-ServersNegativeTestJSON-1733895649 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:42:33 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-bfe6e9ba-1af1-4f04-a8ac-93b9a1c4a9e1 tempest-ServersNegativeTestJSON-1733895649 None] Deleted volume successfully. Sep 08 06:42:33 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-bfe6e9ba-1af1-4f04-a8ac-93b9a1c4a9e1 tempest-ServersNegativeTestJSON-1733895649 None] Lock "cinder-98907d88-5bba-48a7-9dae-31462f308e5f-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:42:33 devstack sudo[88845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8ec61249-429a-486a-8262-d2917ff2ad44 Sep 08 06:42:33 devstack sudo[88845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:42:33 devstack sudo[88845]: pam_unix(sudo:session): session closed for user root Sep 08 06:42:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5d006e37-098a-4a9c-be5f-ee5cea8bea2f tempest-ServersNegativeTestJSON-1733895649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8ec61249-429a-486a-8262-d2917ff2ad44" returned: 0 in 0.463s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:42:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5d006e37-098a-4a9c-be5f-ee5cea8bea2f tempest-ServersNegativeTestJSON-1733895649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8ec61249-429a-486a-8262-d2917ff2ad44 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:42:34 devstack sudo[88850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8ec61249-429a-486a-8262-d2917ff2ad44 Sep 08 06:42:34 devstack sudo[88850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:42:34 devstack sudo[88850]: pam_unix(sudo:session): session closed for user root Sep 08 06:42:34 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5d006e37-098a-4a9c-be5f-ee5cea8bea2f tempest-ServersNegativeTestJSON-1733895649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8ec61249-429a-486a-8262-d2917ff2ad44" returned: 0 in 0.336s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:42:34 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-5d006e37-098a-4a9c-be5f-ee5cea8bea2f tempest-ServersNegativeTestJSON-1733895649 None] Lock "cinder-quobyte-8ec61249-429a-486a-8262-d2917ff2ad44" released by "delete_volume" :: held 0.874s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:42:34 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1fbb20e8-e37f-42dd-a6e9-b22ec75377c1 tempest-BackendsCapabilitiesAdminTestsJSON-560590875 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5347785949707, 'free_capacity_gb': 1773.5347785949707, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87507) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 08 06:42:34 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5859bc7f-8d9c-4878-aaf1-6e4b62f128a0 tempest-BackendsCapabilitiesAdminTestsJSON-560590875 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5347785949707, 'free_capacity_gb': 1773.5347785949707, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87507) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 08 06:42:34 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-5d006e37-098a-4a9c-be5f-ee5cea8bea2f tempest-ServersNegativeTestJSON-1733895649 None] Created reservations ['e6dd961e-e2d5-4ea5-9b0d-c4dfadf3e5af', 'ae8e85cd-575e-4f4e-a830-9662ec1bccc7', 'cfbe490a-5ae6-4b74-9354-5a65a87f79d8', '844933f2-4aaa-45b9-bdee-20c125a923aa'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:42:34 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-5d006e37-098a-4a9c-be5f-ee5cea8bea2f tempest-ServersNegativeTestJSON-1733895649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:42:34 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-5d006e37-098a-4a9c-be5f-ee5cea8bea2f tempest-ServersNegativeTestJSON-1733895649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:42:34 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-5d006e37-098a-4a9c-be5f-ee5cea8bea2f tempest-ServersNegativeTestJSON-1733895649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:42:34 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-5d006e37-098a-4a9c-be5f-ee5cea8bea2f tempest-ServersNegativeTestJSON-1733895649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:42:34 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-5d006e37-098a-4a9c-be5f-ee5cea8bea2f tempest-ServersNegativeTestJSON-1733895649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:42:34 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5d006e37-098a-4a9c-be5f-ee5cea8bea2f tempest-ServersNegativeTestJSON-1733895649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:42:34 devstack sudo[88856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:42:34 devstack sudo[88856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:42:34 devstack sudo[88856]: pam_unix(sudo:session): session closed for user root Sep 08 06:42:34 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5d006e37-098a-4a9c-be5f-ee5cea8bea2f tempest-ServersNegativeTestJSON-1733895649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.344s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:42:34 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-5d006e37-098a-4a9c-be5f-ee5cea8bea2f tempest-ServersNegativeTestJSON-1733895649 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:42:35 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-5d006e37-098a-4a9c-be5f-ee5cea8bea2f tempest-ServersNegativeTestJSON-1733895649 None] Deleted volume successfully. Sep 08 06:42:35 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-5d006e37-098a-4a9c-be5f-ee5cea8bea2f tempest-ServersNegativeTestJSON-1733895649 None] Lock "cinder-8ec61249-429a-486a-8262-d2917ff2ad44-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:42:43 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-5a13b17b-3129-49b1-baaa-3b509ee773c3 tempest-GroupsV314Test-235949681 None] Group tempest-GroupsV314Test-Group-1991385179: creating Sep 08 06:42:43 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-5a13b17b-3129-49b1-baaa-3b509ee773c3 tempest-GroupsV314Test-235949681 None] Group tempest-GroupsV314Test-Group-1991385179: created successfully Sep 08 06:42:43 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-5a13b17b-3129-49b1-baaa-3b509ee773c3 tempest-GroupsV314Test-235949681 None] Create group completed successfully. Sep 08 06:42:45 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7852322-2370-4f1a-8684-e1fae126b531 tempest-GroupsV314Test-235949681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:42:45 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b7852322-2370-4f1a-8684-e1fae126b531 tempest-GroupsV314Test-235949681 None] Flow 'volume_create_manager' (30d6a43c-7dea-425f-82d4-c089af792ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:42:45 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b7852322-2370-4f1a-8684-e1fae126b531 tempest-GroupsV314Test-235949681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0070aa22-fd2a-41d7-9d3f-012defd5b576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:42:45 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b7852322-2370-4f1a-8684-e1fae126b531 tempest-GroupsV314Test-235949681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0070aa22-fd2a-41d7-9d3f-012defd5b576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:42:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-646661665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=10eacc1b-52b5-4e21-a997-28e277b89508,host='devstack@QuobyteHD#QuobyteHD',id=8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed104a7472bf40c5bb99b92ea942532f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:42:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:42:46Z,use_quota=True,user_id='1e5edefae23345c89224578533ca01ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(342a45a9-0822-494b-abe4-7dd48d295c70),volume_type_id=342a45a9-0822-494b-abe4-7dd48d295c70)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:42:45 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b7852322-2370-4f1a-8684-e1fae126b531 tempest-GroupsV314Test-235949681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb1330da-045f-495a-ab28-5bc5593dac78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:42:45 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b7852322-2370-4f1a-8684-e1fae126b531 tempest-GroupsV314Test-235949681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb1330da-045f-495a-ab28-5bc5593dac78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:42:45 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b7852322-2370-4f1a-8684-e1fae126b531 tempest-GroupsV314Test-235949681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efe9dca5-79cb-449b-9347-cd2aa6ee2a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:42:45 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b7852322-2370-4f1a-8684-e1fae126b531 tempest-GroupsV314Test-235949681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efe9dca5-79cb-449b-9347-cd2aa6ee2a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410', 'volume_name': 'volume-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:42:45 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b7852322-2370-4f1a-8684-e1fae126b531 tempest-GroupsV314Test-235949681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b25d100d-b005-44c9-b654-4671066d8755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:42:45 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b7852322-2370-4f1a-8684-e1fae126b531 tempest-GroupsV314Test-235949681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b25d100d-b005-44c9-b654-4671066d8755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:42:45 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b7852322-2370-4f1a-8684-e1fae126b531 tempest-GroupsV314Test-235949681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (402744a1-7538-4f26-b0de-2e2717389da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:42:45 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-b7852322-2370-4f1a-8684-e1fae126b531 tempest-GroupsV314Test-235949681 None] Volume 8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410', 'volume_size': 1} Sep 08 06:42:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b7852322-2370-4f1a-8684-e1fae126b531 tempest-GroupsV314Test-235949681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:42:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b7852322-2370-4f1a-8684-e1fae126b531 tempest-GroupsV314Test-235949681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:42:45 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-b7852322-2370-4f1a-8684-e1fae126b531 tempest-GroupsV314Test-235949681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=10eacc1b-52b5-4e21-a997-28e277b89508,created_at=2026-09-08T04:42:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-646661665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=10eacc1b-52b5-4e21-a997-28e277b89508,host='devstack@QuobyteHD#QuobyteHD',id=8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed104a7472bf40c5bb99b92ea942532f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:42:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:42:46Z,use_quota=True,user_id='1e5edefae23345c89224578533ca01ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(342a45a9-0822-494b-abe4-7dd48d295c70),volume_type_id=342a45a9-0822-494b-abe4-7dd48d295c70)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:42:45 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-b7852322-2370-4f1a-8684-e1fae126b531 tempest-GroupsV314Test-235949681 None] Creating volume 8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:42:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b7852322-2370-4f1a-8684-e1fae126b531 tempest-GroupsV314Test-235949681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:42:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b7852322-2370-4f1a-8684-e1fae126b531 tempest-GroupsV314Test-235949681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:42:45 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-b7852322-2370-4f1a-8684-e1fae126b531 tempest-GroupsV314Test-235949681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:42:45 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-b7852322-2370-4f1a-8684-e1fae126b531 tempest-GroupsV314Test-235949681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:42:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b7852322-2370-4f1a-8684-e1fae126b531 tempest-GroupsV314Test-235949681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:42:45 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-b7852322-2370-4f1a-8684-e1fae126b531 tempest-GroupsV314Test-235949681 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:42:45 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-b7852322-2370-4f1a-8684-e1fae126b531 tempest-GroupsV314Test-235949681 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:42:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b7852322-2370-4f1a-8684-e1fae126b531 tempest-GroupsV314Test-235949681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:42:45 devstack sudo[88890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410 1073741824 Sep 08 06:42:45 devstack sudo[88890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:42:46 devstack sudo[88890]: pam_unix(sudo:session): session closed for user root Sep 08 06:42:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b7852322-2370-4f1a-8684-e1fae126b531 tempest-GroupsV314Test-235949681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410 1073741824" returned: 0 in 0.603s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:42:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b7852322-2370-4f1a-8684-e1fae126b531 tempest-GroupsV314Test-235949681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:42:46 devstack sudo[88897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410 Sep 08 06:42:46 devstack sudo[88897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:42:46 devstack sudo[88897]: pam_unix(sudo:session): session closed for user root Sep 08 06:42:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b7852322-2370-4f1a-8684-e1fae126b531 tempest-GroupsV314Test-235949681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410" returned: 0 in 0.300s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:42:46 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-b7852322-2370-4f1a-8684-e1fae126b531 tempest-GroupsV314Test-235949681 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:42:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b7852322-2370-4f1a-8684-e1fae126b531 tempest-GroupsV314Test-235949681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:42:46 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b7852322-2370-4f1a-8684-e1fae126b531 tempest-GroupsV314Test-235949681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (402744a1-7538-4f26-b0de-2e2717389da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:42:46 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b7852322-2370-4f1a-8684-e1fae126b531 tempest-GroupsV314Test-235949681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95ba33a3-50c9-46ff-b72f-93d1a1d23e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:42:46 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-b7852322-2370-4f1a-8684-e1fae126b531 tempest-GroupsV314Test-235949681 None] Volume volume-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410 (8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410): created successfully Sep 08 06:42:46 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b7852322-2370-4f1a-8684-e1fae126b531 tempest-GroupsV314Test-235949681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95ba33a3-50c9-46ff-b72f-93d1a1d23e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:42:46 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b7852322-2370-4f1a-8684-e1fae126b531 tempest-GroupsV314Test-235949681 None] Flow 'volume_create_manager' (30d6a43c-7dea-425f-82d4-c089af792ae7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:42:46 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-b7852322-2370-4f1a-8684-e1fae126b531 tempest-GroupsV314Test-235949681 None] Created volume successfully. Sep 08 06:42:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-7bb6ce66-3e86-49a0-aeb3-8d5b8d67cc26 tempest-GroupsV314Test-235949681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:42:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-7bb6ce66-3e86-49a0-aeb3-8d5b8d67cc26 tempest-GroupsV314Test-235949681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:42:49 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-7bb6ce66-3e86-49a0-aeb3-8d5b8d67cc26 tempest-GroupsV314Test-235949681 None] Cloning volume 8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410 to volume 4aa4b3fd-a0be-4b51-ac33-869659908180 Sep 08 06:42:49 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-7bb6ce66-3e86-49a0-aeb3-8d5b8d67cc26 tempest-GroupsV314Test-235949681 None] Creating offline snapshot b925bca8-fea9-4da7-af1d-074d65b2db49 of volume 8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410 {{(pid=87507) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 06:42:49 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6563ab0b-3887-4536-8369-d04c0a53a567]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:42:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7bb6ce66-3e86-49a0-aeb3-8d5b8d67cc26 tempest-GroupsV314Test-235949681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:42:49 devstack sudo[88903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410 Sep 08 06:42:49 devstack sudo[88903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:42:49 devstack sudo[88903]: pam_unix(sudo:session): session closed for user root Sep 08 06:42:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7bb6ce66-3e86-49a0-aeb3-8d5b8d67cc26 tempest-GroupsV314Test-235949681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410" returned: 0 in 0.585s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:42:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7bb6ce66-3e86-49a0-aeb3-8d5b8d67cc26 tempest-GroupsV314Test-235949681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410.b925bca8-fea9-4da7-af1d-074d65b2db49 1G {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:42:49 devstack sudo[88908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410.b925bca8-fea9-4da7-af1d-074d65b2db49 1G Sep 08 06:42:49 devstack sudo[88908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:42:50 devstack sudo[88908]: pam_unix(sudo:session): session closed for user root Sep 08 06:42:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7bb6ce66-3e86-49a0-aeb3-8d5b8d67cc26 tempest-GroupsV314Test-235949681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410.b925bca8-fea9-4da7-af1d-074d65b2db49 1G" returned: 0 in 0.436s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:42:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7bb6ce66-3e86-49a0-aeb3-8d5b8d67cc26 tempest-GroupsV314Test-235949681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410.b925bca8-fea9-4da7-af1d-074d65b2db49 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:42:50 devstack sudo[88914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410.b925bca8-fea9-4da7-af1d-074d65b2db49 Sep 08 06:42:50 devstack sudo[88914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:42:50 devstack sudo[88914]: pam_unix(sudo:session): session closed for user root Sep 08 06:42:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7bb6ce66-3e86-49a0-aeb3-8d5b8d67cc26 tempest-GroupsV314Test-235949681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410.b925bca8-fea9-4da7-af1d-074d65b2db49" returned: 0 in 0.414s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:42:50 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-7bb6ce66-3e86-49a0-aeb3-8d5b8d67cc26 tempest-GroupsV314Test-235949681 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410.b925bca8-fea9-4da7-af1d-074d65b2db49 is being set with open permissions: ugo+rw: NotImplementedError Sep 08 06:42:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7bb6ce66-3e86-49a0-aeb3-8d5b8d67cc26 tempest-GroupsV314Test-235949681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410.b925bca8-fea9-4da7-af1d-074d65b2db49 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:42:50 devstack sudo[88919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410.b925bca8-fea9-4da7-af1d-074d65b2db49 Sep 08 06:42:50 devstack sudo[88919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:42:50 devstack sudo[88919]: pam_unix(sudo:session): session closed for user root Sep 08 06:42:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7bb6ce66-3e86-49a0-aeb3-8d5b8d67cc26 tempest-GroupsV314Test-235949681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410.b925bca8-fea9-4da7-af1d-074d65b2db49" returned: 0 in 0.383s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:42:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7bb6ce66-3e86-49a0-aeb3-8d5b8d67cc26 tempest-GroupsV314Test-235949681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:42:51 devstack sudo[88922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410.info Sep 08 06:42:51 devstack sudo[88922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:42:51 devstack sudo[88922]: pam_unix(sudo:session): session closed for user root Sep 08 06:42:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7bb6ce66-3e86-49a0-aeb3-8d5b8d67cc26 tempest-GroupsV314Test-235949681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410.info" returned: 0 in 0.305s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:42:51 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-7bb6ce66-3e86-49a0-aeb3-8d5b8d67cc26 tempest-GroupsV314Test-235949681 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410.info is being set with open permissions: ugo+rw: NotImplementedError Sep 08 06:42:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7bb6ce66-3e86-49a0-aeb3-8d5b8d67cc26 tempest-GroupsV314Test-235949681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:42:51 devstack sudo[88926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410.info Sep 08 06:42:51 devstack sudo[88926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:42:51 devstack sudo[88926]: pam_unix(sudo:session): session closed for user root Sep 08 06:42:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7bb6ce66-3e86-49a0-aeb3-8d5b8d67cc26 tempest-GroupsV314Test-235949681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410.info" returned: 0 in 0.330s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:42:51 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-7bb6ce66-3e86-49a0-aeb3-8d5b8d67cc26 tempest-GroupsV314Test-235949681 None] Acquiring lock "cinder-quobyte-4aa4b3fd-a0be-4b51-ac33-869659908180" by "_copy_volume_from_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:42:51 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-7bb6ce66-3e86-49a0-aeb3-8d5b8d67cc26 tempest-GroupsV314Test-235949681 None] Lock "cinder-quobyte-4aa4b3fd-a0be-4b51-ac33-869659908180" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:42:51 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-7bb6ce66-3e86-49a0-aeb3-8d5b8d67cc26 tempest-GroupsV314Test-235949681 None] snapshot: b925bca8-fea9-4da7-af1d-074d65b2db49, volume: 4aa4b3fd-a0be-4b51-ac33-869659908180, {{(pid=87507) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 08 06:42:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-7bb6ce66-3e86-49a0-aeb3-8d5b8d67cc26 tempest-GroupsV314Test-235949681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:42:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-7bb6ce66-3e86-49a0-aeb3-8d5b8d67cc26 tempest-GroupsV314Test-235949681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:42:51 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-7bb6ce66-3e86-49a0-aeb3-8d5b8d67cc26 tempest-GroupsV314Test-235949681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:42:51 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-7bb6ce66-3e86-49a0-aeb3-8d5b8d67cc26 tempest-GroupsV314Test-235949681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:42:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-7bb6ce66-3e86-49a0-aeb3-8d5b8d67cc26 tempest-GroupsV314Test-235949681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:42:51 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a113b9c-aecb-4076-a8b3-28ef01b7083c]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:42:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7bb6ce66-3e86-49a0-aeb3-8d5b8d67cc26 tempest-GroupsV314Test-235949681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410.b925bca8-fea9-4da7-af1d-074d65b2db49 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:42:51 devstack sudo[88930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410.b925bca8-fea9-4da7-af1d-074d65b2db49 Sep 08 06:42:51 devstack sudo[88930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:42:52 devstack sudo[88930]: pam_unix(sudo:session): session closed for user root Sep 08 06:42:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7bb6ce66-3e86-49a0-aeb3-8d5b8d67cc26 tempest-GroupsV314Test-235949681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410.b925bca8-fea9-4da7-af1d-074d65b2db49" returned: 0 in 0.541s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:42:52 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-7bb6ce66-3e86-49a0-aeb3-8d5b8d67cc26 tempest-GroupsV314Test-235949681 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 06:42:52 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[03fd3f6d-cdb5-4168-9437-8e5394bdc897]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:42:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7bb6ce66-3e86-49a0-aeb3-8d5b8d67cc26 tempest-GroupsV314Test-235949681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:42:52 devstack sudo[88935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410 Sep 08 06:42:52 devstack sudo[88935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:42:52 devstack sudo[88935]: pam_unix(sudo:session): session closed for user root Sep 08 06:42:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7bb6ce66-3e86-49a0-aeb3-8d5b8d67cc26 tempest-GroupsV314Test-235949681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410" returned: 0 in 0.392s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:42:52 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-7bb6ce66-3e86-49a0-aeb3-8d5b8d67cc26 tempest-GroupsV314Test-235949681 None] will copy from snapshot at /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410 {{(pid=87507) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 08 06:42:52 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-7bb6ce66-3e86-49a0-aeb3-8d5b8d67cc26 tempest-GroupsV314Test-235949681 None] Creating direct copy from snapshot {{(pid=87507) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 08 06:42:52 devstack cinder-volume[87507]: DEBUG cinder.utils [None req-7bb6ce66-3e86-49a0-aeb3-8d5b8d67cc26 tempest-GroupsV314Test-235949681 None] Path /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4aa4b3fd-a0be-4b51-ac33-869659908180 not found in is_blk_device check {{(pid=87507) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 08 06:42:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7bb6ce66-3e86-49a0-aeb3-8d5b8d67cc26 tempest-GroupsV314Test-235949681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4aa4b3fd-a0be-4b51-ac33-869659908180 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:42:52 devstack sudo[88940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4aa4b3fd-a0be-4b51-ac33-869659908180 Sep 08 06:42:52 devstack sudo[88940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:42:58 devstack sudo[88940]: pam_unix(sudo:session): session closed for user root Sep 08 06:42:58 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7bb6ce66-3e86-49a0-aeb3-8d5b8d67cc26 tempest-GroupsV314Test-235949681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4aa4b3fd-a0be-4b51-ac33-869659908180" returned: 0 in 5.733s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:42:58 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-7bb6ce66-3e86-49a0-aeb3-8d5b8d67cc26 tempest-GroupsV314Test-235949681 None] Image conversion details: src /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410, size 1024.00 MB, duration 5.73 sec, destination /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4aa4b3fd-a0be-4b51-ac33-869659908180 {{(pid=87507) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 06:42:58 devstack cinder-volume[87507]: INFO cinder.image.image_utils [None req-7bb6ce66-3e86-49a0-aeb3-8d5b8d67cc26 tempest-GroupsV314Test-235949681 None] Converted 1024.00 MB image at 178.58 MB/s Sep 08 06:42:58 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-7bb6ce66-3e86-49a0-aeb3-8d5b8d67cc26 tempest-GroupsV314Test-235949681 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4aa4b3fd-a0be-4b51-ac33-869659908180 is being set with open permissions: ugo+rw: NotImplementedError Sep 08 06:42:58 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7bb6ce66-3e86-49a0-aeb3-8d5b8d67cc26 tempest-GroupsV314Test-235949681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4aa4b3fd-a0be-4b51-ac33-869659908180 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:42:58 devstack sudo[88972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4aa4b3fd-a0be-4b51-ac33-869659908180 Sep 08 06:42:58 devstack sudo[88972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:42:58 devstack sudo[88972]: pam_unix(sudo:session): session closed for user root Sep 08 06:42:58 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7bb6ce66-3e86-49a0-aeb3-8d5b8d67cc26 tempest-GroupsV314Test-235949681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4aa4b3fd-a0be-4b51-ac33-869659908180" returned: 0 in 0.291s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:42:58 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-7bb6ce66-3e86-49a0-aeb3-8d5b8d67cc26 tempest-GroupsV314Test-235949681 None] Lock "cinder-quobyte-4aa4b3fd-a0be-4b51-ac33-869659908180" released by "_copy_volume_from_snapshot" :: held 7.058s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:42:58 devstack cinder-volume[87507]: DEBUG dbcounter [-] [87507] Writing DB stats cinder:UPDATE=74,cinder:SELECT=55,cinder:DELETE=8,cinder:INSERT=14 {{(pid=87507) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 06:42:58 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-7bb6ce66-3e86-49a0-aeb3-8d5b8d67cc26 tempest-GroupsV314Test-235949681 None] Acquiring lock "cinder-quobyte-b925bca8-fea9-4da7-af1d-074d65b2db49" by "_delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:42:58 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-7bb6ce66-3e86-49a0-aeb3-8d5b8d67cc26 tempest-GroupsV314Test-235949681 None] Lock "cinder-quobyte-b925bca8-fea9-4da7-af1d-074d65b2db49" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:42:58 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-7bb6ce66-3e86-49a0-aeb3-8d5b8d67cc26 tempest-GroupsV314Test-235949681 None] Deleting offline snapshot b925bca8-fea9-4da7-af1d-074d65b2db49 of volume 8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410 {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 06:42:58 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-7bb6ce66-3e86-49a0-aeb3-8d5b8d67cc26 tempest-GroupsV314Test-235949681 None] snapshot_file for this snap is: volume-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410.b925bca8-fea9-4da7-af1d-074d65b2db49 {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 06:42:58 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2c46d4-373b-4879-be49-facbe13fe9d1]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:42:58 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7bb6ce66-3e86-49a0-aeb3-8d5b8d67cc26 tempest-GroupsV314Test-235949681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410.b925bca8-fea9-4da7-af1d-074d65b2db49 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:42:58 devstack sudo[88975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410.b925bca8-fea9-4da7-af1d-074d65b2db49 Sep 08 06:42:58 devstack sudo[88975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:42:59 devstack sudo[88975]: pam_unix(sudo:session): session closed for user root Sep 08 06:42:59 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7bb6ce66-3e86-49a0-aeb3-8d5b8d67cc26 tempest-GroupsV314Test-235949681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410.b925bca8-fea9-4da7-af1d-074d65b2db49" returned: 0 in 0.409s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:42:59 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-7bb6ce66-3e86-49a0-aeb3-8d5b8d67cc26 tempest-GroupsV314Test-235949681 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 06:42:59 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c12b83-15fb-4028-894c-4d5520f219a8]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:42:59 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7bb6ce66-3e86-49a0-aeb3-8d5b8d67cc26 tempest-GroupsV314Test-235949681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:42:59 devstack sudo[88980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410 Sep 08 06:42:59 devstack sudo[88980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:42:59 devstack sudo[88980]: pam_unix(sudo:session): session closed for user root Sep 08 06:42:59 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7bb6ce66-3e86-49a0-aeb3-8d5b8d67cc26 tempest-GroupsV314Test-235949681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410" returned: 0 in 0.646s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:42:59 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7bb6ce66-3e86-49a0-aeb3-8d5b8d67cc26 tempest-GroupsV314Test-235949681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410.b925bca8-fea9-4da7-af1d-074d65b2db49 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:42:59 devstack sudo[88986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410.b925bca8-fea9-4da7-af1d-074d65b2db49 Sep 08 06:42:59 devstack sudo[88986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:43:00 devstack sudo[88986]: pam_unix(sudo:session): session closed for user root Sep 08 06:43:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7bb6ce66-3e86-49a0-aeb3-8d5b8d67cc26 tempest-GroupsV314Test-235949681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410.b925bca8-fea9-4da7-af1d-074d65b2db49" returned: 0 in 0.378s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:43:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7bb6ce66-3e86-49a0-aeb3-8d5b8d67cc26 tempest-GroupsV314Test-235949681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410.b925bca8-fea9-4da7-af1d-074d65b2db49 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:43:00 devstack sudo[88992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410.b925bca8-fea9-4da7-af1d-074d65b2db49 Sep 08 06:43:00 devstack sudo[88992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:43:00 devstack sudo[88992]: pam_unix(sudo:session): session closed for user root Sep 08 06:43:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7bb6ce66-3e86-49a0-aeb3-8d5b8d67cc26 tempest-GroupsV314Test-235949681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410.b925bca8-fea9-4da7-af1d-074d65b2db49" returned: 0 in 0.341s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:43:00 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-7bb6ce66-3e86-49a0-aeb3-8d5b8d67cc26 tempest-GroupsV314Test-235949681 None] Lock "cinder-quobyte-b925bca8-fea9-4da7-af1d-074d65b2db49" released by "_delete_snapshot" :: held 1.903s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:43:00 devstack cinder-volume[87507]: DEBUG dbcounter [-] [87507] Writing DB stats cinder:SELECT=47,cinder:INSERT=19,cinder:UPDATE=69,cinder:DELETE=5 {{(pid=87507) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 06:43:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-7bb6ce66-3e86-49a0-aeb3-8d5b8d67cc26 tempest-GroupsV314Test-235949681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.732s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:43:00 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-7bb6ce66-3e86-49a0-aeb3-8d5b8d67cc26 tempest-GroupsV314Test-235949681 None] Create group from source-group-10eacc1b-52b5-4e21-a997-28e277b89508 completed successfully. Sep 08 06:43:01 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-5190f2a0-2f41-4152-84e3-c4c99a771445 tempest-GroupsV314Test-235949681 None] Acquiring lock "cinder-quobyte-4aa4b3fd-a0be-4b51-ac33-869659908180" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:43:01 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-5190f2a0-2f41-4152-84e3-c4c99a771445 tempest-GroupsV314Test-235949681 None] Lock "cinder-quobyte-4aa4b3fd-a0be-4b51-ac33-869659908180" acquired by "delete_volume" :: waited 0.018s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:43:01 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[154c8679-33cd-4a42-bd6f-329cdcf0ec5a]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:43:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5190f2a0-2f41-4152-84e3-c4c99a771445 tempest-GroupsV314Test-235949681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4aa4b3fd-a0be-4b51-ac33-869659908180 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:43:01 devstack sudo[88995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4aa4b3fd-a0be-4b51-ac33-869659908180 Sep 08 06:43:01 devstack sudo[88995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:43:02 devstack sudo[88995]: pam_unix(sudo:session): session closed for user root Sep 08 06:43:02 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5190f2a0-2f41-4152-84e3-c4c99a771445 tempest-GroupsV314Test-235949681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4aa4b3fd-a0be-4b51-ac33-869659908180" returned: 0 in 0.437s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:43:02 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5190f2a0-2f41-4152-84e3-c4c99a771445 tempest-GroupsV314Test-235949681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4aa4b3fd-a0be-4b51-ac33-869659908180 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:43:02 devstack sudo[89000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4aa4b3fd-a0be-4b51-ac33-869659908180 Sep 08 06:43:02 devstack sudo[89000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:43:02 devstack sudo[89000]: pam_unix(sudo:session): session closed for user root Sep 08 06:43:02 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5190f2a0-2f41-4152-84e3-c4c99a771445 tempest-GroupsV314Test-235949681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4aa4b3fd-a0be-4b51-ac33-869659908180" returned: 0 in 0.249s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:43:02 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-5190f2a0-2f41-4152-84e3-c4c99a771445 tempest-GroupsV314Test-235949681 None] Lock "cinder-quobyte-4aa4b3fd-a0be-4b51-ac33-869659908180" released by "delete_volume" :: held 0.746s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:43:02 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-5190f2a0-2f41-4152-84e3-c4c99a771445 tempest-GroupsV314Test-235949681 None] Created reservations ['f8eb6658-c6c0-4cf7-8337-b1225136d7b4'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:43:02 devstack cinder-volume[87507]: WARNING cinder.quota [None req-5190f2a0-2f41-4152-84e3-c4c99a771445 tempest-GroupsV314Test-235949681 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-204800748 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-204800748, it is now deprecated. Please use the default quota class for default quota. Sep 08 06:43:02 devstack cinder-volume[87507]: WARNING cinder.quota [None req-5190f2a0-2f41-4152-84e3-c4c99a771445 tempest-GroupsV314Test-235949681 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-204800748 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-204800748, it is now deprecated. Please use the default quota class for default quota. Sep 08 06:43:02 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-5190f2a0-2f41-4152-84e3-c4c99a771445 tempest-GroupsV314Test-235949681 None] Created reservations ['bb5cc3dc-412b-46e2-8017-b7ab44ca4faf', 'c941dd22-a2da-444e-8c5f-7b92dd200636', 'b3627cd0-4cdb-4ae1-a42f-55777b22097c', 'ff91378e-21cd-4c4e-bc4d-ac68b42cc2c5'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:43:02 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-5190f2a0-2f41-4152-84e3-c4c99a771445 tempest-GroupsV314Test-235949681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:43:02 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-5190f2a0-2f41-4152-84e3-c4c99a771445 tempest-GroupsV314Test-235949681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:43:02 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-5190f2a0-2f41-4152-84e3-c4c99a771445 tempest-GroupsV314Test-235949681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:43:02 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-5190f2a0-2f41-4152-84e3-c4c99a771445 tempest-GroupsV314Test-235949681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:43:02 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-5190f2a0-2f41-4152-84e3-c4c99a771445 tempest-GroupsV314Test-235949681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:43:02 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5190f2a0-2f41-4152-84e3-c4c99a771445 tempest-GroupsV314Test-235949681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:43:02 devstack sudo[89003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:43:02 devstack sudo[89003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:43:03 devstack sudo[89003]: pam_unix(sudo:session): session closed for user root Sep 08 06:43:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5190f2a0-2f41-4152-84e3-c4c99a771445 tempest-GroupsV314Test-235949681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.319s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:43:03 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-5190f2a0-2f41-4152-84e3-c4c99a771445 tempest-GroupsV314Test-235949681 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:43:03 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-5190f2a0-2f41-4152-84e3-c4c99a771445 tempest-GroupsV314Test-235949681 None] Delete group completed successfully. Sep 08 06:43:03 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-3cc925a2-5046-4e2b-8f0e-c24f271f1e8b tempest-GroupsV314Test-235949681 None] Acquiring lock "cinder-quobyte-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:43:03 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-3cc925a2-5046-4e2b-8f0e-c24f271f1e8b tempest-GroupsV314Test-235949681 None] Lock "cinder-quobyte-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410" acquired by "delete_volume" :: waited 0.026s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:43:03 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d33683f-aceb-4f86-b738-d757e60fcb0c]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:43:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3cc925a2-5046-4e2b-8f0e-c24f271f1e8b tempest-GroupsV314Test-235949681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:43:03 devstack sudo[89006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410 Sep 08 06:43:03 devstack sudo[89006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:43:03 devstack sudo[89006]: pam_unix(sudo:session): session closed for user root Sep 08 06:43:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3cc925a2-5046-4e2b-8f0e-c24f271f1e8b tempest-GroupsV314Test-235949681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410" returned: 0 in 0.419s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:43:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3cc925a2-5046-4e2b-8f0e-c24f271f1e8b tempest-GroupsV314Test-235949681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:43:03 devstack sudo[89011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410 Sep 08 06:43:03 devstack sudo[89011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:43:04 devstack sudo[89011]: pam_unix(sudo:session): session closed for user root Sep 08 06:43:04 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3cc925a2-5046-4e2b-8f0e-c24f271f1e8b tempest-GroupsV314Test-235949681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410" returned: 0 in 0.321s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:43:04 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-3cc925a2-5046-4e2b-8f0e-c24f271f1e8b tempest-GroupsV314Test-235949681 None] Lock "cinder-quobyte-8dc9d526-dcf5-4c66-a5d9-fb33dd5fc410" released by "delete_volume" :: held 0.819s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:43:04 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-3cc925a2-5046-4e2b-8f0e-c24f271f1e8b tempest-GroupsV314Test-235949681 None] Created reservations ['152421c7-9c16-4103-9cca-1d204c7df5c3'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:43:04 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-3cc925a2-5046-4e2b-8f0e-c24f271f1e8b tempest-GroupsV314Test-235949681 None] Created reservations ['2aca8931-5c6f-4adb-997e-9e74958d0bf2', '4d35a4d7-3170-44e5-b251-4d64557064cf', 'f7ce7588-db3c-4624-b457-ae785edb07fd', 'ff58aef7-b1ae-447b-bea0-e457eac77e1e'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:43:04 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-3cc925a2-5046-4e2b-8f0e-c24f271f1e8b tempest-GroupsV314Test-235949681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:43:04 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-3cc925a2-5046-4e2b-8f0e-c24f271f1e8b tempest-GroupsV314Test-235949681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:43:04 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-3cc925a2-5046-4e2b-8f0e-c24f271f1e8b tempest-GroupsV314Test-235949681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:43:04 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-3cc925a2-5046-4e2b-8f0e-c24f271f1e8b tempest-GroupsV314Test-235949681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:43:04 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-3cc925a2-5046-4e2b-8f0e-c24f271f1e8b tempest-GroupsV314Test-235949681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:43:04 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3cc925a2-5046-4e2b-8f0e-c24f271f1e8b tempest-GroupsV314Test-235949681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:43:04 devstack sudo[89014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:43:04 devstack sudo[89014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:43:04 devstack sudo[89014]: pam_unix(sudo:session): session closed for user root Sep 08 06:43:04 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3cc925a2-5046-4e2b-8f0e-c24f271f1e8b tempest-GroupsV314Test-235949681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.345s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:43:04 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-3cc925a2-5046-4e2b-8f0e-c24f271f1e8b tempest-GroupsV314Test-235949681 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:43:04 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-3cc925a2-5046-4e2b-8f0e-c24f271f1e8b tempest-GroupsV314Test-235949681 None] Delete group completed successfully. Sep 08 06:43:14 devstack cinder-volume[87507]: DEBUG dbcounter [-] [87507] Writing DB stats cinder:UPDATE=18,cinder:SELECT=21,cinder:INSERT=4 {{(pid=87507) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 06:43:14 devstack cinder-volume[87507]: DEBUG dbcounter [-] [87507] Writing DB stats cinder:UPDATE=30,cinder:SELECT=16,cinder:INSERT=6 {{(pid=87507) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 06:43:20 devstack cinder-volume[87507]: DEBUG oslo_service.periodic_task [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87507) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 06:43:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:43:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:43:20 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:43:20 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:43:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:43:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:43:20 devstack sudo[89255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:43:20 devstack sudo[89255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:43:20 devstack sudo[89255]: pam_unix(sudo:session): session closed for user root Sep 08 06:43:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.635s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:43:20 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:43:20 devstack cinder-volume[87507]: DEBUG oslo_service.periodic_task [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Running periodic task VolumeManager._thread_info {{(pid=87507) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 06:43:20 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] thread count: 8 {{(pid=87507) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 06:43:20 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] thread info: [<_MainThread(MainThread, started 127913129345152)>, , , , , , , ] {{(pid=87507) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 06:43:25 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7b8c6df-c0ae-4e93-ab69-3e22e8f202e3 tempest-DeleteServersTestJSON-1141285060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:43:25 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b7b8c6df-c0ae-4e93-ab69-3e22e8f202e3 tempest-DeleteServersTestJSON-1141285060 None] Flow 'volume_create_manager' (542f3c7c-a618-4b18-a2d4-b5ccd0de93d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:43:25 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b7b8c6df-c0ae-4e93-ab69-3e22e8f202e3 tempest-DeleteServersTestJSON-1141285060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d16d8238-987f-46c8-bc4a-d34f39c3d9a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:43:25 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b7b8c6df-c0ae-4e93-ab69-3e22e8f202e3 tempest-DeleteServersTestJSON-1141285060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d16d8238-987f-46c8-bc4a-d34f39c3d9a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:43:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-746345665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=445c6ae8-cbeb-4fb8-a697-194b0471ed58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da9c5b90417e46139899b872b530d403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:43:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:43:26Z,use_quota=True,user_id='dc7f975f6f0e4ad6822802f75ab9a360',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:43:25 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b7b8c6df-c0ae-4e93-ab69-3e22e8f202e3 tempest-DeleteServersTestJSON-1141285060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e789538-871b-4470-87d2-b0d84252083b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:43:25 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b7b8c6df-c0ae-4e93-ab69-3e22e8f202e3 tempest-DeleteServersTestJSON-1141285060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e789538-871b-4470-87d2-b0d84252083b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:43:25 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b7b8c6df-c0ae-4e93-ab69-3e22e8f202e3 tempest-DeleteServersTestJSON-1141285060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20fd3968-00cf-45e9-b2b3-8d582e8a8200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:43:25 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b7b8c6df-c0ae-4e93-ab69-3e22e8f202e3 tempest-DeleteServersTestJSON-1141285060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20fd3968-00cf-45e9-b2b3-8d582e8a8200) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '445c6ae8-cbeb-4fb8-a697-194b0471ed58', 'volume_name': 'volume-445c6ae8-cbeb-4fb8-a697-194b0471ed58', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:43:25 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b7b8c6df-c0ae-4e93-ab69-3e22e8f202e3 tempest-DeleteServersTestJSON-1141285060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eeb9e79-ae90-49e5-9f69-6f2fa2734828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:43:25 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b7b8c6df-c0ae-4e93-ab69-3e22e8f202e3 tempest-DeleteServersTestJSON-1141285060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eeb9e79-ae90-49e5-9f69-6f2fa2734828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:43:25 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b7b8c6df-c0ae-4e93-ab69-3e22e8f202e3 tempest-DeleteServersTestJSON-1141285060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f91e89f-ca69-4652-846b-8e50a84e0c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:43:25 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-b7b8c6df-c0ae-4e93-ab69-3e22e8f202e3 tempest-DeleteServersTestJSON-1141285060 None] Volume 445c6ae8-cbeb-4fb8-a697-194b0471ed58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-445c6ae8-cbeb-4fb8-a697-194b0471ed58', 'volume_size': 1} Sep 08 06:43:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b7b8c6df-c0ae-4e93-ab69-3e22e8f202e3 tempest-DeleteServersTestJSON-1141285060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:43:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b7b8c6df-c0ae-4e93-ab69-3e22e8f202e3 tempest-DeleteServersTestJSON-1141285060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:43:25 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-b7b8c6df-c0ae-4e93-ab69-3e22e8f202e3 tempest-DeleteServersTestJSON-1141285060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:43:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-746345665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=445c6ae8-cbeb-4fb8-a697-194b0471ed58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da9c5b90417e46139899b872b530d403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:43:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:43:26Z,use_quota=True,user_id='dc7f975f6f0e4ad6822802f75ab9a360',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:43:25 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-b7b8c6df-c0ae-4e93-ab69-3e22e8f202e3 tempest-DeleteServersTestJSON-1141285060 None] Creating volume 445c6ae8-cbeb-4fb8-a697-194b0471ed58 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:43:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b7b8c6df-c0ae-4e93-ab69-3e22e8f202e3 tempest-DeleteServersTestJSON-1141285060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:43:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b7b8c6df-c0ae-4e93-ab69-3e22e8f202e3 tempest-DeleteServersTestJSON-1141285060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:43:25 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-b7b8c6df-c0ae-4e93-ab69-3e22e8f202e3 tempest-DeleteServersTestJSON-1141285060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:43:25 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-b7b8c6df-c0ae-4e93-ab69-3e22e8f202e3 tempest-DeleteServersTestJSON-1141285060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:43:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b7b8c6df-c0ae-4e93-ab69-3e22e8f202e3 tempest-DeleteServersTestJSON-1141285060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:43:25 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-b7b8c6df-c0ae-4e93-ab69-3e22e8f202e3 tempest-DeleteServersTestJSON-1141285060 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:43:25 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-b7b8c6df-c0ae-4e93-ab69-3e22e8f202e3 tempest-DeleteServersTestJSON-1141285060 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:43:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b7b8c6df-c0ae-4e93-ab69-3e22e8f202e3 tempest-DeleteServersTestJSON-1141285060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-445c6ae8-cbeb-4fb8-a697-194b0471ed58 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:43:25 devstack sudo[89285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-445c6ae8-cbeb-4fb8-a697-194b0471ed58 1073741824 Sep 08 06:43:25 devstack sudo[89285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:43:26 devstack sudo[89285]: pam_unix(sudo:session): session closed for user root Sep 08 06:43:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b7b8c6df-c0ae-4e93-ab69-3e22e8f202e3 tempest-DeleteServersTestJSON-1141285060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-445c6ae8-cbeb-4fb8-a697-194b0471ed58 1073741824" returned: 0 in 0.847s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:43:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b7b8c6df-c0ae-4e93-ab69-3e22e8f202e3 tempest-DeleteServersTestJSON-1141285060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-445c6ae8-cbeb-4fb8-a697-194b0471ed58 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:43:27 devstack sudo[89296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-445c6ae8-cbeb-4fb8-a697-194b0471ed58 Sep 08 06:43:27 devstack sudo[89296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:43:27 devstack sudo[89296]: pam_unix(sudo:session): session closed for user root Sep 08 06:43:27 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b7b8c6df-c0ae-4e93-ab69-3e22e8f202e3 tempest-DeleteServersTestJSON-1141285060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-445c6ae8-cbeb-4fb8-a697-194b0471ed58" returned: 0 in 0.901s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:43:27 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-b7b8c6df-c0ae-4e93-ab69-3e22e8f202e3 tempest-DeleteServersTestJSON-1141285060 None] <== create_volume: return (1918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:43:27 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b7b8c6df-c0ae-4e93-ab69-3e22e8f202e3 tempest-DeleteServersTestJSON-1141285060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.922s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:43:27 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b7b8c6df-c0ae-4e93-ab69-3e22e8f202e3 tempest-DeleteServersTestJSON-1141285060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f91e89f-ca69-4652-846b-8e50a84e0c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-445c6ae8-cbeb-4fb8-a697-194b0471ed58', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:43:27 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b7b8c6df-c0ae-4e93-ab69-3e22e8f202e3 tempest-DeleteServersTestJSON-1141285060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c7d4590-7477-4366-8edd-b6eb800ec7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:43:27 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-b7b8c6df-c0ae-4e93-ab69-3e22e8f202e3 tempest-DeleteServersTestJSON-1141285060 None] Volume volume-445c6ae8-cbeb-4fb8-a697-194b0471ed58 (445c6ae8-cbeb-4fb8-a697-194b0471ed58): created successfully Sep 08 06:43:28 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b7b8c6df-c0ae-4e93-ab69-3e22e8f202e3 tempest-DeleteServersTestJSON-1141285060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c7d4590-7477-4366-8edd-b6eb800ec7ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:43:28 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b7b8c6df-c0ae-4e93-ab69-3e22e8f202e3 tempest-DeleteServersTestJSON-1141285060 None] Flow 'volume_create_manager' (542f3c7c-a618-4b18-a2d4-b5ccd0de93d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:43:28 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-b7b8c6df-c0ae-4e93-ab69-3e22e8f202e3 tempest-DeleteServersTestJSON-1141285060 None] Created volume successfully. Sep 08 06:43:29 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f2fa71f-63f2-42f6-8659-3e43e43fa705 tempest-VolumeRetypeWithoutMigrationTest-1109161946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:43:29 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7f2fa71f-63f2-42f6-8659-3e43e43fa705 tempest-VolumeRetypeWithoutMigrationTest-1109161946 None] Flow 'volume_create_manager' (01c2de1e-6276-41b7-a539-03997f1bc734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:43:29 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7f2fa71f-63f2-42f6-8659-3e43e43fa705 tempest-VolumeRetypeWithoutMigrationTest-1109161946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (231903bb-5ecc-4e69-9a6e-53ff4700c73f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:43:29 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7f2fa71f-63f2-42f6-8659-3e43e43fa705 tempest-VolumeRetypeWithoutMigrationTest-1109161946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (231903bb-5ecc-4e69-9a6e-53ff4700c73f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:43:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2021743743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbf11870-05f8-4360-8383-a084e09db9db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='039f27a0bbe94dffa687548b41c33a83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:43:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:43:29Z,use_quota=True,user_id='87e2a2669a954725bd683c46ccd7197a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f1929832-efce-4244-a2a8-d31d0f319278),volume_type_id=f1929832-efce-4244-a2a8-d31d0f319278)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:43:29 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7f2fa71f-63f2-42f6-8659-3e43e43fa705 tempest-VolumeRetypeWithoutMigrationTest-1109161946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45247aff-fb27-4b53-b780-7dc47308bfe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:43:29 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7f2fa71f-63f2-42f6-8659-3e43e43fa705 tempest-VolumeRetypeWithoutMigrationTest-1109161946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45247aff-fb27-4b53-b780-7dc47308bfe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:43:29 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7f2fa71f-63f2-42f6-8659-3e43e43fa705 tempest-VolumeRetypeWithoutMigrationTest-1109161946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b267e168-9d8d-4c85-87fb-b0b634daec0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:43:29 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7f2fa71f-63f2-42f6-8659-3e43e43fa705 tempest-VolumeRetypeWithoutMigrationTest-1109161946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b267e168-9d8d-4c85-87fb-b0b634daec0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbf11870-05f8-4360-8383-a084e09db9db', 'volume_name': 'volume-cbf11870-05f8-4360-8383-a084e09db9db', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:43:29 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7f2fa71f-63f2-42f6-8659-3e43e43fa705 tempest-VolumeRetypeWithoutMigrationTest-1109161946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28177d58-c37b-434b-a5b2-51f2490e3eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:43:29 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7f2fa71f-63f2-42f6-8659-3e43e43fa705 tempest-VolumeRetypeWithoutMigrationTest-1109161946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28177d58-c37b-434b-a5b2-51f2490e3eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:43:29 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7f2fa71f-63f2-42f6-8659-3e43e43fa705 tempest-VolumeRetypeWithoutMigrationTest-1109161946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f7e14b8-fbd7-4b15-aec3-1634da28f453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:43:29 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-7f2fa71f-63f2-42f6-8659-3e43e43fa705 tempest-VolumeRetypeWithoutMigrationTest-1109161946 None] Volume cbf11870-05f8-4360-8383-a084e09db9db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbf11870-05f8-4360-8383-a084e09db9db', 'volume_size': 1} Sep 08 06:43:29 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-7f2fa71f-63f2-42f6-8659-3e43e43fa705 tempest-VolumeRetypeWithoutMigrationTest-1109161946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:43:29 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-7f2fa71f-63f2-42f6-8659-3e43e43fa705 tempest-VolumeRetypeWithoutMigrationTest-1109161946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:43:29 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-7f2fa71f-63f2-42f6-8659-3e43e43fa705 tempest-VolumeRetypeWithoutMigrationTest-1109161946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:43:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2021743743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbf11870-05f8-4360-8383-a084e09db9db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='039f27a0bbe94dffa687548b41c33a83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:43:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:43:29Z,use_quota=True,user_id='87e2a2669a954725bd683c46ccd7197a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f1929832-efce-4244-a2a8-d31d0f319278),volume_type_id=f1929832-efce-4244-a2a8-d31d0f319278)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:43:29 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-7f2fa71f-63f2-42f6-8659-3e43e43fa705 tempest-VolumeRetypeWithoutMigrationTest-1109161946 None] Creating volume cbf11870-05f8-4360-8383-a084e09db9db {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:43:29 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-7f2fa71f-63f2-42f6-8659-3e43e43fa705 tempest-VolumeRetypeWithoutMigrationTest-1109161946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:43:29 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-7f2fa71f-63f2-42f6-8659-3e43e43fa705 tempest-VolumeRetypeWithoutMigrationTest-1109161946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:43:29 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-7f2fa71f-63f2-42f6-8659-3e43e43fa705 tempest-VolumeRetypeWithoutMigrationTest-1109161946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:43:29 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-7f2fa71f-63f2-42f6-8659-3e43e43fa705 tempest-VolumeRetypeWithoutMigrationTest-1109161946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:43:29 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-7f2fa71f-63f2-42f6-8659-3e43e43fa705 tempest-VolumeRetypeWithoutMigrationTest-1109161946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:43:29 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-7f2fa71f-63f2-42f6-8659-3e43e43fa705 tempest-VolumeRetypeWithoutMigrationTest-1109161946 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:43:29 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-7f2fa71f-63f2-42f6-8659-3e43e43fa705 tempest-VolumeRetypeWithoutMigrationTest-1109161946 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:43:29 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7f2fa71f-63f2-42f6-8659-3e43e43fa705 tempest-VolumeRetypeWithoutMigrationTest-1109161946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cbf11870-05f8-4360-8383-a084e09db9db 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:43:29 devstack sudo[89363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cbf11870-05f8-4360-8383-a084e09db9db 1073741824 Sep 08 06:43:29 devstack sudo[89363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:43:30 devstack sudo[89363]: pam_unix(sudo:session): session closed for user root Sep 08 06:43:30 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7f2fa71f-63f2-42f6-8659-3e43e43fa705 tempest-VolumeRetypeWithoutMigrationTest-1109161946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cbf11870-05f8-4360-8383-a084e09db9db 1073741824" returned: 0 in 1.158s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:43:30 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7f2fa71f-63f2-42f6-8659-3e43e43fa705 tempest-VolumeRetypeWithoutMigrationTest-1109161946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cbf11870-05f8-4360-8383-a084e09db9db {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:43:30 devstack sudo[89377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cbf11870-05f8-4360-8383-a084e09db9db Sep 08 06:43:30 devstack sudo[89377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:43:31 devstack sudo[89377]: pam_unix(sudo:session): session closed for user root Sep 08 06:43:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7f2fa71f-63f2-42f6-8659-3e43e43fa705 tempest-VolumeRetypeWithoutMigrationTest-1109161946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cbf11870-05f8-4360-8383-a084e09db9db" returned: 0 in 0.569s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:43:31 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-7f2fa71f-63f2-42f6-8659-3e43e43fa705 tempest-VolumeRetypeWithoutMigrationTest-1109161946 None] <== create_volume: return (1812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:43:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-7f2fa71f-63f2-42f6-8659-3e43e43fa705 tempest-VolumeRetypeWithoutMigrationTest-1109161946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.816s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:43:31 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7f2fa71f-63f2-42f6-8659-3e43e43fa705 tempest-VolumeRetypeWithoutMigrationTest-1109161946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f7e14b8-fbd7-4b15-aec3-1634da28f453) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbf11870-05f8-4360-8383-a084e09db9db', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:43:31 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7f2fa71f-63f2-42f6-8659-3e43e43fa705 tempest-VolumeRetypeWithoutMigrationTest-1109161946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (846e6901-f394-42ee-b4c3-40d4185d94e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:43:31 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-7f2fa71f-63f2-42f6-8659-3e43e43fa705 tempest-VolumeRetypeWithoutMigrationTest-1109161946 None] Volume volume-cbf11870-05f8-4360-8383-a084e09db9db (cbf11870-05f8-4360-8383-a084e09db9db): created successfully Sep 08 06:43:31 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7f2fa71f-63f2-42f6-8659-3e43e43fa705 tempest-VolumeRetypeWithoutMigrationTest-1109161946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (846e6901-f394-42ee-b4c3-40d4185d94e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:43:31 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7f2fa71f-63f2-42f6-8659-3e43e43fa705 tempest-VolumeRetypeWithoutMigrationTest-1109161946 None] Flow 'volume_create_manager' (01c2de1e-6276-41b7-a539-03997f1bc734) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:43:31 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-7f2fa71f-63f2-42f6-8659-3e43e43fa705 tempest-VolumeRetypeWithoutMigrationTest-1109161946 None] Created volume successfully. Sep 08 06:43:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-9b02d02f-e514-4a66-b828-40455b333220 tempest-VolumeRetypeWithoutMigrationTest-1109161946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:43:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-9b02d02f-e514-4a66-b828-40455b333220 tempest-VolumeRetypeWithoutMigrationTest-1109161946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:43:32 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-9b02d02f-e514-4a66-b828-40455b333220 tempest-VolumeRetypeWithoutMigrationTest-1109161946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:43:32 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-9b02d02f-e514-4a66-b828-40455b333220 tempest-VolumeRetypeWithoutMigrationTest-1109161946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:43:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-9b02d02f-e514-4a66-b828-40455b333220 tempest-VolumeRetypeWithoutMigrationTest-1109161946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:43:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9b02d02f-e514-4a66-b828-40455b333220 tempest-VolumeRetypeWithoutMigrationTest-1109161946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:43:32 devstack sudo[89409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:43:32 devstack sudo[89409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:43:33 devstack sudo[89409]: pam_unix(sudo:session): session closed for user root Sep 08 06:43:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9b02d02f-e514-4a66-b828-40455b333220 tempest-VolumeRetypeWithoutMigrationTest-1109161946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.560s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:43:33 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-9b02d02f-e514-4a66-b828-40455b333220 tempest-VolumeRetypeWithoutMigrationTest-1109161946 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:43:33 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-9b02d02f-e514-4a66-b828-40455b333220 tempest-VolumeRetypeWithoutMigrationTest-1109161946 None] Retype volume completed successfully. Sep 08 06:43:33 devstack cinder-volume[87507]: WARNING py.warnings [req-f48fbab2-0fc0-4548-bca6-cb57e2e4c314 req-f8c8b450-ebef-43ab-9a7b-f95f82c957aa tempest-DeleteServersTestJSON-1141285060 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Sep 08 06:43:33 devstack cinder-volume[87507]: .first() Sep 08 06:43:33 devstack cinder-volume[87507]: Sep 08 06:43:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-f48fbab2-0fc0-4548-bca6-cb57e2e4c314 req-f8c8b450-ebef-43ab-9a7b-f95f82c957aa tempest-DeleteServersTestJSON-1141285060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:43:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-f48fbab2-0fc0-4548-bca6-cb57e2e4c314 req-f8c8b450-ebef-43ab-9a7b-f95f82c957aa tempest-DeleteServersTestJSON-1141285060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:43:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-f48fbab2-0fc0-4548-bca6-cb57e2e4c314 req-f8c8b450-ebef-43ab-9a7b-f95f82c957aa tempest-DeleteServersTestJSON-1141285060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:43:33 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-f48fbab2-0fc0-4548-bca6-cb57e2e4c314 req-f8c8b450-ebef-43ab-9a7b-f95f82c957aa tempest-DeleteServersTestJSON-1141285060 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d', 'name': 'volume-445c6ae8-cbeb-4fb8-a697-194b0471ed58', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1d55c23f-c09e-4f3d-a8e5-b53221021df7', 'enforce_multipath': True} {{(pid=87507) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 06:43:33 devstack cinder-volume[87507]: INFO cinder.volume.manager [req-f48fbab2-0fc0-4548-bca6-cb57e2e4c314 req-f8c8b450-ebef-43ab-9a7b-f95f82c957aa tempest-DeleteServersTestJSON-1141285060 None] attachment_update completed successfully. Sep 08 06:43:34 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-64b4d685-20e2-4d78-a247-3dc131f19638 tempest-VolumeRetypeWithoutMigrationTest-1109161946 None] Acquiring lock "cinder-cbf11870-05f8-4360-8383-a084e09db9db-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:43:34 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-64b4d685-20e2-4d78-a247-3dc131f19638 tempest-VolumeRetypeWithoutMigrationTest-1109161946 None] Lock "cinder-cbf11870-05f8-4360-8383-a084e09db9db-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:43:34 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-64b4d685-20e2-4d78-a247-3dc131f19638 tempest-VolumeRetypeWithoutMigrationTest-1109161946 None] Acquiring lock "cinder-quobyte-cbf11870-05f8-4360-8383-a084e09db9db" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:43:34 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-64b4d685-20e2-4d78-a247-3dc131f19638 tempest-VolumeRetypeWithoutMigrationTest-1109161946 None] Lock "cinder-quobyte-cbf11870-05f8-4360-8383-a084e09db9db" acquired by "delete_volume" :: waited 0.046s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:43:34 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4feee1f7-5a1e-4614-bab1-912c5995f480]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:43:34 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-64b4d685-20e2-4d78-a247-3dc131f19638 tempest-VolumeRetypeWithoutMigrationTest-1109161946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cbf11870-05f8-4360-8383-a084e09db9db {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:43:34 devstack sudo[89509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cbf11870-05f8-4360-8383-a084e09db9db Sep 08 06:43:34 devstack sudo[89509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:43:35 devstack sudo[89509]: pam_unix(sudo:session): session closed for user root Sep 08 06:43:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-64b4d685-20e2-4d78-a247-3dc131f19638 tempest-VolumeRetypeWithoutMigrationTest-1109161946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cbf11870-05f8-4360-8383-a084e09db9db" returned: 0 in 0.489s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:43:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-64b4d685-20e2-4d78-a247-3dc131f19638 tempest-VolumeRetypeWithoutMigrationTest-1109161946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cbf11870-05f8-4360-8383-a084e09db9db {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:43:35 devstack sudo[89817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cbf11870-05f8-4360-8383-a084e09db9db Sep 08 06:43:35 devstack sudo[89817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:43:35 devstack sudo[89817]: pam_unix(sudo:session): session closed for user root Sep 08 06:43:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-64b4d685-20e2-4d78-a247-3dc131f19638 tempest-VolumeRetypeWithoutMigrationTest-1109161946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cbf11870-05f8-4360-8383-a084e09db9db" returned: 0 in 0.559s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:43:35 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-64b4d685-20e2-4d78-a247-3dc131f19638 tempest-VolumeRetypeWithoutMigrationTest-1109161946 None] Lock "cinder-quobyte-cbf11870-05f8-4360-8383-a084e09db9db" released by "delete_volume" :: held 1.134s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:43:35 devstack cinder-volume[87507]: WARNING cinder.quota [None req-64b4d685-20e2-4d78-a247-3dc131f19638 tempest-VolumeRetypeWithoutMigrationTest-1109161946 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 08 06:43:35 devstack cinder-volume[87507]: WARNING cinder.quota [None req-64b4d685-20e2-4d78-a247-3dc131f19638 tempest-VolumeRetypeWithoutMigrationTest-1109161946 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 08 06:43:35 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-64b4d685-20e2-4d78-a247-3dc131f19638 tempest-VolumeRetypeWithoutMigrationTest-1109161946 None] Created reservations ['202cc780-a9f9-488c-a7f0-baa563985200', '81d0107d-b215-4d6b-955a-d9fc12ba344f', '27cb2e0e-ca24-4657-bce4-c1cb474de76f', '035a6940-b05f-4220-8cbc-4c9c38576318'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:43:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-64b4d685-20e2-4d78-a247-3dc131f19638 tempest-VolumeRetypeWithoutMigrationTest-1109161946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:43:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-64b4d685-20e2-4d78-a247-3dc131f19638 tempest-VolumeRetypeWithoutMigrationTest-1109161946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:43:35 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-64b4d685-20e2-4d78-a247-3dc131f19638 tempest-VolumeRetypeWithoutMigrationTest-1109161946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:43:35 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-64b4d685-20e2-4d78-a247-3dc131f19638 tempest-VolumeRetypeWithoutMigrationTest-1109161946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:43:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-64b4d685-20e2-4d78-a247-3dc131f19638 tempest-VolumeRetypeWithoutMigrationTest-1109161946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:43:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-64b4d685-20e2-4d78-a247-3dc131f19638 tempest-VolumeRetypeWithoutMigrationTest-1109161946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:43:35 devstack sudo[89820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:43:35 devstack sudo[89820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:43:36 devstack sudo[89820]: pam_unix(sudo:session): session closed for user root Sep 08 06:43:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-64b4d685-20e2-4d78-a247-3dc131f19638 tempest-VolumeRetypeWithoutMigrationTest-1109161946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.321s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:43:36 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-64b4d685-20e2-4d78-a247-3dc131f19638 tempest-VolumeRetypeWithoutMigrationTest-1109161946 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:43:36 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-64b4d685-20e2-4d78-a247-3dc131f19638 tempest-VolumeRetypeWithoutMigrationTest-1109161946 None] Deleted volume successfully. Sep 08 06:43:36 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-64b4d685-20e2-4d78-a247-3dc131f19638 tempest-VolumeRetypeWithoutMigrationTest-1109161946 None] Lock "cinder-cbf11870-05f8-4360-8383-a084e09db9db-delete_volume" released by "delete_volume" :: held 1.811s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:43:38 devstack cinder-volume[87507]: INFO cinder.volume.manager [req-1324d838-a2d6-416f-a43c-d7f32673eca4 req-ba667306-4247-498c-b26e-4d48fffe1832 tempest-DeleteServersTestJSON-1141285060 None] Terminate volume connection completed successfully. Sep 08 06:43:38 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-1324d838-a2d6-416f-a43c-d7f32673eca4 req-ba667306-4247-498c-b26e-4d48fffe1832 tempest-DeleteServersTestJSON-1141285060 None] Deleting attachment 1d55c23f-c09e-4f3d-a8e5-b53221021df7. {{(pid=87507) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 06:43:39 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-01025eea-9856-4f6e-9f30-8eed4ab469b4 tempest-DeleteServersTestJSON-1141285060 None] Acquiring lock "cinder-445c6ae8-cbeb-4fb8-a697-194b0471ed58-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:43:39 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-01025eea-9856-4f6e-9f30-8eed4ab469b4 tempest-DeleteServersTestJSON-1141285060 None] Lock "cinder-445c6ae8-cbeb-4fb8-a697-194b0471ed58-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:43:39 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-01025eea-9856-4f6e-9f30-8eed4ab469b4 tempest-DeleteServersTestJSON-1141285060 None] Acquiring lock "cinder-quobyte-445c6ae8-cbeb-4fb8-a697-194b0471ed58" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:43:39 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-01025eea-9856-4f6e-9f30-8eed4ab469b4 tempest-DeleteServersTestJSON-1141285060 None] Lock "cinder-quobyte-445c6ae8-cbeb-4fb8-a697-194b0471ed58" acquired by "delete_volume" :: waited 0.022s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:43:39 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb74eed-5328-4ec1-8307-a57fab9973f6]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:43:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-01025eea-9856-4f6e-9f30-8eed4ab469b4 tempest-DeleteServersTestJSON-1141285060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-445c6ae8-cbeb-4fb8-a697-194b0471ed58 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:43:39 devstack sudo[89875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-445c6ae8-cbeb-4fb8-a697-194b0471ed58 Sep 08 06:43:39 devstack sudo[89875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:43:39 devstack sudo[89875]: pam_unix(sudo:session): session closed for user root Sep 08 06:43:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-01025eea-9856-4f6e-9f30-8eed4ab469b4 tempest-DeleteServersTestJSON-1141285060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-445c6ae8-cbeb-4fb8-a697-194b0471ed58" returned: 0 in 0.457s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:43:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-01025eea-9856-4f6e-9f30-8eed4ab469b4 tempest-DeleteServersTestJSON-1141285060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-445c6ae8-cbeb-4fb8-a697-194b0471ed58 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:43:39 devstack sudo[89880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-445c6ae8-cbeb-4fb8-a697-194b0471ed58 Sep 08 06:43:39 devstack sudo[89880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:43:40 devstack sudo[89880]: pam_unix(sudo:session): session closed for user root Sep 08 06:43:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-01025eea-9856-4f6e-9f30-8eed4ab469b4 tempest-DeleteServersTestJSON-1141285060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-445c6ae8-cbeb-4fb8-a697-194b0471ed58" returned: 0 in 0.363s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:43:40 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-01025eea-9856-4f6e-9f30-8eed4ab469b4 tempest-DeleteServersTestJSON-1141285060 None] Lock "cinder-quobyte-445c6ae8-cbeb-4fb8-a697-194b0471ed58" released by "delete_volume" :: held 0.878s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:43:40 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-01025eea-9856-4f6e-9f30-8eed4ab469b4 tempest-DeleteServersTestJSON-1141285060 None] Created reservations ['57cde66e-717f-4e22-8c28-e2d70551d653', 'ab004e44-f706-4e38-96bc-d7432f0800f6', '89f3eafb-960d-483a-81ed-267233130667', 'c5abfef5-425a-492f-a252-6bce57bcaafa'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:43:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-01025eea-9856-4f6e-9f30-8eed4ab469b4 tempest-DeleteServersTestJSON-1141285060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:43:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-01025eea-9856-4f6e-9f30-8eed4ab469b4 tempest-DeleteServersTestJSON-1141285060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:43:40 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-01025eea-9856-4f6e-9f30-8eed4ab469b4 tempest-DeleteServersTestJSON-1141285060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:43:40 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-01025eea-9856-4f6e-9f30-8eed4ab469b4 tempest-DeleteServersTestJSON-1141285060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:43:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-01025eea-9856-4f6e-9f30-8eed4ab469b4 tempest-DeleteServersTestJSON-1141285060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:43:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-01025eea-9856-4f6e-9f30-8eed4ab469b4 tempest-DeleteServersTestJSON-1141285060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:43:40 devstack sudo[89883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:43:40 devstack sudo[89883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:43:41 devstack sudo[89883]: pam_unix(sudo:session): session closed for user root Sep 08 06:43:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-01025eea-9856-4f6e-9f30-8eed4ab469b4 tempest-DeleteServersTestJSON-1141285060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.629s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:43:41 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-01025eea-9856-4f6e-9f30-8eed4ab469b4 tempest-DeleteServersTestJSON-1141285060 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:43:41 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-01025eea-9856-4f6e-9f30-8eed4ab469b4 tempest-DeleteServersTestJSON-1141285060 None] Deleted volume successfully. Sep 08 06:43:41 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-01025eea-9856-4f6e-9f30-8eed4ab469b4 tempest-DeleteServersTestJSON-1141285060 None] Lock "cinder-445c6ae8-cbeb-4fb8-a697-194b0471ed58-delete_volume" released by "delete_volume" :: held 1.828s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:43:44 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-720f09bb-c56f-4bb7-9899-b4b56ad5908b tempest-ServerActionsTestOtherA-1140651778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:43:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-720f09bb-c56f-4bb7-9899-b4b56ad5908b tempest-ServerActionsTestOtherA-1140651778 None] Flow 'volume_create_manager' (55a75bf1-e488-4e69-a1b5-ed4afdbe1933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:43:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-720f09bb-c56f-4bb7-9899-b4b56ad5908b tempest-ServerActionsTestOtherA-1140651778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2af6f339-6064-4ab0-b22d-4bb09224666c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:43:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-720f09bb-c56f-4bb7-9899-b4b56ad5908b tempest-ServerActionsTestOtherA-1140651778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2af6f339-6064-4ab0-b22d-4bb09224666c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:43:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-591507578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=439c9734-e231-45ca-b475-b4a0b57f534b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b002e53583134e8aa8614ce3f689e71c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:43:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:43:44Z,use_quota=True,user_id='51fad9ee2f914a86b41aba71fa7f48aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:43:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-720f09bb-c56f-4bb7-9899-b4b56ad5908b tempest-ServerActionsTestOtherA-1140651778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b05e8fab-ce7b-4012-a670-75363f99a259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:43:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-720f09bb-c56f-4bb7-9899-b4b56ad5908b tempest-ServerActionsTestOtherA-1140651778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b05e8fab-ce7b-4012-a670-75363f99a259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:43:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-720f09bb-c56f-4bb7-9899-b4b56ad5908b tempest-ServerActionsTestOtherA-1140651778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (979a01fc-60e2-4de8-b813-1338a0a33fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:43:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-720f09bb-c56f-4bb7-9899-b4b56ad5908b tempest-ServerActionsTestOtherA-1140651778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (979a01fc-60e2-4de8-b813-1338a0a33fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '439c9734-e231-45ca-b475-b4a0b57f534b', 'volume_name': 'volume-439c9734-e231-45ca-b475-b4a0b57f534b', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:43:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-720f09bb-c56f-4bb7-9899-b4b56ad5908b tempest-ServerActionsTestOtherA-1140651778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d23c201e-715f-45e0-aae0-adfe42493f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:43:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-720f09bb-c56f-4bb7-9899-b4b56ad5908b tempest-ServerActionsTestOtherA-1140651778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d23c201e-715f-45e0-aae0-adfe42493f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:43:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-720f09bb-c56f-4bb7-9899-b4b56ad5908b tempest-ServerActionsTestOtherA-1140651778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9c2cb64-e606-46ce-a32f-87d362605a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:43:44 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-720f09bb-c56f-4bb7-9899-b4b56ad5908b tempest-ServerActionsTestOtherA-1140651778 None] Volume 439c9734-e231-45ca-b475-b4a0b57f534b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-439c9734-e231-45ca-b475-b4a0b57f534b', 'volume_size': 1} Sep 08 06:43:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-720f09bb-c56f-4bb7-9899-b4b56ad5908b tempest-ServerActionsTestOtherA-1140651778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:43:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-720f09bb-c56f-4bb7-9899-b4b56ad5908b tempest-ServerActionsTestOtherA-1140651778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:43:44 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-720f09bb-c56f-4bb7-9899-b4b56ad5908b tempest-ServerActionsTestOtherA-1140651778 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:43:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-591507578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=439c9734-e231-45ca-b475-b4a0b57f534b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b002e53583134e8aa8614ce3f689e71c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:43:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:43:44Z,use_quota=True,user_id='51fad9ee2f914a86b41aba71fa7f48aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:43:44 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-720f09bb-c56f-4bb7-9899-b4b56ad5908b tempest-ServerActionsTestOtherA-1140651778 None] Creating volume 439c9734-e231-45ca-b475-b4a0b57f534b {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:43:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-720f09bb-c56f-4bb7-9899-b4b56ad5908b tempest-ServerActionsTestOtherA-1140651778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:43:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-720f09bb-c56f-4bb7-9899-b4b56ad5908b tempest-ServerActionsTestOtherA-1140651778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:43:44 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-720f09bb-c56f-4bb7-9899-b4b56ad5908b tempest-ServerActionsTestOtherA-1140651778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:43:44 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-720f09bb-c56f-4bb7-9899-b4b56ad5908b tempest-ServerActionsTestOtherA-1140651778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:43:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-720f09bb-c56f-4bb7-9899-b4b56ad5908b tempest-ServerActionsTestOtherA-1140651778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:43:44 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-720f09bb-c56f-4bb7-9899-b4b56ad5908b tempest-ServerActionsTestOtherA-1140651778 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:43:44 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-720f09bb-c56f-4bb7-9899-b4b56ad5908b tempest-ServerActionsTestOtherA-1140651778 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:43:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-720f09bb-c56f-4bb7-9899-b4b56ad5908b tempest-ServerActionsTestOtherA-1140651778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-439c9734-e231-45ca-b475-b4a0b57f534b 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:43:44 devstack sudo[89910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-439c9734-e231-45ca-b475-b4a0b57f534b 1073741824 Sep 08 06:43:44 devstack sudo[89910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:43:45 devstack sudo[89910]: pam_unix(sudo:session): session closed for user root Sep 08 06:43:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-720f09bb-c56f-4bb7-9899-b4b56ad5908b tempest-ServerActionsTestOtherA-1140651778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-439c9734-e231-45ca-b475-b4a0b57f534b 1073741824" returned: 0 in 0.813s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:43:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-720f09bb-c56f-4bb7-9899-b4b56ad5908b tempest-ServerActionsTestOtherA-1140651778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-439c9734-e231-45ca-b475-b4a0b57f534b {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:43:45 devstack sudo[89916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-439c9734-e231-45ca-b475-b4a0b57f534b Sep 08 06:43:45 devstack sudo[89916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:43:45 devstack sudo[89916]: pam_unix(sudo:session): session closed for user root Sep 08 06:43:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-720f09bb-c56f-4bb7-9899-b4b56ad5908b tempest-ServerActionsTestOtherA-1140651778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-439c9734-e231-45ca-b475-b4a0b57f534b" returned: 0 in 0.352s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:43:45 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-720f09bb-c56f-4bb7-9899-b4b56ad5908b tempest-ServerActionsTestOtherA-1140651778 None] <== create_volume: return (1227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:43:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-720f09bb-c56f-4bb7-9899-b4b56ad5908b tempest-ServerActionsTestOtherA-1140651778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.229s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:43:45 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-720f09bb-c56f-4bb7-9899-b4b56ad5908b tempest-ServerActionsTestOtherA-1140651778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9c2cb64-e606-46ce-a32f-87d362605a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-439c9734-e231-45ca-b475-b4a0b57f534b', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:43:45 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-720f09bb-c56f-4bb7-9899-b4b56ad5908b tempest-ServerActionsTestOtherA-1140651778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f798a44-68f0-448f-94d0-a2b112411360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:43:45 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-720f09bb-c56f-4bb7-9899-b4b56ad5908b tempest-ServerActionsTestOtherA-1140651778 None] Volume volume-439c9734-e231-45ca-b475-b4a0b57f534b (439c9734-e231-45ca-b475-b4a0b57f534b): created successfully Sep 08 06:43:45 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-720f09bb-c56f-4bb7-9899-b4b56ad5908b tempest-ServerActionsTestOtherA-1140651778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f798a44-68f0-448f-94d0-a2b112411360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:43:45 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-720f09bb-c56f-4bb7-9899-b4b56ad5908b tempest-ServerActionsTestOtherA-1140651778 None] Flow 'volume_create_manager' (55a75bf1-e488-4e69-a1b5-ed4afdbe1933) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:43:45 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-720f09bb-c56f-4bb7-9899-b4b56ad5908b tempest-ServerActionsTestOtherA-1140651778 None] Created volume successfully. Sep 08 06:43:52 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cd8e18d-8a5d-4a7e-9fae-5b3d1240b360 tempest-VolumeTypesAccessTest-206779982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:43:52 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0cd8e18d-8a5d-4a7e-9fae-5b3d1240b360 tempest-VolumeTypesAccessTest-206779982 None] Flow 'volume_create_manager' (197d82d3-d535-4926-bace-35a1f4b0152b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:43:52 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0cd8e18d-8a5d-4a7e-9fae-5b3d1240b360 tempest-VolumeTypesAccessTest-206779982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59091d84-cc28-460c-994e-5729e31828b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:43:52 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0cd8e18d-8a5d-4a7e-9fae-5b3d1240b360 tempest-VolumeTypesAccessTest-206779982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59091d84-cc28-460c-994e-5729e31828b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:43:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-579594011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d2d266e-1cb3-4a9d-b407-b6da24d65a0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad6f80708d8c463e95ee64d5f3a890eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:43:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:43:52Z,use_quota=True,user_id='ae7519d9693c463e974fcf12e09004dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db088ecd-57bd-46f6-ac80-8502a81028df),volume_type_id=db088ecd-57bd-46f6-ac80-8502a81028df)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:43:52 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0cd8e18d-8a5d-4a7e-9fae-5b3d1240b360 tempest-VolumeTypesAccessTest-206779982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bb934da-1e41-4da5-9770-37c74acbd71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:43:52 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0cd8e18d-8a5d-4a7e-9fae-5b3d1240b360 tempest-VolumeTypesAccessTest-206779982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bb934da-1e41-4da5-9770-37c74acbd71e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:43:52 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0cd8e18d-8a5d-4a7e-9fae-5b3d1240b360 tempest-VolumeTypesAccessTest-206779982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b59f340-5baf-4087-b71c-09b7f0f09a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:43:52 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0cd8e18d-8a5d-4a7e-9fae-5b3d1240b360 tempest-VolumeTypesAccessTest-206779982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b59f340-5baf-4087-b71c-09b7f0f09a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d2d266e-1cb3-4a9d-b407-b6da24d65a0e', 'volume_name': 'volume-1d2d266e-1cb3-4a9d-b407-b6da24d65a0e', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:43:52 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0cd8e18d-8a5d-4a7e-9fae-5b3d1240b360 tempest-VolumeTypesAccessTest-206779982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c10f80fd-0003-4afa-8de1-a3c22e0e5735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:43:52 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0cd8e18d-8a5d-4a7e-9fae-5b3d1240b360 tempest-VolumeTypesAccessTest-206779982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c10f80fd-0003-4afa-8de1-a3c22e0e5735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:43:52 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0cd8e18d-8a5d-4a7e-9fae-5b3d1240b360 tempest-VolumeTypesAccessTest-206779982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e40b3b5b-0a3c-4dac-b74b-fa2346d8cc34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:43:52 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-0cd8e18d-8a5d-4a7e-9fae-5b3d1240b360 tempest-VolumeTypesAccessTest-206779982 None] Volume 1d2d266e-1cb3-4a9d-b407-b6da24d65a0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d2d266e-1cb3-4a9d-b407-b6da24d65a0e', 'volume_size': 1} Sep 08 06:43:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-0cd8e18d-8a5d-4a7e-9fae-5b3d1240b360 tempest-VolumeTypesAccessTest-206779982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:43:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-0cd8e18d-8a5d-4a7e-9fae-5b3d1240b360 tempest-VolumeTypesAccessTest-206779982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:43:52 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-0cd8e18d-8a5d-4a7e-9fae-5b3d1240b360 tempest-VolumeTypesAccessTest-206779982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:43:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-579594011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d2d266e-1cb3-4a9d-b407-b6da24d65a0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad6f80708d8c463e95ee64d5f3a890eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:43:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:43:52Z,use_quota=True,user_id='ae7519d9693c463e974fcf12e09004dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db088ecd-57bd-46f6-ac80-8502a81028df),volume_type_id=db088ecd-57bd-46f6-ac80-8502a81028df)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:43:52 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-0cd8e18d-8a5d-4a7e-9fae-5b3d1240b360 tempest-VolumeTypesAccessTest-206779982 None] Creating volume 1d2d266e-1cb3-4a9d-b407-b6da24d65a0e {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:43:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-0cd8e18d-8a5d-4a7e-9fae-5b3d1240b360 tempest-VolumeTypesAccessTest-206779982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:43:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-0cd8e18d-8a5d-4a7e-9fae-5b3d1240b360 tempest-VolumeTypesAccessTest-206779982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:43:52 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-0cd8e18d-8a5d-4a7e-9fae-5b3d1240b360 tempest-VolumeTypesAccessTest-206779982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:43:52 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-0cd8e18d-8a5d-4a7e-9fae-5b3d1240b360 tempest-VolumeTypesAccessTest-206779982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:43:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-0cd8e18d-8a5d-4a7e-9fae-5b3d1240b360 tempest-VolumeTypesAccessTest-206779982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:43:52 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-0cd8e18d-8a5d-4a7e-9fae-5b3d1240b360 tempest-VolumeTypesAccessTest-206779982 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:43:52 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-0cd8e18d-8a5d-4a7e-9fae-5b3d1240b360 tempest-VolumeTypesAccessTest-206779982 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:43:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0cd8e18d-8a5d-4a7e-9fae-5b3d1240b360 tempest-VolumeTypesAccessTest-206779982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1d2d266e-1cb3-4a9d-b407-b6da24d65a0e 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:43:52 devstack sudo[89944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1d2d266e-1cb3-4a9d-b407-b6da24d65a0e 1073741824 Sep 08 06:43:52 devstack sudo[89944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:43:52 devstack sudo[89944]: pam_unix(sudo:session): session closed for user root Sep 08 06:43:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0cd8e18d-8a5d-4a7e-9fae-5b3d1240b360 tempest-VolumeTypesAccessTest-206779982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1d2d266e-1cb3-4a9d-b407-b6da24d65a0e 1073741824" returned: 0 in 0.662s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:43:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0cd8e18d-8a5d-4a7e-9fae-5b3d1240b360 tempest-VolumeTypesAccessTest-206779982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1d2d266e-1cb3-4a9d-b407-b6da24d65a0e {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:43:53 devstack sudo[89960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1d2d266e-1cb3-4a9d-b407-b6da24d65a0e Sep 08 06:43:53 devstack sudo[89960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:43:53 devstack sudo[89960]: pam_unix(sudo:session): session closed for user root Sep 08 06:43:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0cd8e18d-8a5d-4a7e-9fae-5b3d1240b360 tempest-VolumeTypesAccessTest-206779982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1d2d266e-1cb3-4a9d-b407-b6da24d65a0e" returned: 0 in 0.614s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:43:53 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-0cd8e18d-8a5d-4a7e-9fae-5b3d1240b360 tempest-VolumeTypesAccessTest-206779982 None] <== create_volume: return (1438ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:43:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-0cd8e18d-8a5d-4a7e-9fae-5b3d1240b360 tempest-VolumeTypesAccessTest-206779982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.440s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:43:53 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0cd8e18d-8a5d-4a7e-9fae-5b3d1240b360 tempest-VolumeTypesAccessTest-206779982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e40b3b5b-0a3c-4dac-b74b-fa2346d8cc34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d2d266e-1cb3-4a9d-b407-b6da24d65a0e', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:43:53 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0cd8e18d-8a5d-4a7e-9fae-5b3d1240b360 tempest-VolumeTypesAccessTest-206779982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d99d62e-f6b1-4563-83d9-3c705a77a0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:43:53 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-0cd8e18d-8a5d-4a7e-9fae-5b3d1240b360 tempest-VolumeTypesAccessTest-206779982 None] Volume volume-1d2d266e-1cb3-4a9d-b407-b6da24d65a0e (1d2d266e-1cb3-4a9d-b407-b6da24d65a0e): created successfully Sep 08 06:43:53 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0cd8e18d-8a5d-4a7e-9fae-5b3d1240b360 tempest-VolumeTypesAccessTest-206779982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d99d62e-f6b1-4563-83d9-3c705a77a0f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:43:53 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0cd8e18d-8a5d-4a7e-9fae-5b3d1240b360 tempest-VolumeTypesAccessTest-206779982 None] Flow 'volume_create_manager' (197d82d3-d535-4926-bace-35a1f4b0152b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:43:53 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-0cd8e18d-8a5d-4a7e-9fae-5b3d1240b360 tempest-VolumeTypesAccessTest-206779982 None] Created volume successfully. Sep 08 06:43:54 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-b4455c0a-bf09-49c3-8c49-83a621e7c606 tempest-VolumeTypesAccessTest-206779982 None] Acquiring lock "cinder-1d2d266e-1cb3-4a9d-b407-b6da24d65a0e-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:43:54 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-b4455c0a-bf09-49c3-8c49-83a621e7c606 tempest-VolumeTypesAccessTest-206779982 None] Lock "cinder-1d2d266e-1cb3-4a9d-b407-b6da24d65a0e-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:43:54 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-b4455c0a-bf09-49c3-8c49-83a621e7c606 tempest-VolumeTypesAccessTest-206779982 None] Acquiring lock "cinder-quobyte-1d2d266e-1cb3-4a9d-b407-b6da24d65a0e" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:43:54 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-b4455c0a-bf09-49c3-8c49-83a621e7c606 tempest-VolumeTypesAccessTest-206779982 None] Lock "cinder-quobyte-1d2d266e-1cb3-4a9d-b407-b6da24d65a0e" acquired by "delete_volume" :: waited 0.029s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:43:54 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe3bb3d-79da-4275-82f6-2eb5c4804742]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:43:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b4455c0a-bf09-49c3-8c49-83a621e7c606 tempest-VolumeTypesAccessTest-206779982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1d2d266e-1cb3-4a9d-b407-b6da24d65a0e {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:43:55 devstack sudo[89999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1d2d266e-1cb3-4a9d-b407-b6da24d65a0e Sep 08 06:43:55 devstack sudo[89999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:43:55 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-4436be23-43e6-4280-a559-2546791c163a tempest-AttachVolumeNegativeTest-1461620538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:43:55 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4436be23-43e6-4280-a559-2546791c163a tempest-AttachVolumeNegativeTest-1461620538 None] Flow 'volume_create_manager' (2463c242-a648-410b-b4d3-f1b37ab4b36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:43:55 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4436be23-43e6-4280-a559-2546791c163a tempest-AttachVolumeNegativeTest-1461620538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5160e0a8-673d-431f-be68-7d08826f0040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:43:55 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4436be23-43e6-4280-a559-2546791c163a tempest-AttachVolumeNegativeTest-1461620538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5160e0a8-673d-431f-be68-7d08826f0040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:43:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1610735660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa8592cc-488a-4b2b-9dd5-038385cbe3d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ce0c24857024850a79b0c7619a73fd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:43:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:43:55Z,use_quota=True,user_id='006c16241bf445aaa778b41186274e8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:43:55 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4436be23-43e6-4280-a559-2546791c163a tempest-AttachVolumeNegativeTest-1461620538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77eb4abf-63ab-430e-98cd-d7543a3d0a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:43:55 devstack sudo[89999]: pam_unix(sudo:session): session closed for user root Sep 08 06:43:55 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4436be23-43e6-4280-a559-2546791c163a tempest-AttachVolumeNegativeTest-1461620538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77eb4abf-63ab-430e-98cd-d7543a3d0a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:43:55 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4436be23-43e6-4280-a559-2546791c163a tempest-AttachVolumeNegativeTest-1461620538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07205c61-d124-46bf-a577-dbb4d6245585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:43:55 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4436be23-43e6-4280-a559-2546791c163a tempest-AttachVolumeNegativeTest-1461620538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07205c61-d124-46bf-a577-dbb4d6245585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa8592cc-488a-4b2b-9dd5-038385cbe3d1', 'volume_name': 'volume-aa8592cc-488a-4b2b-9dd5-038385cbe3d1', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:43:55 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4436be23-43e6-4280-a559-2546791c163a tempest-AttachVolumeNegativeTest-1461620538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4c05142-f87a-4236-ba9a-39acd1f21202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:43:55 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4436be23-43e6-4280-a559-2546791c163a tempest-AttachVolumeNegativeTest-1461620538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4c05142-f87a-4236-ba9a-39acd1f21202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:43:55 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4436be23-43e6-4280-a559-2546791c163a tempest-AttachVolumeNegativeTest-1461620538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (661fc9d1-4830-4e00-a329-976e76c3d7a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:43:55 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-4436be23-43e6-4280-a559-2546791c163a tempest-AttachVolumeNegativeTest-1461620538 None] Volume aa8592cc-488a-4b2b-9dd5-038385cbe3d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa8592cc-488a-4b2b-9dd5-038385cbe3d1', 'volume_size': 1} Sep 08 06:43:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4436be23-43e6-4280-a559-2546791c163a tempest-AttachVolumeNegativeTest-1461620538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:43:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4436be23-43e6-4280-a559-2546791c163a tempest-AttachVolumeNegativeTest-1461620538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:43:55 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-4436be23-43e6-4280-a559-2546791c163a tempest-AttachVolumeNegativeTest-1461620538 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:43:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1610735660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa8592cc-488a-4b2b-9dd5-038385cbe3d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ce0c24857024850a79b0c7619a73fd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:43:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:43:55Z,use_quota=True,user_id='006c16241bf445aaa778b41186274e8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:43:55 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-4436be23-43e6-4280-a559-2546791c163a tempest-AttachVolumeNegativeTest-1461620538 None] Creating volume aa8592cc-488a-4b2b-9dd5-038385cbe3d1 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:43:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4436be23-43e6-4280-a559-2546791c163a tempest-AttachVolumeNegativeTest-1461620538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:43:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4436be23-43e6-4280-a559-2546791c163a tempest-AttachVolumeNegativeTest-1461620538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:43:55 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-4436be23-43e6-4280-a559-2546791c163a tempest-AttachVolumeNegativeTest-1461620538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:43:55 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-4436be23-43e6-4280-a559-2546791c163a tempest-AttachVolumeNegativeTest-1461620538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:43:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4436be23-43e6-4280-a559-2546791c163a tempest-AttachVolumeNegativeTest-1461620538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:43:55 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-4436be23-43e6-4280-a559-2546791c163a tempest-AttachVolumeNegativeTest-1461620538 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:43:55 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-4436be23-43e6-4280-a559-2546791c163a tempest-AttachVolumeNegativeTest-1461620538 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:43:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4436be23-43e6-4280-a559-2546791c163a tempest-AttachVolumeNegativeTest-1461620538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-aa8592cc-488a-4b2b-9dd5-038385cbe3d1 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:43:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b4455c0a-bf09-49c3-8c49-83a621e7c606 tempest-VolumeTypesAccessTest-206779982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1d2d266e-1cb3-4a9d-b407-b6da24d65a0e" returned: 0 in 0.839s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:43:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b4455c0a-bf09-49c3-8c49-83a621e7c606 tempest-VolumeTypesAccessTest-206779982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1d2d266e-1cb3-4a9d-b407-b6da24d65a0e {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:43:55 devstack sudo[90006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-aa8592cc-488a-4b2b-9dd5-038385cbe3d1 1073741824 Sep 08 06:43:55 devstack sudo[90006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:43:55 devstack sudo[90007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1d2d266e-1cb3-4a9d-b407-b6da24d65a0e Sep 08 06:43:55 devstack sudo[90007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:43:56 devstack sudo[90007]: pam_unix(sudo:session): session closed for user root Sep 08 06:43:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b4455c0a-bf09-49c3-8c49-83a621e7c606 tempest-VolumeTypesAccessTest-206779982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1d2d266e-1cb3-4a9d-b407-b6da24d65a0e" returned: 0 in 0.478s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:43:56 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-b4455c0a-bf09-49c3-8c49-83a621e7c606 tempest-VolumeTypesAccessTest-206779982 None] Lock "cinder-quobyte-1d2d266e-1cb3-4a9d-b407-b6da24d65a0e" released by "delete_volume" :: held 1.408s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:43:56 devstack cinder-volume[87507]: WARNING cinder.quota [None req-b4455c0a-bf09-49c3-8c49-83a621e7c606 tempest-VolumeTypesAccessTest-206779982 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1542349881 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1542349881, it is now deprecated. Please use the default quota class for default quota. Sep 08 06:43:56 devstack cinder-volume[87507]: WARNING cinder.quota [None req-b4455c0a-bf09-49c3-8c49-83a621e7c606 tempest-VolumeTypesAccessTest-206779982 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1542349881 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1542349881, it is now deprecated. Please use the default quota class for default quota. Sep 08 06:43:56 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-b4455c0a-bf09-49c3-8c49-83a621e7c606 tempest-VolumeTypesAccessTest-206779982 None] Created reservations ['72bb82dc-ee62-427c-a6a9-1aa7c7b10c11', 'fb27c9d2-89e5-4229-9870-d49e9417d5a4', '262259d3-dd88-4d41-8b0d-7c0e269e1e6e', 'c4836895-2c71-430d-9a88-e6b80e96b1a8'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:43:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b4455c0a-bf09-49c3-8c49-83a621e7c606 tempest-VolumeTypesAccessTest-206779982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:43:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b4455c0a-bf09-49c3-8c49-83a621e7c606 tempest-VolumeTypesAccessTest-206779982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:43:56 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-b4455c0a-bf09-49c3-8c49-83a621e7c606 tempest-VolumeTypesAccessTest-206779982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:43:56 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-b4455c0a-bf09-49c3-8c49-83a621e7c606 tempest-VolumeTypesAccessTest-206779982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:43:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b4455c0a-bf09-49c3-8c49-83a621e7c606 tempest-VolumeTypesAccessTest-206779982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:43:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b4455c0a-bf09-49c3-8c49-83a621e7c606 tempest-VolumeTypesAccessTest-206779982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:43:56 devstack sudo[90016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:43:56 devstack sudo[90016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:43:56 devstack sudo[90006]: pam_unix(sudo:session): session closed for user root Sep 08 06:43:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4436be23-43e6-4280-a559-2546791c163a tempest-AttachVolumeNegativeTest-1461620538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-aa8592cc-488a-4b2b-9dd5-038385cbe3d1 1073741824" returned: 0 in 0.933s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:43:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4436be23-43e6-4280-a559-2546791c163a tempest-AttachVolumeNegativeTest-1461620538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-aa8592cc-488a-4b2b-9dd5-038385cbe3d1 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:43:56 devstack sudo[90018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-aa8592cc-488a-4b2b-9dd5-038385cbe3d1 Sep 08 06:43:56 devstack sudo[90018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:43:57 devstack sudo[90018]: pam_unix(sudo:session): session closed for user root Sep 08 06:43:57 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4436be23-43e6-4280-a559-2546791c163a tempest-AttachVolumeNegativeTest-1461620538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-aa8592cc-488a-4b2b-9dd5-038385cbe3d1" returned: 0 in 0.360s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:43:57 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-4436be23-43e6-4280-a559-2546791c163a tempest-AttachVolumeNegativeTest-1461620538 None] <== create_volume: return (1369ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:43:57 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4436be23-43e6-4280-a559-2546791c163a tempest-AttachVolumeNegativeTest-1461620538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.372s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:43:57 devstack sudo[90016]: pam_unix(sudo:session): session closed for user root Sep 08 06:43:57 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b4455c0a-bf09-49c3-8c49-83a621e7c606 tempest-VolumeTypesAccessTest-206779982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.513s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:43:57 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-b4455c0a-bf09-49c3-8c49-83a621e7c606 tempest-VolumeTypesAccessTest-206779982 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:43:57 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-b4455c0a-bf09-49c3-8c49-83a621e7c606 tempest-VolumeTypesAccessTest-206779982 None] Deleted volume successfully. Sep 08 06:43:57 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4436be23-43e6-4280-a559-2546791c163a tempest-AttachVolumeNegativeTest-1461620538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (661fc9d1-4830-4e00-a329-976e76c3d7a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa8592cc-488a-4b2b-9dd5-038385cbe3d1', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:43:57 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4436be23-43e6-4280-a559-2546791c163a tempest-AttachVolumeNegativeTest-1461620538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2025a3bb-03ed-4ea6-b832-40cebcde10d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:43:57 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-4436be23-43e6-4280-a559-2546791c163a tempest-AttachVolumeNegativeTest-1461620538 None] Volume volume-aa8592cc-488a-4b2b-9dd5-038385cbe3d1 (aa8592cc-488a-4b2b-9dd5-038385cbe3d1): created successfully Sep 08 06:43:57 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4436be23-43e6-4280-a559-2546791c163a tempest-AttachVolumeNegativeTest-1461620538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2025a3bb-03ed-4ea6-b832-40cebcde10d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:43:57 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4436be23-43e6-4280-a559-2546791c163a tempest-AttachVolumeNegativeTest-1461620538 None] Flow 'volume_create_manager' (2463c242-a648-410b-b4d3-f1b37ab4b36d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:43:57 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-b4455c0a-bf09-49c3-8c49-83a621e7c606 tempest-VolumeTypesAccessTest-206779982 None] Lock "cinder-1d2d266e-1cb3-4a9d-b407-b6da24d65a0e-delete_volume" released by "delete_volume" :: held 2.476s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:43:57 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-4436be23-43e6-4280-a559-2546791c163a tempest-AttachVolumeNegativeTest-1461620538 None] Created volume successfully. Sep 08 06:43:59 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-3aeedd9c-9b26-4482-b0fc-899db46a094a req-16959e72-6af8-47c4-a07e-16637e31c0a0 tempest-AttachVolumeNegativeTest-1461620538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:43:59 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-3aeedd9c-9b26-4482-b0fc-899db46a094a req-16959e72-6af8-47c4-a07e-16637e31c0a0 tempest-AttachVolumeNegativeTest-1461620538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:43:59 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-3aeedd9c-9b26-4482-b0fc-899db46a094a req-16959e72-6af8-47c4-a07e-16637e31c0a0 tempest-AttachVolumeNegativeTest-1461620538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:43:59 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-3aeedd9c-9b26-4482-b0fc-899db46a094a req-16959e72-6af8-47c4-a07e-16637e31c0a0 tempest-AttachVolumeNegativeTest-1461620538 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d', 'name': 'volume-aa8592cc-488a-4b2b-9dd5-038385cbe3d1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9f097bd1-4cc7-4bf0-ac0c-10ac7fe7ca66', 'enforce_multipath': True} {{(pid=87507) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 06:43:59 devstack cinder-volume[87507]: INFO cinder.volume.manager [req-3aeedd9c-9b26-4482-b0fc-899db46a094a req-16959e72-6af8-47c4-a07e-16637e31c0a0 tempest-AttachVolumeNegativeTest-1461620538 None] attachment_update completed successfully. Sep 08 06:44:09 devstack cinder-volume[87507]: DEBUG dbcounter [-] [87507] Writing DB stats cinder:UPDATE=48,cinder:SELECT=45,cinder:DELETE=4,cinder:INSERT=6 {{(pid=87507) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 06:44:09 devstack cinder-volume[87507]: DEBUG dbcounter [-] [87507] Writing DB stats cinder:SELECT=47,cinder:UPDATE=45,cinder:INSERT=11,cinder:DELETE=4 {{(pid=87507) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 06:44:19 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-08713354-dc6b-4a8b-9140-6e4501d287ac tempest-TaggedAttachmentsTest-1974514162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:44:19 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-08713354-dc6b-4a8b-9140-6e4501d287ac tempest-TaggedAttachmentsTest-1974514162 None] Flow 'volume_create_manager' (659d476b-69a2-4b1a-b0f2-223cd4e9731a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:44:19 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-08713354-dc6b-4a8b-9140-6e4501d287ac tempest-TaggedAttachmentsTest-1974514162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6744f20a-b473-4953-b9d5-e7384576e4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:44:19 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-08713354-dc6b-4a8b-9140-6e4501d287ac tempest-TaggedAttachmentsTest-1974514162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6744f20a-b473-4953-b9d5-e7384576e4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:44:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1534023145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a50711e2-6cb8-4633-b27d-e3c8139aac33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88be6eba3e714aa8862bb38f162a7edb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:44:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:44:19Z,use_quota=True,user_id='9c0b76aad7bb41048969afec5799a611',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:44:19 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-08713354-dc6b-4a8b-9140-6e4501d287ac tempest-TaggedAttachmentsTest-1974514162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e16c867-84f7-4dfa-9504-55ad3fd198d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:44:19 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-08713354-dc6b-4a8b-9140-6e4501d287ac tempest-TaggedAttachmentsTest-1974514162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e16c867-84f7-4dfa-9504-55ad3fd198d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:44:19 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-08713354-dc6b-4a8b-9140-6e4501d287ac tempest-TaggedAttachmentsTest-1974514162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bb50375-e48e-4637-852c-1aad2505b60b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:44:19 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-08713354-dc6b-4a8b-9140-6e4501d287ac tempest-TaggedAttachmentsTest-1974514162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bb50375-e48e-4637-852c-1aad2505b60b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a50711e2-6cb8-4633-b27d-e3c8139aac33', 'volume_name': 'volume-a50711e2-6cb8-4633-b27d-e3c8139aac33', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:44:19 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-08713354-dc6b-4a8b-9140-6e4501d287ac tempest-TaggedAttachmentsTest-1974514162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc11fa01-9f7c-4c7b-98eb-f51999bddbc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:44:19 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-08713354-dc6b-4a8b-9140-6e4501d287ac tempest-TaggedAttachmentsTest-1974514162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc11fa01-9f7c-4c7b-98eb-f51999bddbc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:44:19 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-08713354-dc6b-4a8b-9140-6e4501d287ac tempest-TaggedAttachmentsTest-1974514162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3200f3e-126f-497f-9d62-8f2815875543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:44:19 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-08713354-dc6b-4a8b-9140-6e4501d287ac tempest-TaggedAttachmentsTest-1974514162 None] Volume a50711e2-6cb8-4633-b27d-e3c8139aac33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a50711e2-6cb8-4633-b27d-e3c8139aac33', 'volume_size': 1} Sep 08 06:44:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-08713354-dc6b-4a8b-9140-6e4501d287ac tempest-TaggedAttachmentsTest-1974514162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:44:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-08713354-dc6b-4a8b-9140-6e4501d287ac tempest-TaggedAttachmentsTest-1974514162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:44:19 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-08713354-dc6b-4a8b-9140-6e4501d287ac tempest-TaggedAttachmentsTest-1974514162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:44:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1534023145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a50711e2-6cb8-4633-b27d-e3c8139aac33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88be6eba3e714aa8862bb38f162a7edb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:44:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:44:19Z,use_quota=True,user_id='9c0b76aad7bb41048969afec5799a611',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:44:19 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-08713354-dc6b-4a8b-9140-6e4501d287ac tempest-TaggedAttachmentsTest-1974514162 None] Creating volume a50711e2-6cb8-4633-b27d-e3c8139aac33 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:44:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-08713354-dc6b-4a8b-9140-6e4501d287ac tempest-TaggedAttachmentsTest-1974514162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:44:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-08713354-dc6b-4a8b-9140-6e4501d287ac tempest-TaggedAttachmentsTest-1974514162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:44:19 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-08713354-dc6b-4a8b-9140-6e4501d287ac tempest-TaggedAttachmentsTest-1974514162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:44:19 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-08713354-dc6b-4a8b-9140-6e4501d287ac tempest-TaggedAttachmentsTest-1974514162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:44:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-08713354-dc6b-4a8b-9140-6e4501d287ac tempest-TaggedAttachmentsTest-1974514162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:44:19 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-08713354-dc6b-4a8b-9140-6e4501d287ac tempest-TaggedAttachmentsTest-1974514162 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:44:19 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-08713354-dc6b-4a8b-9140-6e4501d287ac tempest-TaggedAttachmentsTest-1974514162 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:44:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-08713354-dc6b-4a8b-9140-6e4501d287ac tempest-TaggedAttachmentsTest-1974514162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a50711e2-6cb8-4633-b27d-e3c8139aac33 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:44:19 devstack sudo[90573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a50711e2-6cb8-4633-b27d-e3c8139aac33 1073741824 Sep 08 06:44:19 devstack sudo[90573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:44:20 devstack cinder-volume[87507]: DEBUG oslo_service.periodic_task [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87507) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 06:44:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:44:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:44:20 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:44:20 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:44:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:44:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:44:20 devstack sudo[90578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:44:20 devstack sudo[90578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:44:20 devstack sudo[90573]: pam_unix(sudo:session): session closed for user root Sep 08 06:44:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-08713354-dc6b-4a8b-9140-6e4501d287ac tempest-TaggedAttachmentsTest-1974514162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a50711e2-6cb8-4633-b27d-e3c8139aac33 1073741824" returned: 0 in 0.587s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:44:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-08713354-dc6b-4a8b-9140-6e4501d287ac tempest-TaggedAttachmentsTest-1974514162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a50711e2-6cb8-4633-b27d-e3c8139aac33 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:44:20 devstack sudo[90606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a50711e2-6cb8-4633-b27d-e3c8139aac33 Sep 08 06:44:20 devstack sudo[90606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:44:20 devstack sudo[90578]: pam_unix(sudo:session): session closed for user root Sep 08 06:44:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.457s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:44:20 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:44:20 devstack cinder-volume[87507]: DEBUG oslo_service.periodic_task [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Running periodic task VolumeManager._thread_info {{(pid=87507) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 06:44:20 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] thread count: 8 {{(pid=87507) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 06:44:20 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] thread info: [<_MainThread(MainThread, started 127913129345152)>, , , , , , , ] {{(pid=87507) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 06:44:20 devstack sudo[90606]: pam_unix(sudo:session): session closed for user root Sep 08 06:44:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-08713354-dc6b-4a8b-9140-6e4501d287ac tempest-TaggedAttachmentsTest-1974514162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a50711e2-6cb8-4633-b27d-e3c8139aac33" returned: 0 in 0.318s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:44:20 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-08713354-dc6b-4a8b-9140-6e4501d287ac tempest-TaggedAttachmentsTest-1974514162 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:44:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-08713354-dc6b-4a8b-9140-6e4501d287ac tempest-TaggedAttachmentsTest-1974514162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:44:20 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-08713354-dc6b-4a8b-9140-6e4501d287ac tempest-TaggedAttachmentsTest-1974514162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3200f3e-126f-497f-9d62-8f2815875543) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a50711e2-6cb8-4633-b27d-e3c8139aac33', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:44:20 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-08713354-dc6b-4a8b-9140-6e4501d287ac tempest-TaggedAttachmentsTest-1974514162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28d724e1-35bd-4d5e-a501-118f8c0506a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:44:20 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-08713354-dc6b-4a8b-9140-6e4501d287ac tempest-TaggedAttachmentsTest-1974514162 None] Volume volume-a50711e2-6cb8-4633-b27d-e3c8139aac33 (a50711e2-6cb8-4633-b27d-e3c8139aac33): created successfully Sep 08 06:44:20 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-08713354-dc6b-4a8b-9140-6e4501d287ac tempest-TaggedAttachmentsTest-1974514162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28d724e1-35bd-4d5e-a501-118f8c0506a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:44:20 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-08713354-dc6b-4a8b-9140-6e4501d287ac tempest-TaggedAttachmentsTest-1974514162 None] Flow 'volume_create_manager' (659d476b-69a2-4b1a-b0f2-223cd4e9731a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:44:20 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-08713354-dc6b-4a8b-9140-6e4501d287ac tempest-TaggedAttachmentsTest-1974514162 None] Created volume successfully. Sep 08 06:44:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-46b5f36a-27a2-4f7f-ad2b-3230dcb90f73 req-763d45fc-0c78-4a82-8a51-fbdec18f0a67 tempest-ServerActionsTestOtherA-1140651778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:44:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-46b5f36a-27a2-4f7f-ad2b-3230dcb90f73 req-763d45fc-0c78-4a82-8a51-fbdec18f0a67 tempest-ServerActionsTestOtherA-1140651778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:44:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-46b5f36a-27a2-4f7f-ad2b-3230dcb90f73 req-763d45fc-0c78-4a82-8a51-fbdec18f0a67 tempest-ServerActionsTestOtherA-1140651778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:44:25 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-46b5f36a-27a2-4f7f-ad2b-3230dcb90f73 req-763d45fc-0c78-4a82-8a51-fbdec18f0a67 tempest-ServerActionsTestOtherA-1140651778 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d', 'name': 'volume-439c9734-e231-45ca-b475-b4a0b57f534b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6ad43436-3240-4a73-b3e8-0a262679cf74', 'enforce_multipath': True} {{(pid=87507) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 06:44:25 devstack cinder-volume[87507]: INFO cinder.volume.manager [req-46b5f36a-27a2-4f7f-ad2b-3230dcb90f73 req-763d45fc-0c78-4a82-8a51-fbdec18f0a67 tempest-ServerActionsTestOtherA-1140651778 None] attachment_update completed successfully. Sep 08 06:44:30 devstack cinder-volume[87507]: INFO cinder.volume.manager [req-c4f35b85-ff89-40ad-85b6-af688f926353 req-c3b1b810-6d39-46c8-ba7c-d49c744cc8c7 tempest-ServerActionsTestOtherA-1140651778 None] Terminate volume connection completed successfully. Sep 08 06:44:30 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-c4f35b85-ff89-40ad-85b6-af688f926353 req-c3b1b810-6d39-46c8-ba7c-d49c744cc8c7 tempest-ServerActionsTestOtherA-1140651778 None] Deleting attachment 6ad43436-3240-4a73-b3e8-0a262679cf74. {{(pid=87507) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 06:44:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-c4f35b85-ff89-40ad-85b6-af688f926353 req-077246de-e9d8-4ac0-9de2-8e71ad72ac0a tempest-ServerActionsTestOtherA-1140651778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:44:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-c4f35b85-ff89-40ad-85b6-af688f926353 req-077246de-e9d8-4ac0-9de2-8e71ad72ac0a tempest-ServerActionsTestOtherA-1140651778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:44:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-c4f35b85-ff89-40ad-85b6-af688f926353 req-077246de-e9d8-4ac0-9de2-8e71ad72ac0a tempest-ServerActionsTestOtherA-1140651778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:44:31 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-c4f35b85-ff89-40ad-85b6-af688f926353 req-077246de-e9d8-4ac0-9de2-8e71ad72ac0a tempest-ServerActionsTestOtherA-1140651778 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d', 'name': 'volume-439c9734-e231-45ca-b475-b4a0b57f534b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '319cb1dc-5fad-44a2-8afb-e681749dfea8', 'enforce_multipath': True} {{(pid=87507) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 06:44:31 devstack cinder-volume[87507]: INFO cinder.volume.manager [req-c4f35b85-ff89-40ad-85b6-af688f926353 req-077246de-e9d8-4ac0-9de2-8e71ad72ac0a tempest-ServerActionsTestOtherA-1140651778 None] attachment_update completed successfully. Sep 08 06:44:41 devstack cinder-volume[87507]: DEBUG dbcounter [-] [87507] Writing DB stats cinder:SELECT=15,cinder:UPDATE=5,cinder:INSERT=1 {{(pid=87507) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 06:44:41 devstack cinder-volume[87507]: DEBUG dbcounter [-] [87507] Writing DB stats cinder:SELECT=17,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=87507) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 06:44:44 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-bce84be6-6fe0-4240-bca3-748c9a2f81b2 tempest-VolumesImageMetadata-1989026910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:44:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-bce84be6-6fe0-4240-bca3-748c9a2f81b2 tempest-VolumesImageMetadata-1989026910 None] Flow 'volume_create_manager' (9dd9a413-57f9-4402-bc30-291fb3c03db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:44:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-bce84be6-6fe0-4240-bca3-748c9a2f81b2 tempest-VolumesImageMetadata-1989026910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c61795b4-07c9-47b5-bbda-82c2e485603c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:44:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-bce84be6-6fe0-4240-bca3-748c9a2f81b2 tempest-VolumesImageMetadata-1989026910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c61795b4-07c9-47b5-bbda-82c2e485603c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:44:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1473614762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23c9dc6d-25d3-4f62-b79c-b378d8d442b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e29aaba94f324c1e9481e2560593a001',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:44:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:44:44Z,use_quota=True,user_id='ce9465b29a284802bf8f2c585ca79bbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:44:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-bce84be6-6fe0-4240-bca3-748c9a2f81b2 tempest-VolumesImageMetadata-1989026910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f4794b0-3312-4fd3-a9f6-9bdeb29fa1ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:44:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-bce84be6-6fe0-4240-bca3-748c9a2f81b2 tempest-VolumesImageMetadata-1989026910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f4794b0-3312-4fd3-a9f6-9bdeb29fa1ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:44:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-bce84be6-6fe0-4240-bca3-748c9a2f81b2 tempest-VolumesImageMetadata-1989026910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deba2a8e-cb26-47b8-9508-75146f29a0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:44:44 devstack cinder-volume[87507]: DEBUG cinder.image.glance [None req-bce84be6-6fe0-4240-bca3-748c9a2f81b2 tempest-VolumesImageMetadata-1989026910 None] Creating Keystone auth plugin from conf {{(pid=87507) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 08 06:44:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-bce84be6-6fe0-4240-bca3-748c9a2f81b2 tempest-VolumesImageMetadata-1989026910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deba2a8e-cb26-47b8-9508-75146f29a0c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '23c9dc6d-25d3-4f62-b79c-b378d8d442b9', 'volume_name': 'volume-23c9dc6d-25d3-4f62-b79c-b378d8d442b9', 'volume_size': 1, 'image_id': '69da6bac-8b7b-48c5-af3b-29466563452a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/69da6bac-8b7b-48c5-af3b-29466563452a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '95d2d5dbb3e04d74b8da31fc6ee47f98', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '69da6bac-8b7b-48c5-af3b-29466563452a', 'created_at': datetime.datetime(2026, 9, 8, 4, 36, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 4, 36, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/69da6bac-8b7b-48c5-af3b-29466563452a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:44:45 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-bce84be6-6fe0-4240-bca3-748c9a2f81b2 tempest-VolumesImageMetadata-1989026910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3675584d-4fb2-4574-b932-f1f0f0dc3728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:44:45 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-bce84be6-6fe0-4240-bca3-748c9a2f81b2 tempest-VolumesImageMetadata-1989026910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3675584d-4fb2-4574-b932-f1f0f0dc3728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:44:45 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-bce84be6-6fe0-4240-bca3-748c9a2f81b2 tempest-VolumesImageMetadata-1989026910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c763505-8c64-4897-aed3-65f8dce631aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:44:45 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-bce84be6-6fe0-4240-bca3-748c9a2f81b2 tempest-VolumesImageMetadata-1989026910 None] Volume 23c9dc6d-25d3-4f62-b79c-b378d8d442b9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-23c9dc6d-25d3-4f62-b79c-b378d8d442b9', 'volume_size': 1, 'image_id': '69da6bac-8b7b-48c5-af3b-29466563452a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/69da6bac-8b7b-48c5-af3b-29466563452a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '95d2d5dbb3e04d74b8da31fc6ee47f98', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '69da6bac-8b7b-48c5-af3b-29466563452a', 'created_at': datetime.datetime(2026, 9, 8, 4, 36, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 4, 36, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/69da6bac-8b7b-48c5-af3b-29466563452a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 08 06:44:45 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-bce84be6-6fe0-4240-bca3-748c9a2f81b2 tempest-VolumesImageMetadata-1989026910 None] Trying to clone 23c9dc6d-25d3-4f62-b79c-b378d8d442b9 from image 69da6bac-8b7b-48c5-af3b-29466563452a at location (None, [{'url': 'file:///opt/stack/data/glance/images/69da6bac-8b7b-48c5-af3b-29466563452a', 'metadata': {}}]). {{(pid=87507) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 08 06:44:45 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-bce84be6-6fe0-4240-bca3-748c9a2f81b2 tempest-VolumesImageMetadata-1989026910 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_pacthu9bdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87507) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 08 06:44:45 devstack cinder-volume[87507]: INFO cinder.image.image_utils [None req-bce84be6-6fe0-4240-bca3-748c9a2f81b2 tempest-VolumesImageMetadata-1989026910 None] Image download 20.69 MB at 20.69 MB/s Sep 08 06:44:45 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f8b74e-2baa-4716-b45a-efe0656924fa]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:44:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bce84be6-6fe0-4240-bca3-748c9a2f81b2 tempest-VolumesImageMetadata-1989026910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_pacthu9bdevstack@QuobyteHD {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:44:45 devstack sudo[90918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_pacthu9bdevstack@QuobyteHD Sep 08 06:44:45 devstack sudo[90918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:44:46 devstack sudo[90918]: pam_unix(sudo:session): session closed for user root Sep 08 06:44:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bce84be6-6fe0-4240-bca3-748c9a2f81b2 tempest-VolumesImageMetadata-1989026910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_pacthu9bdevstack@QuobyteHD" returned: 0 in 0.536s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:44:46 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-bce84be6-6fe0-4240-bca3-748c9a2f81b2 tempest-VolumesImageMetadata-1989026910 None] Temporary image 69da6bac-8b7b-48c5-af3b-29466563452a is fetched for user ce9465b29a284802bf8f2c585ca79bbd. {{(pid=87507) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 08 06:44:46 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9a6a3c-9c7e-4ad2-bd6f-eb24c4e15091]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:44:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bce84be6-6fe0-4240-bca3-748c9a2f81b2 tempest-VolumesImageMetadata-1989026910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_pacthu9bdevstack@QuobyteHD {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:44:46 devstack sudo[90924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_pacthu9bdevstack@QuobyteHD Sep 08 06:44:46 devstack sudo[90924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:44:46 devstack sudo[90924]: pam_unix(sudo:session): session closed for user root Sep 08 06:44:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bce84be6-6fe0-4240-bca3-748c9a2f81b2 tempest-VolumesImageMetadata-1989026910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_pacthu9bdevstack@QuobyteHD" returned: 0 in 0.437s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:44:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-bce84be6-6fe0-4240-bca3-748c9a2f81b2 tempest-VolumesImageMetadata-1989026910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:44:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-bce84be6-6fe0-4240-bca3-748c9a2f81b2 tempest-VolumesImageMetadata-1989026910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:44:46 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-bce84be6-6fe0-4240-bca3-748c9a2f81b2 tempest-VolumesImageMetadata-1989026910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:44:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1473614762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23c9dc6d-25d3-4f62-b79c-b378d8d442b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e29aaba94f324c1e9481e2560593a001',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:44:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:44:44Z,use_quota=True,user_id='ce9465b29a284802bf8f2c585ca79bbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:44:46 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-bce84be6-6fe0-4240-bca3-748c9a2f81b2 tempest-VolumesImageMetadata-1989026910 None] Creating volume 23c9dc6d-25d3-4f62-b79c-b378d8d442b9 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:44:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-bce84be6-6fe0-4240-bca3-748c9a2f81b2 tempest-VolumesImageMetadata-1989026910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:44:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-bce84be6-6fe0-4240-bca3-748c9a2f81b2 tempest-VolumesImageMetadata-1989026910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:44:46 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-bce84be6-6fe0-4240-bca3-748c9a2f81b2 tempest-VolumesImageMetadata-1989026910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:44:46 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-bce84be6-6fe0-4240-bca3-748c9a2f81b2 tempest-VolumesImageMetadata-1989026910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:44:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-bce84be6-6fe0-4240-bca3-748c9a2f81b2 tempest-VolumesImageMetadata-1989026910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:44:46 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-bce84be6-6fe0-4240-bca3-748c9a2f81b2 tempest-VolumesImageMetadata-1989026910 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:44:46 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-bce84be6-6fe0-4240-bca3-748c9a2f81b2 tempest-VolumesImageMetadata-1989026910 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:44:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bce84be6-6fe0-4240-bca3-748c9a2f81b2 tempest-VolumesImageMetadata-1989026910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-23c9dc6d-25d3-4f62-b79c-b378d8d442b9 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:44:46 devstack sudo[90929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-23c9dc6d-25d3-4f62-b79c-b378d8d442b9 1073741824 Sep 08 06:44:46 devstack sudo[90929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:44:47 devstack sudo[90929]: pam_unix(sudo:session): session closed for user root Sep 08 06:44:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bce84be6-6fe0-4240-bca3-748c9a2f81b2 tempest-VolumesImageMetadata-1989026910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-23c9dc6d-25d3-4f62-b79c-b378d8d442b9 1073741824" returned: 0 in 0.631s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:44:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bce84be6-6fe0-4240-bca3-748c9a2f81b2 tempest-VolumesImageMetadata-1989026910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-23c9dc6d-25d3-4f62-b79c-b378d8d442b9 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:44:47 devstack sudo[90935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-23c9dc6d-25d3-4f62-b79c-b378d8d442b9 Sep 08 06:44:47 devstack sudo[90935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:44:47 devstack sudo[90935]: pam_unix(sudo:session): session closed for user root Sep 08 06:44:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bce84be6-6fe0-4240-bca3-748c9a2f81b2 tempest-VolumesImageMetadata-1989026910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-23c9dc6d-25d3-4f62-b79c-b378d8d442b9" returned: 0 in 0.285s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:44:47 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-bce84be6-6fe0-4240-bca3-748c9a2f81b2 tempest-VolumesImageMetadata-1989026910 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:44:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-bce84be6-6fe0-4240-bca3-748c9a2f81b2 tempest-VolumesImageMetadata-1989026910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:44:47 devstack cinder-volume[87507]: DEBUG cinder.volume.volume_utils [None req-bce84be6-6fe0-4240-bca3-748c9a2f81b2 tempest-VolumesImageMetadata-1989026910 None] Attempting download of 69da6bac-8b7b-48c5-af3b-29466563452a ((None, [{'url': 'file:///opt/stack/data/glance/images/69da6bac-8b7b-48c5-af3b-29466563452a', 'metadata': {}}])) to volume 23c9dc6d-25d3-4f62-b79c-b378d8d442b9. {{(pid=87507) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 08 06:44:47 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d5eaad-a155-4902-97d8-3444ac1b3fad]: (4, 'raw') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:44:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bce84be6-6fe0-4240-bca3-748c9a2f81b2 tempest-VolumesImageMetadata-1989026910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_69da6bac-8b7b-48c5-af3b-29466563452a_rfa750fe {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:44:48 devstack sudo[90938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_69da6bac-8b7b-48c5-af3b-29466563452a_rfa750fe Sep 08 06:44:48 devstack sudo[90938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:44:48 devstack sudo[90938]: pam_unix(sudo:session): session closed for user root Sep 08 06:44:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bce84be6-6fe0-4240-bca3-748c9a2f81b2 tempest-VolumesImageMetadata-1989026910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_69da6bac-8b7b-48c5-af3b-29466563452a_rfa750fe" returned: 0 in 0.410s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:44:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bce84be6-6fe0-4240-bca3-748c9a2f81b2 tempest-VolumesImageMetadata-1989026910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_69da6bac-8b7b-48c5-af3b-29466563452a_rfa750fe {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:44:48 devstack sudo[90943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_69da6bac-8b7b-48c5-af3b-29466563452a_rfa750fe Sep 08 06:44:48 devstack sudo[90943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:44:48 devstack sudo[90943]: pam_unix(sudo:session): session closed for user root Sep 08 06:44:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bce84be6-6fe0-4240-bca3-748c9a2f81b2 tempest-VolumesImageMetadata-1989026910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_69da6bac-8b7b-48c5-af3b-29466563452a_rfa750fe" returned: 1 in 0.495s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:44:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bce84be6-6fe0-4240-bca3-748c9a2f81b2 tempest-VolumesImageMetadata-1989026910 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_69da6bac-8b7b-48c5-af3b-29466563452a_rfa750fe' failed. Not Retrying. {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 06:44:48 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[992e925c-667e-47ff-9078-fb8f2f670873]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:44:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bce84be6-6fe0-4240-bca3-748c9a2f81b2 tempest-VolumesImageMetadata-1989026910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_pacthu9bdevstack@QuobyteHD {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:44:48 devstack sudo[90948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_pacthu9bdevstack@QuobyteHD Sep 08 06:44:48 devstack sudo[90948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:44:49 devstack cinder-volume[87507]: INFO cinder.volume.manager [req-82b37c26-fc9c-4c90-9bd7-f9a5c68e64a7 req-2405bd65-e50a-49e2-ab5f-d229ac653317 tempest-AttachVolumeNegativeTest-1461620538 None] Terminate volume connection completed successfully. Sep 08 06:44:49 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-82b37c26-fc9c-4c90-9bd7-f9a5c68e64a7 req-2405bd65-e50a-49e2-ab5f-d229ac653317 tempest-AttachVolumeNegativeTest-1461620538 None] Deleting attachment 9f097bd1-4cc7-4bf0-ac0c-10ac7fe7ca66. {{(pid=87507) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 06:44:49 devstack sudo[90948]: pam_unix(sudo:session): session closed for user root Sep 08 06:44:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bce84be6-6fe0-4240-bca3-748c9a2f81b2 tempest-VolumesImageMetadata-1989026910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_pacthu9bdevstack@QuobyteHD" returned: 0 in 0.360s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:44:49 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-bce84be6-6fe0-4240-bca3-748c9a2f81b2 tempest-VolumesImageMetadata-1989026910 None] 69da6bac-8b7b-48c5-af3b-29466563452a was qcow2, converting to qcow2 {{(pid=87507) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 08 06:44:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bce84be6-6fe0-4240-bca3-748c9a2f81b2 tempest-VolumesImageMetadata-1989026910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_pacthu9bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-23c9dc6d-25d3-4f62-b79c-b378d8d442b9 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:44:49 devstack sudo[90956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_pacthu9bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-23c9dc6d-25d3-4f62-b79c-b378d8d442b9 Sep 08 06:44:49 devstack sudo[90956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:44:51 devstack sudo[90956]: pam_unix(sudo:session): session closed for user root Sep 08 06:44:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bce84be6-6fe0-4240-bca3-748c9a2f81b2 tempest-VolumesImageMetadata-1989026910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_pacthu9bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-23c9dc6d-25d3-4f62-b79c-b378d8d442b9" returned: 0 in 2.469s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:44:51 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-bce84be6-6fe0-4240-bca3-748c9a2f81b2 tempest-VolumesImageMetadata-1989026910 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_pacthu9bdevstack@QuobyteHD, size 112.00 MB, duration 2.47 sec, destination /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-23c9dc6d-25d3-4f62-b79c-b378d8d442b9 {{(pid=87507) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 06:44:51 devstack cinder-volume[87507]: INFO cinder.image.image_utils [None req-bce84be6-6fe0-4240-bca3-748c9a2f81b2 tempest-VolumesImageMetadata-1989026910 None] Converted 112.00 MB image at 45.33 MB/s Sep 08 06:44:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bce84be6-6fe0-4240-bca3-748c9a2f81b2 tempest-VolumesImageMetadata-1989026910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-23c9dc6d-25d3-4f62-b79c-b378d8d442b9 1G {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:44:51 devstack sudo[91035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-23c9dc6d-25d3-4f62-b79c-b378d8d442b9 1G Sep 08 06:44:51 devstack sudo[91035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:44:52 devstack sudo[91035]: pam_unix(sudo:session): session closed for user root Sep 08 06:44:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bce84be6-6fe0-4240-bca3-748c9a2f81b2 tempest-VolumesImageMetadata-1989026910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-23c9dc6d-25d3-4f62-b79c-b378d8d442b9 1G" returned: 0 in 0.422s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:44:52 devstack cinder-volume[87507]: DEBUG cinder.volume.volume_utils [None req-bce84be6-6fe0-4240-bca3-748c9a2f81b2 tempest-VolumesImageMetadata-1989026910 None] Downloaded image 69da6bac-8b7b-48c5-af3b-29466563452a ((None, [{'url': 'file:///opt/stack/data/glance/images/69da6bac-8b7b-48c5-af3b-29466563452a', 'metadata': {}}])) to volume 23c9dc6d-25d3-4f62-b79c-b378d8d442b9 successfully. {{(pid=87507) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 08 06:44:52 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-bce84be6-6fe0-4240-bca3-748c9a2f81b2 tempest-VolumesImageMetadata-1989026910 None] Temporary image 69da6bac-8b7b-48c5-af3b-29466563452a for user ce9465b29a284802bf8f2c585ca79bbd is deleted. {{(pid=87507) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 08 06:44:52 devstack cinder-volume[87507]: DEBUG cinder.volume.volume_utils [None req-bce84be6-6fe0-4240-bca3-748c9a2f81b2 tempest-VolumesImageMetadata-1989026910 None] Marking volume 23c9dc6d-25d3-4f62-b79c-b378d8d442b9 as bootable. {{(pid=87507) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 08 06:44:52 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-bce84be6-6fe0-4240-bca3-748c9a2f81b2 tempest-VolumesImageMetadata-1989026910 None] Copying metadata from image 69da6bac-8b7b-48c5-af3b-29466563452a to 23c9dc6d-25d3-4f62-b79c-b378d8d442b9. {{(pid=87507) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 08 06:44:52 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-bce84be6-6fe0-4240-bca3-748c9a2f81b2 tempest-VolumesImageMetadata-1989026910 None] Creating volume glance metadata for volume 23c9dc6d-25d3-4f62-b79c-b378d8d442b9 backed by image 69da6bac-8b7b-48c5-af3b-29466563452a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '69da6bac-8b7b-48c5-af3b-29466563452a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87507) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 08 06:44:52 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-bce84be6-6fe0-4240-bca3-748c9a2f81b2 tempest-VolumesImageMetadata-1989026910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c763505-8c64-4897-aed3-65f8dce631aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23c9dc6d-25d3-4f62-b79c-b378d8d442b9', 'volume_size': 1, 'image_id': '69da6bac-8b7b-48c5-af3b-29466563452a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/69da6bac-8b7b-48c5-af3b-29466563452a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '95d2d5dbb3e04d74b8da31fc6ee47f98', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '69da6bac-8b7b-48c5-af3b-29466563452a', 'created_at': datetime.datetime(2026, 9, 8, 4, 36, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 4, 36, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/69da6bac-8b7b-48c5-af3b-29466563452a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:44:52 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-bce84be6-6fe0-4240-bca3-748c9a2f81b2 tempest-VolumesImageMetadata-1989026910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9adbd1df-0d6e-4231-9e03-f5670c07c7f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:44:52 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-bce84be6-6fe0-4240-bca3-748c9a2f81b2 tempest-VolumesImageMetadata-1989026910 None] Volume volume-23c9dc6d-25d3-4f62-b79c-b378d8d442b9 (23c9dc6d-25d3-4f62-b79c-b378d8d442b9): created successfully Sep 08 06:44:52 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-bce84be6-6fe0-4240-bca3-748c9a2f81b2 tempest-VolumesImageMetadata-1989026910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9adbd1df-0d6e-4231-9e03-f5670c07c7f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:44:52 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-bce84be6-6fe0-4240-bca3-748c9a2f81b2 tempest-VolumesImageMetadata-1989026910 None] Flow 'volume_create_manager' (9dd9a413-57f9-4402-bc30-291fb3c03db8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:44:52 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-bce84be6-6fe0-4240-bca3-748c9a2f81b2 tempest-VolumesImageMetadata-1989026910 None] Created volume successfully. Sep 08 06:44:53 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-b2a3e8e2-7d75-4078-a7c7-4f2c149fd38a tempest-VolumesImageMetadata-1989026910 None] Acquiring lock "cinder-23c9dc6d-25d3-4f62-b79c-b378d8d442b9-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:44:53 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-b2a3e8e2-7d75-4078-a7c7-4f2c149fd38a tempest-VolumesImageMetadata-1989026910 None] Lock "cinder-23c9dc6d-25d3-4f62-b79c-b378d8d442b9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:44:53 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-b2a3e8e2-7d75-4078-a7c7-4f2c149fd38a tempest-VolumesImageMetadata-1989026910 None] Acquiring lock "cinder-quobyte-23c9dc6d-25d3-4f62-b79c-b378d8d442b9" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:44:53 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-b2a3e8e2-7d75-4078-a7c7-4f2c149fd38a tempest-VolumesImageMetadata-1989026910 None] Lock "cinder-quobyte-23c9dc6d-25d3-4f62-b79c-b378d8d442b9" acquired by "delete_volume" :: waited 0.021s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:44:53 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[589eb126-8f37-417b-9fea-5c53ceea55eb]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:44:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b2a3e8e2-7d75-4078-a7c7-4f2c149fd38a tempest-VolumesImageMetadata-1989026910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-23c9dc6d-25d3-4f62-b79c-b378d8d442b9 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:44:53 devstack sudo[91044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-23c9dc6d-25d3-4f62-b79c-b378d8d442b9 Sep 08 06:44:53 devstack sudo[91044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:44:53 devstack sudo[91044]: pam_unix(sudo:session): session closed for user root Sep 08 06:44:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b2a3e8e2-7d75-4078-a7c7-4f2c149fd38a tempest-VolumesImageMetadata-1989026910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-23c9dc6d-25d3-4f62-b79c-b378d8d442b9" returned: 0 in 0.374s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:44:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b2a3e8e2-7d75-4078-a7c7-4f2c149fd38a tempest-VolumesImageMetadata-1989026910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-23c9dc6d-25d3-4f62-b79c-b378d8d442b9 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:44:53 devstack sudo[91050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-23c9dc6d-25d3-4f62-b79c-b378d8d442b9 Sep 08 06:44:53 devstack sudo[91050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:44:54 devstack sudo[91050]: pam_unix(sudo:session): session closed for user root Sep 08 06:44:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b2a3e8e2-7d75-4078-a7c7-4f2c149fd38a tempest-VolumesImageMetadata-1989026910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-23c9dc6d-25d3-4f62-b79c-b378d8d442b9" returned: 0 in 0.284s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:44:54 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-b2a3e8e2-7d75-4078-a7c7-4f2c149fd38a tempest-VolumesImageMetadata-1989026910 None] Lock "cinder-quobyte-23c9dc6d-25d3-4f62-b79c-b378d8d442b9" released by "delete_volume" :: held 0.698s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:44:54 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-b2a3e8e2-7d75-4078-a7c7-4f2c149fd38a tempest-VolumesImageMetadata-1989026910 None] Created reservations ['cee39b7c-41f2-480b-8afd-e9a3d371e94b', '7bffb70a-77db-4cc6-af48-cbdada5a43d8', '5496af32-a224-4a85-b91e-5b2852c5187c', 'd5e223db-59e5-45ca-a6da-b5a70b455165'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:44:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b2a3e8e2-7d75-4078-a7c7-4f2c149fd38a tempest-VolumesImageMetadata-1989026910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:44:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b2a3e8e2-7d75-4078-a7c7-4f2c149fd38a tempest-VolumesImageMetadata-1989026910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:44:54 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-b2a3e8e2-7d75-4078-a7c7-4f2c149fd38a tempest-VolumesImageMetadata-1989026910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:44:54 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-b2a3e8e2-7d75-4078-a7c7-4f2c149fd38a tempest-VolumesImageMetadata-1989026910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:44:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b2a3e8e2-7d75-4078-a7c7-4f2c149fd38a tempest-VolumesImageMetadata-1989026910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:44:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b2a3e8e2-7d75-4078-a7c7-4f2c149fd38a tempest-VolumesImageMetadata-1989026910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:44:54 devstack sudo[91053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:44:54 devstack sudo[91053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:44:54 devstack sudo[91053]: pam_unix(sudo:session): session closed for user root Sep 08 06:44:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b2a3e8e2-7d75-4078-a7c7-4f2c149fd38a tempest-VolumesImageMetadata-1989026910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.278s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:44:54 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-b2a3e8e2-7d75-4078-a7c7-4f2c149fd38a tempest-VolumesImageMetadata-1989026910 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:44:54 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-b2a3e8e2-7d75-4078-a7c7-4f2c149fd38a tempest-VolumesImageMetadata-1989026910 None] Deleted volume successfully. Sep 08 06:44:54 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-b2a3e8e2-7d75-4078-a7c7-4f2c149fd38a tempest-VolumesImageMetadata-1989026910 None] Lock "cinder-23c9dc6d-25d3-4f62-b79c-b378d8d442b9-delete_volume" released by "delete_volume" :: held 1.206s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:44:58 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-5383c93a-1e07-4dae-a4d5-2b404275ea20 tempest-SnapshotMetadataTestJSON-1097257466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:44:58 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5383c93a-1e07-4dae-a4d5-2b404275ea20 tempest-SnapshotMetadataTestJSON-1097257466 None] Flow 'volume_create_manager' (b63ab9e1-63f5-4edf-9363-99b5ba92060d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:44:58 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5383c93a-1e07-4dae-a4d5-2b404275ea20 tempest-SnapshotMetadataTestJSON-1097257466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c11706f0-4f3f-483a-a5a1-b5fdee04e6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:44:58 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5383c93a-1e07-4dae-a4d5-2b404275ea20 tempest-SnapshotMetadataTestJSON-1097257466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c11706f0-4f3f-483a-a5a1-b5fdee04e6e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:44:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1081529529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cc6f4fc-6119-482d-96fa-7f8f622b7db4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='118c2e29541d4f839d5e3ce69705aeaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:44:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:44:59Z,use_quota=True,user_id='0c3614c1e0be407f9ab47ccd06eb2a61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:44:58 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5383c93a-1e07-4dae-a4d5-2b404275ea20 tempest-SnapshotMetadataTestJSON-1097257466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dd6bc6a-c032-4fb1-af4f-dc1bd970f707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:44:58 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5383c93a-1e07-4dae-a4d5-2b404275ea20 tempest-SnapshotMetadataTestJSON-1097257466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dd6bc6a-c032-4fb1-af4f-dc1bd970f707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:44:58 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5383c93a-1e07-4dae-a4d5-2b404275ea20 tempest-SnapshotMetadataTestJSON-1097257466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a478cb0-7e55-4f46-98fb-cc5521a2dfdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:44:58 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5383c93a-1e07-4dae-a4d5-2b404275ea20 tempest-SnapshotMetadataTestJSON-1097257466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a478cb0-7e55-4f46-98fb-cc5521a2dfdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cc6f4fc-6119-482d-96fa-7f8f622b7db4', 'volume_name': 'volume-1cc6f4fc-6119-482d-96fa-7f8f622b7db4', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:44:58 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5383c93a-1e07-4dae-a4d5-2b404275ea20 tempest-SnapshotMetadataTestJSON-1097257466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f84ae9a5-294c-4f57-a8ba-ab73affff40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:44:58 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5383c93a-1e07-4dae-a4d5-2b404275ea20 tempest-SnapshotMetadataTestJSON-1097257466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f84ae9a5-294c-4f57-a8ba-ab73affff40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:44:58 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5383c93a-1e07-4dae-a4d5-2b404275ea20 tempest-SnapshotMetadataTestJSON-1097257466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37b336f6-fcee-462a-8a0f-947dffa55558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:44:58 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-5383c93a-1e07-4dae-a4d5-2b404275ea20 tempest-SnapshotMetadataTestJSON-1097257466 None] Volume 1cc6f4fc-6119-482d-96fa-7f8f622b7db4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cc6f4fc-6119-482d-96fa-7f8f622b7db4', 'volume_size': 1} Sep 08 06:44:58 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-5383c93a-1e07-4dae-a4d5-2b404275ea20 tempest-SnapshotMetadataTestJSON-1097257466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:44:58 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-5383c93a-1e07-4dae-a4d5-2b404275ea20 tempest-SnapshotMetadataTestJSON-1097257466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:44:58 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-5383c93a-1e07-4dae-a4d5-2b404275ea20 tempest-SnapshotMetadataTestJSON-1097257466 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:44:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1081529529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cc6f4fc-6119-482d-96fa-7f8f622b7db4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='118c2e29541d4f839d5e3ce69705aeaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:44:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:44:59Z,use_quota=True,user_id='0c3614c1e0be407f9ab47ccd06eb2a61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:44:58 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-5383c93a-1e07-4dae-a4d5-2b404275ea20 tempest-SnapshotMetadataTestJSON-1097257466 None] Creating volume 1cc6f4fc-6119-482d-96fa-7f8f622b7db4 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:44:58 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-5383c93a-1e07-4dae-a4d5-2b404275ea20 tempest-SnapshotMetadataTestJSON-1097257466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:44:58 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-5383c93a-1e07-4dae-a4d5-2b404275ea20 tempest-SnapshotMetadataTestJSON-1097257466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:44:58 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-5383c93a-1e07-4dae-a4d5-2b404275ea20 tempest-SnapshotMetadataTestJSON-1097257466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:44:58 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-5383c93a-1e07-4dae-a4d5-2b404275ea20 tempest-SnapshotMetadataTestJSON-1097257466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:44:58 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-5383c93a-1e07-4dae-a4d5-2b404275ea20 tempest-SnapshotMetadataTestJSON-1097257466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:44:58 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-5383c93a-1e07-4dae-a4d5-2b404275ea20 tempest-SnapshotMetadataTestJSON-1097257466 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:44:58 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-5383c93a-1e07-4dae-a4d5-2b404275ea20 tempest-SnapshotMetadataTestJSON-1097257466 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:44:58 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5383c93a-1e07-4dae-a4d5-2b404275ea20 tempest-SnapshotMetadataTestJSON-1097257466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1cc6f4fc-6119-482d-96fa-7f8f622b7db4 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:44:58 devstack sudo[91065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1cc6f4fc-6119-482d-96fa-7f8f622b7db4 1073741824 Sep 08 06:44:58 devstack sudo[91065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:44:59 devstack sudo[91065]: pam_unix(sudo:session): session closed for user root Sep 08 06:44:59 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5383c93a-1e07-4dae-a4d5-2b404275ea20 tempest-SnapshotMetadataTestJSON-1097257466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1cc6f4fc-6119-482d-96fa-7f8f622b7db4 1073741824" returned: 0 in 0.723s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:44:59 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5383c93a-1e07-4dae-a4d5-2b404275ea20 tempest-SnapshotMetadataTestJSON-1097257466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1cc6f4fc-6119-482d-96fa-7f8f622b7db4 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:44:59 devstack sudo[91077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1cc6f4fc-6119-482d-96fa-7f8f622b7db4 Sep 08 06:44:59 devstack sudo[91077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:45:00 devstack sudo[91077]: pam_unix(sudo:session): session closed for user root Sep 08 06:45:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5383c93a-1e07-4dae-a4d5-2b404275ea20 tempest-SnapshotMetadataTestJSON-1097257466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1cc6f4fc-6119-482d-96fa-7f8f622b7db4" returned: 0 in 0.702s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:45:00 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-5383c93a-1e07-4dae-a4d5-2b404275ea20 tempest-SnapshotMetadataTestJSON-1097257466 None] <== create_volume: return (1543ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:45:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-5383c93a-1e07-4dae-a4d5-2b404275ea20 tempest-SnapshotMetadataTestJSON-1097257466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.547s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:45:00 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5383c93a-1e07-4dae-a4d5-2b404275ea20 tempest-SnapshotMetadataTestJSON-1097257466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37b336f6-fcee-462a-8a0f-947dffa55558) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cc6f4fc-6119-482d-96fa-7f8f622b7db4', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:45:00 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5383c93a-1e07-4dae-a4d5-2b404275ea20 tempest-SnapshotMetadataTestJSON-1097257466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f349c0e-0c1f-4125-bd7c-d6f171d5c72c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:45:00 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-5383c93a-1e07-4dae-a4d5-2b404275ea20 tempest-SnapshotMetadataTestJSON-1097257466 None] Volume volume-1cc6f4fc-6119-482d-96fa-7f8f622b7db4 (1cc6f4fc-6119-482d-96fa-7f8f622b7db4): created successfully Sep 08 06:45:00 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5383c93a-1e07-4dae-a4d5-2b404275ea20 tempest-SnapshotMetadataTestJSON-1097257466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f349c0e-0c1f-4125-bd7c-d6f171d5c72c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:45:00 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5383c93a-1e07-4dae-a4d5-2b404275ea20 tempest-SnapshotMetadataTestJSON-1097257466 None] Flow 'volume_create_manager' (b63ab9e1-63f5-4edf-9363-99b5ba92060d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:45:00 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-5383c93a-1e07-4dae-a4d5-2b404275ea20 tempest-SnapshotMetadataTestJSON-1097257466 None] Created volume successfully. Sep 08 06:45:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-9217a3ec-316f-4736-8d2e-12dbb66eebd5 tempest-SnapshotMetadataTestJSON-1097257466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:45:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-9217a3ec-316f-4736-8d2e-12dbb66eebd5 tempest-SnapshotMetadataTestJSON-1097257466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:45:01 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-9217a3ec-316f-4736-8d2e-12dbb66eebd5 tempest-SnapshotMetadataTestJSON-1097257466 None] Creating offline snapshot 95b3cab7-80b4-4123-bbf3-7832d151c94c of volume 1cc6f4fc-6119-482d-96fa-7f8f622b7db4 {{(pid=87507) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 06:45:01 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b1445b-c98c-422e-a5c3-140a67412c16]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:45:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9217a3ec-316f-4736-8d2e-12dbb66eebd5 tempest-SnapshotMetadataTestJSON-1097257466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1cc6f4fc-6119-482d-96fa-7f8f622b7db4 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:45:01 devstack sudo[91114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1cc6f4fc-6119-482d-96fa-7f8f622b7db4 Sep 08 06:45:01 devstack sudo[91114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:45:01 devstack cinder-volume[87507]: INFO cinder.volume.manager [req-9f41fc88-4647-488f-9bbd-c21b36f5bd36 req-56fbd46d-d689-4df1-ad71-2fee30fbfbee tempest-ServerActionsTestOtherA-1140651778 None] Terminate volume connection completed successfully. Sep 08 06:45:01 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-9f41fc88-4647-488f-9bbd-c21b36f5bd36 req-56fbd46d-d689-4df1-ad71-2fee30fbfbee tempest-ServerActionsTestOtherA-1140651778 None] Deleting attachment 319cb1dc-5fad-44a2-8afb-e681749dfea8. {{(pid=87507) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 06:45:01 devstack sudo[91114]: pam_unix(sudo:session): session closed for user root Sep 08 06:45:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9217a3ec-316f-4736-8d2e-12dbb66eebd5 tempest-SnapshotMetadataTestJSON-1097257466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1cc6f4fc-6119-482d-96fa-7f8f622b7db4" returned: 0 in 0.582s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:45:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9217a3ec-316f-4736-8d2e-12dbb66eebd5 tempest-SnapshotMetadataTestJSON-1097257466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1cc6f4fc-6119-482d-96fa-7f8f622b7db4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1cc6f4fc-6119-482d-96fa-7f8f622b7db4.95b3cab7-80b4-4123-bbf3-7832d151c94c 1G {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:45:01 devstack sudo[91127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1cc6f4fc-6119-482d-96fa-7f8f622b7db4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1cc6f4fc-6119-482d-96fa-7f8f622b7db4.95b3cab7-80b4-4123-bbf3-7832d151c94c 1G Sep 08 06:45:01 devstack sudo[91127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:45:02 devstack sudo[91127]: pam_unix(sudo:session): session closed for user root Sep 08 06:45:02 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9217a3ec-316f-4736-8d2e-12dbb66eebd5 tempest-SnapshotMetadataTestJSON-1097257466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1cc6f4fc-6119-482d-96fa-7f8f622b7db4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1cc6f4fc-6119-482d-96fa-7f8f622b7db4.95b3cab7-80b4-4123-bbf3-7832d151c94c 1G" returned: 0 in 0.614s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:45:02 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9217a3ec-316f-4736-8d2e-12dbb66eebd5 tempest-SnapshotMetadataTestJSON-1097257466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cc6f4fc-6119-482d-96fa-7f8f622b7db4 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1cc6f4fc-6119-482d-96fa-7f8f622b7db4.95b3cab7-80b4-4123-bbf3-7832d151c94c {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:45:02 devstack sudo[91137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cc6f4fc-6119-482d-96fa-7f8f622b7db4 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1cc6f4fc-6119-482d-96fa-7f8f622b7db4.95b3cab7-80b4-4123-bbf3-7832d151c94c Sep 08 06:45:02 devstack sudo[91137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:45:02 devstack sudo[91137]: pam_unix(sudo:session): session closed for user root Sep 08 06:45:02 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9217a3ec-316f-4736-8d2e-12dbb66eebd5 tempest-SnapshotMetadataTestJSON-1097257466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cc6f4fc-6119-482d-96fa-7f8f622b7db4 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1cc6f4fc-6119-482d-96fa-7f8f622b7db4.95b3cab7-80b4-4123-bbf3-7832d151c94c" returned: 0 in 0.504s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:45:02 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-9217a3ec-316f-4736-8d2e-12dbb66eebd5 tempest-SnapshotMetadataTestJSON-1097257466 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1cc6f4fc-6119-482d-96fa-7f8f622b7db4.95b3cab7-80b4-4123-bbf3-7832d151c94c is being set with open permissions: ugo+rw Sep 08 06:45:02 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9217a3ec-316f-4736-8d2e-12dbb66eebd5 tempest-SnapshotMetadataTestJSON-1097257466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1cc6f4fc-6119-482d-96fa-7f8f622b7db4.95b3cab7-80b4-4123-bbf3-7832d151c94c {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:45:03 devstack sudo[91152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1cc6f4fc-6119-482d-96fa-7f8f622b7db4.95b3cab7-80b4-4123-bbf3-7832d151c94c Sep 08 06:45:03 devstack sudo[91152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:45:03 devstack sudo[91152]: pam_unix(sudo:session): session closed for user root Sep 08 06:45:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9217a3ec-316f-4736-8d2e-12dbb66eebd5 tempest-SnapshotMetadataTestJSON-1097257466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1cc6f4fc-6119-482d-96fa-7f8f622b7db4.95b3cab7-80b4-4123-bbf3-7832d151c94c" returned: 0 in 0.522s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:45:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9217a3ec-316f-4736-8d2e-12dbb66eebd5 tempest-SnapshotMetadataTestJSON-1097257466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1cc6f4fc-6119-482d-96fa-7f8f622b7db4.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:45:03 devstack sudo[91187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1cc6f4fc-6119-482d-96fa-7f8f622b7db4.info Sep 08 06:45:03 devstack sudo[91187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:45:03 devstack sudo[91187]: pam_unix(sudo:session): session closed for user root Sep 08 06:45:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9217a3ec-316f-4736-8d2e-12dbb66eebd5 tempest-SnapshotMetadataTestJSON-1097257466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1cc6f4fc-6119-482d-96fa-7f8f622b7db4.info" returned: 0 in 0.462s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:45:03 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-9217a3ec-316f-4736-8d2e-12dbb66eebd5 tempest-SnapshotMetadataTestJSON-1097257466 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1cc6f4fc-6119-482d-96fa-7f8f622b7db4.info is being set with open permissions: ugo+rw Sep 08 06:45:04 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9217a3ec-316f-4736-8d2e-12dbb66eebd5 tempest-SnapshotMetadataTestJSON-1097257466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1cc6f4fc-6119-482d-96fa-7f8f622b7db4.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:45:04 devstack sudo[91221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1cc6f4fc-6119-482d-96fa-7f8f622b7db4.info Sep 08 06:45:04 devstack sudo[91221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:45:04 devstack sudo[91221]: pam_unix(sudo:session): session closed for user root Sep 08 06:45:04 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9217a3ec-316f-4736-8d2e-12dbb66eebd5 tempest-SnapshotMetadataTestJSON-1097257466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1cc6f4fc-6119-482d-96fa-7f8f622b7db4.info" returned: 0 in 0.365s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:45:04 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-9217a3ec-316f-4736-8d2e-12dbb66eebd5 tempest-SnapshotMetadataTestJSON-1097257466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.186s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:45:04 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-9217a3ec-316f-4736-8d2e-12dbb66eebd5 tempest-SnapshotMetadataTestJSON-1097257466 None] Create snapshot completed successfully Sep 08 06:45:07 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-337b99ad-5e35-491b-85d3-b804e20559a9 tempest-SnapshotMetadataTestJSON-1097257466 None] Acquiring lock "cinder-95b3cab7-80b4-4123-bbf3-7832d151c94c-delete_snapshot" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:45:07 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-337b99ad-5e35-491b-85d3-b804e20559a9 tempest-SnapshotMetadataTestJSON-1097257466 None] Lock "cinder-95b3cab7-80b4-4123-bbf3-7832d151c94c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:45:07 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-337b99ad-5e35-491b-85d3-b804e20559a9 tempest-SnapshotMetadataTestJSON-1097257466 None] Acquiring lock "cinder-quobyte-1cc6f4fc-6119-482d-96fa-7f8f622b7db4" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:45:07 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-337b99ad-5e35-491b-85d3-b804e20559a9 tempest-SnapshotMetadataTestJSON-1097257466 None] Lock "cinder-quobyte-1cc6f4fc-6119-482d-96fa-7f8f622b7db4" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:45:07 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-337b99ad-5e35-491b-85d3-b804e20559a9 tempest-SnapshotMetadataTestJSON-1097257466 None] Acquiring lock "cinder-quobyte-95b3cab7-80b4-4123-bbf3-7832d151c94c" by "_delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:45:07 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-337b99ad-5e35-491b-85d3-b804e20559a9 tempest-SnapshotMetadataTestJSON-1097257466 None] Lock "cinder-quobyte-95b3cab7-80b4-4123-bbf3-7832d151c94c" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:45:07 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-337b99ad-5e35-491b-85d3-b804e20559a9 tempest-SnapshotMetadataTestJSON-1097257466 None] Deleting offline snapshot 95b3cab7-80b4-4123-bbf3-7832d151c94c of volume 1cc6f4fc-6119-482d-96fa-7f8f622b7db4 {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 06:45:07 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-337b99ad-5e35-491b-85d3-b804e20559a9 tempest-SnapshotMetadataTestJSON-1097257466 None] snapshot_file for this snap is: volume-1cc6f4fc-6119-482d-96fa-7f8f622b7db4.95b3cab7-80b4-4123-bbf3-7832d151c94c {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 06:45:07 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[af486fe7-c046-47c8-b611-e30cc5c2304b]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:45:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-337b99ad-5e35-491b-85d3-b804e20559a9 tempest-SnapshotMetadataTestJSON-1097257466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1cc6f4fc-6119-482d-96fa-7f8f622b7db4.95b3cab7-80b4-4123-bbf3-7832d151c94c {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:45:07 devstack sudo[91248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1cc6f4fc-6119-482d-96fa-7f8f622b7db4.95b3cab7-80b4-4123-bbf3-7832d151c94c Sep 08 06:45:07 devstack sudo[91248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:45:07 devstack sudo[91248]: pam_unix(sudo:session): session closed for user root Sep 08 06:45:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-337b99ad-5e35-491b-85d3-b804e20559a9 tempest-SnapshotMetadataTestJSON-1097257466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1cc6f4fc-6119-482d-96fa-7f8f622b7db4.95b3cab7-80b4-4123-bbf3-7832d151c94c" returned: 0 in 0.561s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:45:07 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-337b99ad-5e35-491b-85d3-b804e20559a9 tempest-SnapshotMetadataTestJSON-1097257466 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1cc6f4fc-6119-482d-96fa-7f8f622b7db4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 06:45:07 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcefd51c-1bc6-409f-82ff-4d8d87e41b47]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:45:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-337b99ad-5e35-491b-85d3-b804e20559a9 tempest-SnapshotMetadataTestJSON-1097257466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1cc6f4fc-6119-482d-96fa-7f8f622b7db4 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:45:08 devstack sudo[91254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1cc6f4fc-6119-482d-96fa-7f8f622b7db4 Sep 08 06:45:08 devstack sudo[91254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:45:08 devstack sudo[91254]: pam_unix(sudo:session): session closed for user root Sep 08 06:45:08 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-337b99ad-5e35-491b-85d3-b804e20559a9 tempest-SnapshotMetadataTestJSON-1097257466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1cc6f4fc-6119-482d-96fa-7f8f622b7db4" returned: 0 in 1.056s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:45:08 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-337b99ad-5e35-491b-85d3-b804e20559a9 tempest-SnapshotMetadataTestJSON-1097257466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1cc6f4fc-6119-482d-96fa-7f8f622b7db4.95b3cab7-80b4-4123-bbf3-7832d151c94c {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:45:08 devstack sudo[91296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1cc6f4fc-6119-482d-96fa-7f8f622b7db4.95b3cab7-80b4-4123-bbf3-7832d151c94c Sep 08 06:45:08 devstack sudo[91296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:45:09 devstack sudo[91296]: pam_unix(sudo:session): session closed for user root Sep 08 06:45:09 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-337b99ad-5e35-491b-85d3-b804e20559a9 tempest-SnapshotMetadataTestJSON-1097257466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1cc6f4fc-6119-482d-96fa-7f8f622b7db4.95b3cab7-80b4-4123-bbf3-7832d151c94c" returned: 0 in 0.671s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:45:09 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-337b99ad-5e35-491b-85d3-b804e20559a9 tempest-SnapshotMetadataTestJSON-1097257466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1cc6f4fc-6119-482d-96fa-7f8f622b7db4.95b3cab7-80b4-4123-bbf3-7832d151c94c {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:45:09 devstack sudo[91314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1cc6f4fc-6119-482d-96fa-7f8f622b7db4.95b3cab7-80b4-4123-bbf3-7832d151c94c Sep 08 06:45:09 devstack sudo[91314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:45:09 devstack sudo[91314]: pam_unix(sudo:session): session closed for user root Sep 08 06:45:09 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-337b99ad-5e35-491b-85d3-b804e20559a9 tempest-SnapshotMetadataTestJSON-1097257466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1cc6f4fc-6119-482d-96fa-7f8f622b7db4.95b3cab7-80b4-4123-bbf3-7832d151c94c" returned: 0 in 0.357s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:45:09 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-337b99ad-5e35-491b-85d3-b804e20559a9 tempest-SnapshotMetadataTestJSON-1097257466 None] Lock "cinder-quobyte-95b3cab7-80b4-4123-bbf3-7832d151c94c" released by "_delete_snapshot" :: held 2.847s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:45:09 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-337b99ad-5e35-491b-85d3-b804e20559a9 tempest-SnapshotMetadataTestJSON-1097257466 None] Lock "cinder-quobyte-1cc6f4fc-6119-482d-96fa-7f8f622b7db4" released by "delete_snapshot" :: held 2.898s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:45:10 devstack cinder-volume[87507]: WARNING cinder.quota [None req-337b99ad-5e35-491b-85d3-b804e20559a9 tempest-SnapshotMetadataTestJSON-1097257466 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 08 06:45:10 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-337b99ad-5e35-491b-85d3-b804e20559a9 tempest-SnapshotMetadataTestJSON-1097257466 None] Created reservations ['0a9dac9d-65df-4b2f-bb99-18dec6a3a382', '35e0938a-911b-4187-944f-3de1aa607e73', '7367a53b-834c-4b99-b32e-0eea50140f86', '5cfbe77c-914d-4eb2-8e15-9d255b562769'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:45:10 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-337b99ad-5e35-491b-85d3-b804e20559a9 tempest-SnapshotMetadataTestJSON-1097257466 None] Delete snapshot completed successfully. Sep 08 06:45:10 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-337b99ad-5e35-491b-85d3-b804e20559a9 tempest-SnapshotMetadataTestJSON-1097257466 None] Lock "cinder-95b3cab7-80b4-4123-bbf3-7832d151c94c-delete_snapshot" released by "delete_snapshot" :: held 3.145s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:45:10 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-2fe7bf8a-03da-4285-a9b6-8008e7116ba8 tempest-SnapshotMetadataTestJSON-1097257466 None] Acquiring lock "cinder-1cc6f4fc-6119-482d-96fa-7f8f622b7db4-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:45:10 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-2fe7bf8a-03da-4285-a9b6-8008e7116ba8 tempest-SnapshotMetadataTestJSON-1097257466 None] Lock "cinder-1cc6f4fc-6119-482d-96fa-7f8f622b7db4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:45:10 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-2fe7bf8a-03da-4285-a9b6-8008e7116ba8 tempest-SnapshotMetadataTestJSON-1097257466 None] Acquiring lock "cinder-quobyte-1cc6f4fc-6119-482d-96fa-7f8f622b7db4" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:45:11 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-2fe7bf8a-03da-4285-a9b6-8008e7116ba8 tempest-SnapshotMetadataTestJSON-1097257466 None] Lock "cinder-quobyte-1cc6f4fc-6119-482d-96fa-7f8f622b7db4" acquired by "delete_volume" :: waited 0.048s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:45:11 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad31b51d-5c0f-4d06-b525-58f5dd426b79]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:45:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2fe7bf8a-03da-4285-a9b6-8008e7116ba8 tempest-SnapshotMetadataTestJSON-1097257466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1cc6f4fc-6119-482d-96fa-7f8f622b7db4 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:45:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-c132010c-cf53-4958-a1cc-6cc8dcdc170b req-ac8d4524-ff7c-4386-af0f-88ca4999e18d tempest-TaggedAttachmentsTest-1974514162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:45:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-c132010c-cf53-4958-a1cc-6cc8dcdc170b req-ac8d4524-ff7c-4386-af0f-88ca4999e18d tempest-TaggedAttachmentsTest-1974514162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:45:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-c132010c-cf53-4958-a1cc-6cc8dcdc170b req-ac8d4524-ff7c-4386-af0f-88ca4999e18d tempest-TaggedAttachmentsTest-1974514162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:45:11 devstack sudo[91334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1cc6f4fc-6119-482d-96fa-7f8f622b7db4 Sep 08 06:45:11 devstack sudo[91334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:45:11 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-c132010c-cf53-4958-a1cc-6cc8dcdc170b req-ac8d4524-ff7c-4386-af0f-88ca4999e18d tempest-TaggedAttachmentsTest-1974514162 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d', 'name': 'volume-a50711e2-6cb8-4633-b27d-e3c8139aac33', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4e3534d4-5192-4b38-ab0b-256c644223d1', 'enforce_multipath': True} {{(pid=87507) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 06:45:11 devstack cinder-volume[87507]: INFO cinder.volume.manager [req-c132010c-cf53-4958-a1cc-6cc8dcdc170b req-ac8d4524-ff7c-4386-af0f-88ca4999e18d tempest-TaggedAttachmentsTest-1974514162 None] attachment_update completed successfully. Sep 08 06:45:11 devstack sudo[91334]: pam_unix(sudo:session): session closed for user root Sep 08 06:45:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2fe7bf8a-03da-4285-a9b6-8008e7116ba8 tempest-SnapshotMetadataTestJSON-1097257466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1cc6f4fc-6119-482d-96fa-7f8f622b7db4" returned: 0 in 0.755s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:45:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2fe7bf8a-03da-4285-a9b6-8008e7116ba8 tempest-SnapshotMetadataTestJSON-1097257466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1cc6f4fc-6119-482d-96fa-7f8f622b7db4 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:45:11 devstack sudo[91469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1cc6f4fc-6119-482d-96fa-7f8f622b7db4 Sep 08 06:45:11 devstack sudo[91469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:45:12 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-47e52326-cbeb-4847-bdf8-a14c195600f5 tempest-ServerActionsTestOtherA-1140651778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:45:12 devstack sudo[91469]: pam_unix(sudo:session): session closed for user root Sep 08 06:45:12 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-47e52326-cbeb-4847-bdf8-a14c195600f5 tempest-ServerActionsTestOtherA-1140651778 None] Flow 'volume_create_manager' (b2364336-d630-41d2-aa32-3404f357f93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:45:12 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-47e52326-cbeb-4847-bdf8-a14c195600f5 tempest-ServerActionsTestOtherA-1140651778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad1593c7-198c-456c-92aa-25e6c16ea3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:45:12 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2fe7bf8a-03da-4285-a9b6-8008e7116ba8 tempest-SnapshotMetadataTestJSON-1097257466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1cc6f4fc-6119-482d-96fa-7f8f622b7db4" returned: 0 in 0.672s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:45:12 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-47e52326-cbeb-4847-bdf8-a14c195600f5 tempest-ServerActionsTestOtherA-1140651778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad1593c7-198c-456c-92aa-25e6c16ea3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:45:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-332262923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c679adbf-d2cb-46b1-8505-1418b345f941,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b002e53583134e8aa8614ce3f689e71c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:45:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:45:12Z,use_quota=True,user_id='51fad9ee2f914a86b41aba71fa7f48aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:45:12 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-47e52326-cbeb-4847-bdf8-a14c195600f5 tempest-ServerActionsTestOtherA-1140651778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d92d2e2-5029-4e74-926a-c2352de70d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:45:12 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-47e52326-cbeb-4847-bdf8-a14c195600f5 tempest-ServerActionsTestOtherA-1140651778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d92d2e2-5029-4e74-926a-c2352de70d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:45:12 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-47e52326-cbeb-4847-bdf8-a14c195600f5 tempest-ServerActionsTestOtherA-1140651778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a026e5f-1655-45ab-8582-c59f9bc40693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:45:12 devstack cinder-volume[87507]: DEBUG cinder.image.glance [None req-47e52326-cbeb-4847-bdf8-a14c195600f5 tempest-ServerActionsTestOtherA-1140651778 None] Creating Keystone auth plugin from conf {{(pid=87507) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 08 06:45:12 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-2fe7bf8a-03da-4285-a9b6-8008e7116ba8 tempest-SnapshotMetadataTestJSON-1097257466 None] Lock "cinder-quobyte-1cc6f4fc-6119-482d-96fa-7f8f622b7db4" released by "delete_volume" :: held 1.587s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:45:12 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-2fe7bf8a-03da-4285-a9b6-8008e7116ba8 tempest-SnapshotMetadataTestJSON-1097257466 None] Created reservations ['33e1503a-0bf4-4981-91f7-9978bf7242e0', 'd0310426-e454-4f98-b09a-d69e63d226ec', 'd05c6f57-5cdc-4427-823d-a57d5bd7273a', '58db759c-92d5-4935-82aa-aae5ec005d11'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:45:12 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-2fe7bf8a-03da-4285-a9b6-8008e7116ba8 tempest-SnapshotMetadataTestJSON-1097257466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:45:12 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-2fe7bf8a-03da-4285-a9b6-8008e7116ba8 tempest-SnapshotMetadataTestJSON-1097257466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:45:12 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-2fe7bf8a-03da-4285-a9b6-8008e7116ba8 tempest-SnapshotMetadataTestJSON-1097257466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:45:12 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-2fe7bf8a-03da-4285-a9b6-8008e7116ba8 tempest-SnapshotMetadataTestJSON-1097257466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:45:12 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-2fe7bf8a-03da-4285-a9b6-8008e7116ba8 tempest-SnapshotMetadataTestJSON-1097257466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:45:12 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2fe7bf8a-03da-4285-a9b6-8008e7116ba8 tempest-SnapshotMetadataTestJSON-1097257466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:45:12 devstack sudo[91760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:45:12 devstack sudo[91760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:45:12 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-47e52326-cbeb-4847-bdf8-a14c195600f5 tempest-ServerActionsTestOtherA-1140651778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a026e5f-1655-45ab-8582-c59f9bc40693) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c679adbf-d2cb-46b1-8505-1418b345f941', 'volume_name': 'volume-c679adbf-d2cb-46b1-8505-1418b345f941', 'volume_size': 1, 'image_id': '69da6bac-8b7b-48c5-af3b-29466563452a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/69da6bac-8b7b-48c5-af3b-29466563452a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '95d2d5dbb3e04d74b8da31fc6ee47f98', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '69da6bac-8b7b-48c5-af3b-29466563452a', 'created_at': datetime.datetime(2026, 9, 8, 4, 36, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 4, 36, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/69da6bac-8b7b-48c5-af3b-29466563452a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:45:12 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-47e52326-cbeb-4847-bdf8-a14c195600f5 tempest-ServerActionsTestOtherA-1140651778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c42fc1b-aec0-40cb-83ab-dcbf1fd40fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:45:13 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-47e52326-cbeb-4847-bdf8-a14c195600f5 tempest-ServerActionsTestOtherA-1140651778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c42fc1b-aec0-40cb-83ab-dcbf1fd40fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:45:13 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-47e52326-cbeb-4847-bdf8-a14c195600f5 tempest-ServerActionsTestOtherA-1140651778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0494130c-cdb8-4a41-9795-2542a3689912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:45:13 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-47e52326-cbeb-4847-bdf8-a14c195600f5 tempest-ServerActionsTestOtherA-1140651778 None] Volume c679adbf-d2cb-46b1-8505-1418b345f941: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c679adbf-d2cb-46b1-8505-1418b345f941', 'volume_size': 1, 'image_id': '69da6bac-8b7b-48c5-af3b-29466563452a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/69da6bac-8b7b-48c5-af3b-29466563452a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '95d2d5dbb3e04d74b8da31fc6ee47f98', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '69da6bac-8b7b-48c5-af3b-29466563452a', 'created_at': datetime.datetime(2026, 9, 8, 4, 36, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 4, 36, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/69da6bac-8b7b-48c5-af3b-29466563452a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 08 06:45:13 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-47e52326-cbeb-4847-bdf8-a14c195600f5 tempest-ServerActionsTestOtherA-1140651778 None] Trying to clone c679adbf-d2cb-46b1-8505-1418b345f941 from image 69da6bac-8b7b-48c5-af3b-29466563452a at location (None, [{'url': 'file:///opt/stack/data/glance/images/69da6bac-8b7b-48c5-af3b-29466563452a', 'metadata': {}}]). {{(pid=87507) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 08 06:45:13 devstack sudo[91760]: pam_unix(sudo:session): session closed for user root Sep 08 06:45:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2fe7bf8a-03da-4285-a9b6-8008e7116ba8 tempest-SnapshotMetadataTestJSON-1097257466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.470s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:45:13 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-2fe7bf8a-03da-4285-a9b6-8008e7116ba8 tempest-SnapshotMetadataTestJSON-1097257466 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:45:13 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-2fe7bf8a-03da-4285-a9b6-8008e7116ba8 tempest-SnapshotMetadataTestJSON-1097257466 None] Deleted volume successfully. Sep 08 06:45:13 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-2fe7bf8a-03da-4285-a9b6-8008e7116ba8 tempest-SnapshotMetadataTestJSON-1097257466 None] Lock "cinder-1cc6f4fc-6119-482d-96fa-7f8f622b7db4-delete_volume" released by "delete_volume" :: held 2.610s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:45:13 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-47e52326-cbeb-4847-bdf8-a14c195600f5 tempest-ServerActionsTestOtherA-1140651778 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_cdlmnsscdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87507) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 08 06:45:13 devstack cinder-volume[87507]: INFO cinder.image.image_utils [None req-47e52326-cbeb-4847-bdf8-a14c195600f5 tempest-ServerActionsTestOtherA-1140651778 None] Image download 20.69 MB at 20.69 MB/s Sep 08 06:45:13 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9ccef5-aee1-4e57-920f-c31282de13cc]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:45:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-47e52326-cbeb-4847-bdf8-a14c195600f5 tempest-ServerActionsTestOtherA-1140651778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_cdlmnsscdevstack@QuobyteHD {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:45:14 devstack sudo[91771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_cdlmnsscdevstack@QuobyteHD Sep 08 06:45:14 devstack sudo[91771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:45:14 devstack sudo[91771]: pam_unix(sudo:session): session closed for user root Sep 08 06:45:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-47e52326-cbeb-4847-bdf8-a14c195600f5 tempest-ServerActionsTestOtherA-1140651778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_cdlmnsscdevstack@QuobyteHD" returned: 0 in 0.554s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:45:14 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-47e52326-cbeb-4847-bdf8-a14c195600f5 tempest-ServerActionsTestOtherA-1140651778 None] Temporary image 69da6bac-8b7b-48c5-af3b-29466563452a is fetched for user 51fad9ee2f914a86b41aba71fa7f48aa. {{(pid=87507) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 08 06:45:14 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[feaa0b6c-f769-48ac-ab4d-84efa9a732ee]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:45:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-47e52326-cbeb-4847-bdf8-a14c195600f5 tempest-ServerActionsTestOtherA-1140651778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_cdlmnsscdevstack@QuobyteHD {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:45:14 devstack sudo[91778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_cdlmnsscdevstack@QuobyteHD Sep 08 06:45:14 devstack sudo[91778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:45:14 devstack cinder-volume[87507]: INFO cinder.volume.manager [req-ca32b86b-1b2c-4e07-b30b-961882d58856 req-c8401752-904b-4091-97c1-77c282e7510b tempest-TaggedAttachmentsTest-1974514162 None] Terminate volume connection completed successfully. Sep 08 06:45:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-ca32b86b-1b2c-4e07-b30b-961882d58856 req-c8401752-904b-4091-97c1-77c282e7510b tempest-TaggedAttachmentsTest-1974514162 None] Deleting attachment 4e3534d4-5192-4b38-ab0b-256c644223d1. {{(pid=87507) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 06:45:15 devstack sudo[91778]: pam_unix(sudo:session): session closed for user root Sep 08 06:45:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-47e52326-cbeb-4847-bdf8-a14c195600f5 tempest-ServerActionsTestOtherA-1140651778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_cdlmnsscdevstack@QuobyteHD" returned: 0 in 0.471s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:45:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-47e52326-cbeb-4847-bdf8-a14c195600f5 tempest-ServerActionsTestOtherA-1140651778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:45:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-47e52326-cbeb-4847-bdf8-a14c195600f5 tempest-ServerActionsTestOtherA-1140651778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:45:15 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-47e52326-cbeb-4847-bdf8-a14c195600f5 tempest-ServerActionsTestOtherA-1140651778 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:45:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-332262923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c679adbf-d2cb-46b1-8505-1418b345f941,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b002e53583134e8aa8614ce3f689e71c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:45:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:45:12Z,use_quota=True,user_id='51fad9ee2f914a86b41aba71fa7f48aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:45:15 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-47e52326-cbeb-4847-bdf8-a14c195600f5 tempest-ServerActionsTestOtherA-1140651778 None] Creating volume c679adbf-d2cb-46b1-8505-1418b345f941 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:45:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-47e52326-cbeb-4847-bdf8-a14c195600f5 tempest-ServerActionsTestOtherA-1140651778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:45:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-47e52326-cbeb-4847-bdf8-a14c195600f5 tempest-ServerActionsTestOtherA-1140651778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:45:15 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-47e52326-cbeb-4847-bdf8-a14c195600f5 tempest-ServerActionsTestOtherA-1140651778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:45:15 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-47e52326-cbeb-4847-bdf8-a14c195600f5 tempest-ServerActionsTestOtherA-1140651778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:45:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-47e52326-cbeb-4847-bdf8-a14c195600f5 tempest-ServerActionsTestOtherA-1140651778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:45:15 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-47e52326-cbeb-4847-bdf8-a14c195600f5 tempest-ServerActionsTestOtherA-1140651778 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:45:15 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-47e52326-cbeb-4847-bdf8-a14c195600f5 tempest-ServerActionsTestOtherA-1140651778 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:45:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-47e52326-cbeb-4847-bdf8-a14c195600f5 tempest-ServerActionsTestOtherA-1140651778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c679adbf-d2cb-46b1-8505-1418b345f941 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:45:15 devstack sudo[91811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c679adbf-d2cb-46b1-8505-1418b345f941 1073741824 Sep 08 06:45:15 devstack sudo[91811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:45:15 devstack sudo[91811]: pam_unix(sudo:session): session closed for user root Sep 08 06:45:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-47e52326-cbeb-4847-bdf8-a14c195600f5 tempest-ServerActionsTestOtherA-1140651778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c679adbf-d2cb-46b1-8505-1418b345f941 1073741824" returned: 0 in 0.641s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:45:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-47e52326-cbeb-4847-bdf8-a14c195600f5 tempest-ServerActionsTestOtherA-1140651778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c679adbf-d2cb-46b1-8505-1418b345f941 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:45:15 devstack sudo[91819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c679adbf-d2cb-46b1-8505-1418b345f941 Sep 08 06:45:15 devstack sudo[91819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:45:16 devstack sudo[91819]: pam_unix(sudo:session): session closed for user root Sep 08 06:45:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-47e52326-cbeb-4847-bdf8-a14c195600f5 tempest-ServerActionsTestOtherA-1140651778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c679adbf-d2cb-46b1-8505-1418b345f941" returned: 0 in 0.642s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:45:16 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-47e52326-cbeb-4847-bdf8-a14c195600f5 tempest-ServerActionsTestOtherA-1140651778 None] <== create_volume: return (1342ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:45:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-47e52326-cbeb-4847-bdf8-a14c195600f5 tempest-ServerActionsTestOtherA-1140651778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.346s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:45:16 devstack cinder-volume[87507]: DEBUG cinder.volume.volume_utils [None req-47e52326-cbeb-4847-bdf8-a14c195600f5 tempest-ServerActionsTestOtherA-1140651778 None] Attempting download of 69da6bac-8b7b-48c5-af3b-29466563452a ((None, [{'url': 'file:///opt/stack/data/glance/images/69da6bac-8b7b-48c5-af3b-29466563452a', 'metadata': {}}])) to volume c679adbf-d2cb-46b1-8505-1418b345f941. {{(pid=87507) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 08 06:45:16 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0245318-0f07-47b3-b548-4ad1a4c0dd4d]: (4, 'raw') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:45:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-47e52326-cbeb-4847-bdf8-a14c195600f5 tempest-ServerActionsTestOtherA-1140651778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_69da6bac-8b7b-48c5-af3b-29466563452a_78fm_i8_ {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:45:16 devstack sudo[91838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_69da6bac-8b7b-48c5-af3b-29466563452a_78fm_i8_ Sep 08 06:45:16 devstack sudo[91838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:45:17 devstack sudo[91838]: pam_unix(sudo:session): session closed for user root Sep 08 06:45:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-47e52326-cbeb-4847-bdf8-a14c195600f5 tempest-ServerActionsTestOtherA-1140651778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_69da6bac-8b7b-48c5-af3b-29466563452a_78fm_i8_" returned: 0 in 0.524s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:45:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-47e52326-cbeb-4847-bdf8-a14c195600f5 tempest-ServerActionsTestOtherA-1140651778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_69da6bac-8b7b-48c5-af3b-29466563452a_78fm_i8_ {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:45:17 devstack sudo[91844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_69da6bac-8b7b-48c5-af3b-29466563452a_78fm_i8_ Sep 08 06:45:17 devstack sudo[91844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:45:17 devstack sudo[91844]: pam_unix(sudo:session): session closed for user root Sep 08 06:45:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-47e52326-cbeb-4847-bdf8-a14c195600f5 tempest-ServerActionsTestOtherA-1140651778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_69da6bac-8b7b-48c5-af3b-29466563452a_78fm_i8_" returned: 1 in 0.590s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:45:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-47e52326-cbeb-4847-bdf8-a14c195600f5 tempest-ServerActionsTestOtherA-1140651778 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_69da6bac-8b7b-48c5-af3b-29466563452a_78fm_i8_' failed. Not Retrying. {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 06:45:17 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6678b933-7136-46e0-9f1f-8018a30ff5e3]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:45:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-47e52326-cbeb-4847-bdf8-a14c195600f5 tempest-ServerActionsTestOtherA-1140651778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_cdlmnsscdevstack@QuobyteHD {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:45:17 devstack sudo[91851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_cdlmnsscdevstack@QuobyteHD Sep 08 06:45:17 devstack sudo[91851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:45:18 devstack sudo[91851]: pam_unix(sudo:session): session closed for user root Sep 08 06:45:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-47e52326-cbeb-4847-bdf8-a14c195600f5 tempest-ServerActionsTestOtherA-1140651778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_cdlmnsscdevstack@QuobyteHD" returned: 0 in 0.615s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:45:18 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-47e52326-cbeb-4847-bdf8-a14c195600f5 tempest-ServerActionsTestOtherA-1140651778 None] 69da6bac-8b7b-48c5-af3b-29466563452a was qcow2, converting to qcow2 {{(pid=87507) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 08 06:45:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-47e52326-cbeb-4847-bdf8-a14c195600f5 tempest-ServerActionsTestOtherA-1140651778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_cdlmnsscdevstack@QuobyteHD /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c679adbf-d2cb-46b1-8505-1418b345f941 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:45:18 devstack sudo[91858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_cdlmnsscdevstack@QuobyteHD /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c679adbf-d2cb-46b1-8505-1418b345f941 Sep 08 06:45:18 devstack sudo[91858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:45:19 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c0b59ea-91f8-4e03-b5a2-c89fd82161fe tempest-VolumesMetadataTest-588513960 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:45:19 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9c0b59ea-91f8-4e03-b5a2-c89fd82161fe tempest-VolumesMetadataTest-588513960 None] Flow 'volume_create_manager' (2dcd4f87-722b-4cd5-b831-db6a012fba59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:45:19 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9c0b59ea-91f8-4e03-b5a2-c89fd82161fe tempest-VolumesMetadataTest-588513960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c7ac93a-f82e-4507-b2ef-c02c7c886244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:45:19 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9c0b59ea-91f8-4e03-b5a2-c89fd82161fe tempest-VolumesMetadataTest-588513960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c7ac93a-f82e-4507-b2ef-c02c7c886244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-313168419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec4d4944-93cf-45d3-938d-cb338756e59b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d38ed4a742834c6390d0070ea0db7f2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:45:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:45:20Z,use_quota=True,user_id='6877ed3e52744481a83a606a1d8b3d6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:45:19 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9c0b59ea-91f8-4e03-b5a2-c89fd82161fe tempest-VolumesMetadataTest-588513960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (605a6291-e8dd-47a9-945e-d01acce1049c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:45:19 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9c0b59ea-91f8-4e03-b5a2-c89fd82161fe tempest-VolumesMetadataTest-588513960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (605a6291-e8dd-47a9-945e-d01acce1049c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:45:19 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9c0b59ea-91f8-4e03-b5a2-c89fd82161fe tempest-VolumesMetadataTest-588513960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1f6094d-69ff-404c-9c70-3b01aaa413e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:45:19 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9c0b59ea-91f8-4e03-b5a2-c89fd82161fe tempest-VolumesMetadataTest-588513960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1f6094d-69ff-404c-9c70-3b01aaa413e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec4d4944-93cf-45d3-938d-cb338756e59b', 'volume_name': 'volume-ec4d4944-93cf-45d3-938d-cb338756e59b', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:45:19 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9c0b59ea-91f8-4e03-b5a2-c89fd82161fe tempest-VolumesMetadataTest-588513960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec819232-e4f9-4582-8067-9a5d9553c80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:45:19 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9c0b59ea-91f8-4e03-b5a2-c89fd82161fe tempest-VolumesMetadataTest-588513960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec819232-e4f9-4582-8067-9a5d9553c80e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:45:19 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9c0b59ea-91f8-4e03-b5a2-c89fd82161fe tempest-VolumesMetadataTest-588513960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2583f722-eeee-43fd-9884-2c96388d7904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:45:19 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-9c0b59ea-91f8-4e03-b5a2-c89fd82161fe tempest-VolumesMetadataTest-588513960 None] Volume ec4d4944-93cf-45d3-938d-cb338756e59b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec4d4944-93cf-45d3-938d-cb338756e59b', 'volume_size': 1} Sep 08 06:45:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-9c0b59ea-91f8-4e03-b5a2-c89fd82161fe tempest-VolumesMetadataTest-588513960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:45:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-9c0b59ea-91f8-4e03-b5a2-c89fd82161fe tempest-VolumesMetadataTest-588513960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:45:19 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-9c0b59ea-91f8-4e03-b5a2-c89fd82161fe tempest-VolumesMetadataTest-588513960 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-313168419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec4d4944-93cf-45d3-938d-cb338756e59b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d38ed4a742834c6390d0070ea0db7f2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:45:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:45:20Z,use_quota=True,user_id='6877ed3e52744481a83a606a1d8b3d6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:45:19 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-9c0b59ea-91f8-4e03-b5a2-c89fd82161fe tempest-VolumesMetadataTest-588513960 None] Creating volume ec4d4944-93cf-45d3-938d-cb338756e59b {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:45:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-9c0b59ea-91f8-4e03-b5a2-c89fd82161fe tempest-VolumesMetadataTest-588513960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:45:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-9c0b59ea-91f8-4e03-b5a2-c89fd82161fe tempest-VolumesMetadataTest-588513960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:45:19 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-9c0b59ea-91f8-4e03-b5a2-c89fd82161fe tempest-VolumesMetadataTest-588513960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:45:19 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-9c0b59ea-91f8-4e03-b5a2-c89fd82161fe tempest-VolumesMetadataTest-588513960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:45:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-9c0b59ea-91f8-4e03-b5a2-c89fd82161fe tempest-VolumesMetadataTest-588513960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:45:19 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-9c0b59ea-91f8-4e03-b5a2-c89fd82161fe tempest-VolumesMetadataTest-588513960 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:45:19 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-9c0b59ea-91f8-4e03-b5a2-c89fd82161fe tempest-VolumesMetadataTest-588513960 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:45:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9c0b59ea-91f8-4e03-b5a2-c89fd82161fe tempest-VolumesMetadataTest-588513960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ec4d4944-93cf-45d3-938d-cb338756e59b 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:45:19 devstack sudo[91903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ec4d4944-93cf-45d3-938d-cb338756e59b 1073741824 Sep 08 06:45:19 devstack sudo[91903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:45:20 devstack cinder-volume[87507]: DEBUG oslo_service.periodic_task [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87507) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 06:45:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:45:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:45:20 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:45:20 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:45:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:45:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:45:20 devstack sudo[91906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:45:20 devstack sudo[91906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:45:20 devstack sudo[91906]: pam_unix(sudo:session): session closed for user root Sep 08 06:45:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.405s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:45:20 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:45:20 devstack sudo[91858]: pam_unix(sudo:session): session closed for user root Sep 08 06:45:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-47e52326-cbeb-4847-bdf8-a14c195600f5 tempest-ServerActionsTestOtherA-1140651778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_cdlmnsscdevstack@QuobyteHD /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c679adbf-d2cb-46b1-8505-1418b345f941" returned: 0 in 2.224s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:45:20 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-47e52326-cbeb-4847-bdf8-a14c195600f5 tempest-ServerActionsTestOtherA-1140651778 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_cdlmnsscdevstack@QuobyteHD, size 112.00 MB, duration 2.23 sec, destination /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c679adbf-d2cb-46b1-8505-1418b345f941 {{(pid=87507) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 06:45:20 devstack cinder-volume[87507]: INFO cinder.image.image_utils [None req-47e52326-cbeb-4847-bdf8-a14c195600f5 tempest-ServerActionsTestOtherA-1140651778 None] Converted 112.00 MB image at 50.32 MB/s Sep 08 06:45:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-47e52326-cbeb-4847-bdf8-a14c195600f5 tempest-ServerActionsTestOtherA-1140651778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c679adbf-d2cb-46b1-8505-1418b345f941 1G {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:45:20 devstack sudo[91903]: pam_unix(sudo:session): session closed for user root Sep 08 06:45:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9c0b59ea-91f8-4e03-b5a2-c89fd82161fe tempest-VolumesMetadataTest-588513960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ec4d4944-93cf-45d3-938d-cb338756e59b 1073741824" returned: 0 in 0.701s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:45:20 devstack sudo[91931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c679adbf-d2cb-46b1-8505-1418b345f941 1G Sep 08 06:45:20 devstack sudo[91931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:45:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9c0b59ea-91f8-4e03-b5a2-c89fd82161fe tempest-VolumesMetadataTest-588513960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ec4d4944-93cf-45d3-938d-cb338756e59b {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:45:20 devstack sudo[91933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ec4d4944-93cf-45d3-938d-cb338756e59b Sep 08 06:45:20 devstack sudo[91933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:45:20 devstack sudo[91931]: pam_unix(sudo:session): session closed for user root Sep 08 06:45:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-47e52326-cbeb-4847-bdf8-a14c195600f5 tempest-ServerActionsTestOtherA-1140651778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c679adbf-d2cb-46b1-8505-1418b345f941 1G" returned: 0 in 0.407s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:45:20 devstack cinder-volume[87507]: DEBUG cinder.volume.volume_utils [None req-47e52326-cbeb-4847-bdf8-a14c195600f5 tempest-ServerActionsTestOtherA-1140651778 None] Downloaded image 69da6bac-8b7b-48c5-af3b-29466563452a ((None, [{'url': 'file:///opt/stack/data/glance/images/69da6bac-8b7b-48c5-af3b-29466563452a', 'metadata': {}}])) to volume c679adbf-d2cb-46b1-8505-1418b345f941 successfully. {{(pid=87507) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 08 06:45:20 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-47e52326-cbeb-4847-bdf8-a14c195600f5 tempest-ServerActionsTestOtherA-1140651778 None] Temporary image 69da6bac-8b7b-48c5-af3b-29466563452a for user 51fad9ee2f914a86b41aba71fa7f48aa is deleted. {{(pid=87507) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 08 06:45:20 devstack cinder-volume[87507]: DEBUG cinder.volume.volume_utils [None req-47e52326-cbeb-4847-bdf8-a14c195600f5 tempest-ServerActionsTestOtherA-1140651778 None] Marking volume c679adbf-d2cb-46b1-8505-1418b345f941 as bootable. {{(pid=87507) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 08 06:45:20 devstack sudo[91933]: pam_unix(sudo:session): session closed for user root Sep 08 06:45:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9c0b59ea-91f8-4e03-b5a2-c89fd82161fe tempest-VolumesMetadataTest-588513960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ec4d4944-93cf-45d3-938d-cb338756e59b" returned: 0 in 0.355s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:45:20 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-9c0b59ea-91f8-4e03-b5a2-c89fd82161fe tempest-VolumesMetadataTest-588513960 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:45:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-9c0b59ea-91f8-4e03-b5a2-c89fd82161fe tempest-VolumesMetadataTest-588513960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:45:21 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-47e52326-cbeb-4847-bdf8-a14c195600f5 tempest-ServerActionsTestOtherA-1140651778 None] Copying metadata from image 69da6bac-8b7b-48c5-af3b-29466563452a to c679adbf-d2cb-46b1-8505-1418b345f941. {{(pid=87507) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 08 06:45:21 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-47e52326-cbeb-4847-bdf8-a14c195600f5 tempest-ServerActionsTestOtherA-1140651778 None] Creating volume glance metadata for volume c679adbf-d2cb-46b1-8505-1418b345f941 backed by image 69da6bac-8b7b-48c5-af3b-29466563452a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '69da6bac-8b7b-48c5-af3b-29466563452a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87507) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 08 06:45:21 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9c0b59ea-91f8-4e03-b5a2-c89fd82161fe tempest-VolumesMetadataTest-588513960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2583f722-eeee-43fd-9884-2c96388d7904) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec4d4944-93cf-45d3-938d-cb338756e59b', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:45:21 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9c0b59ea-91f8-4e03-b5a2-c89fd82161fe tempest-VolumesMetadataTest-588513960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ba47a4c-f58d-4dab-b2f0-c488ea689f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:45:21 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-9c0b59ea-91f8-4e03-b5a2-c89fd82161fe tempest-VolumesMetadataTest-588513960 None] Volume volume-ec4d4944-93cf-45d3-938d-cb338756e59b (ec4d4944-93cf-45d3-938d-cb338756e59b): created successfully Sep 08 06:45:21 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9c0b59ea-91f8-4e03-b5a2-c89fd82161fe tempest-VolumesMetadataTest-588513960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ba47a4c-f58d-4dab-b2f0-c488ea689f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:45:21 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9c0b59ea-91f8-4e03-b5a2-c89fd82161fe tempest-VolumesMetadataTest-588513960 None] Flow 'volume_create_manager' (2dcd4f87-722b-4cd5-b831-db6a012fba59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:45:21 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-9c0b59ea-91f8-4e03-b5a2-c89fd82161fe tempest-VolumesMetadataTest-588513960 None] Created volume successfully. Sep 08 06:45:21 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-47e52326-cbeb-4847-bdf8-a14c195600f5 tempest-ServerActionsTestOtherA-1140651778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0494130c-cdb8-4a41-9795-2542a3689912) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c679adbf-d2cb-46b1-8505-1418b345f941', 'volume_size': 1, 'image_id': '69da6bac-8b7b-48c5-af3b-29466563452a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/69da6bac-8b7b-48c5-af3b-29466563452a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '95d2d5dbb3e04d74b8da31fc6ee47f98', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '69da6bac-8b7b-48c5-af3b-29466563452a', 'created_at': datetime.datetime(2026, 9, 8, 4, 36, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 4, 36, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/69da6bac-8b7b-48c5-af3b-29466563452a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:45:21 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-47e52326-cbeb-4847-bdf8-a14c195600f5 tempest-ServerActionsTestOtherA-1140651778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c00b225-703d-4da3-93ab-18b3ce9df42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:45:21 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-47e52326-cbeb-4847-bdf8-a14c195600f5 tempest-ServerActionsTestOtherA-1140651778 None] Volume volume-c679adbf-d2cb-46b1-8505-1418b345f941 (c679adbf-d2cb-46b1-8505-1418b345f941): created successfully Sep 08 06:45:21 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-47e52326-cbeb-4847-bdf8-a14c195600f5 tempest-ServerActionsTestOtherA-1140651778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c00b225-703d-4da3-93ab-18b3ce9df42a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:45:21 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-47e52326-cbeb-4847-bdf8-a14c195600f5 tempest-ServerActionsTestOtherA-1140651778 None] Flow 'volume_create_manager' (b2364336-d630-41d2-aa32-3404f357f93d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:45:21 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-47e52326-cbeb-4847-bdf8-a14c195600f5 tempest-ServerActionsTestOtherA-1140651778 None] Created volume successfully. Sep 08 06:45:22 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-3e33b1ae-7e2e-46d3-ad92-0b385af6f678 tempest-VolumesMetadataTest-588513960 None] Acquiring lock "cinder-ec4d4944-93cf-45d3-938d-cb338756e59b-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:45:22 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-3e33b1ae-7e2e-46d3-ad92-0b385af6f678 tempest-VolumesMetadataTest-588513960 None] Lock "cinder-ec4d4944-93cf-45d3-938d-cb338756e59b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:45:22 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-3e33b1ae-7e2e-46d3-ad92-0b385af6f678 tempest-VolumesMetadataTest-588513960 None] Acquiring lock "cinder-quobyte-ec4d4944-93cf-45d3-938d-cb338756e59b" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:45:22 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-3e33b1ae-7e2e-46d3-ad92-0b385af6f678 tempest-VolumesMetadataTest-588513960 None] Lock "cinder-quobyte-ec4d4944-93cf-45d3-938d-cb338756e59b" acquired by "delete_volume" :: waited 0.024s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:45:22 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bef6952-f04b-4edc-bc87-a32caab3f24f]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:45:22 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3e33b1ae-7e2e-46d3-ad92-0b385af6f678 tempest-VolumesMetadataTest-588513960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ec4d4944-93cf-45d3-938d-cb338756e59b {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:45:23 devstack sudo[91955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ec4d4944-93cf-45d3-938d-cb338756e59b Sep 08 06:45:23 devstack sudo[91955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:45:23 devstack sudo[91955]: pam_unix(sudo:session): session closed for user root Sep 08 06:45:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3e33b1ae-7e2e-46d3-ad92-0b385af6f678 tempest-VolumesMetadataTest-588513960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ec4d4944-93cf-45d3-938d-cb338756e59b" returned: 0 in 0.393s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:45:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3e33b1ae-7e2e-46d3-ad92-0b385af6f678 tempest-VolumesMetadataTest-588513960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ec4d4944-93cf-45d3-938d-cb338756e59b {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:45:23 devstack sudo[91962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ec4d4944-93cf-45d3-938d-cb338756e59b Sep 08 06:45:23 devstack sudo[91962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:45:23 devstack sudo[91962]: pam_unix(sudo:session): session closed for user root Sep 08 06:45:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3e33b1ae-7e2e-46d3-ad92-0b385af6f678 tempest-VolumesMetadataTest-588513960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ec4d4944-93cf-45d3-938d-cb338756e59b" returned: 0 in 0.289s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:45:23 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-3e33b1ae-7e2e-46d3-ad92-0b385af6f678 tempest-VolumesMetadataTest-588513960 None] Lock "cinder-quobyte-ec4d4944-93cf-45d3-938d-cb338756e59b" released by "delete_volume" :: held 0.733s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:45:23 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-3e33b1ae-7e2e-46d3-ad92-0b385af6f678 tempest-VolumesMetadataTest-588513960 None] Created reservations ['21e5373c-c6d5-4153-9dc2-f4d6a9086468', 'd1f2025d-5e2c-49d9-b466-0dc78862eb5d', '5a053501-3731-41c7-990d-5f9be2dc0e35', '59828a1a-7d11-422a-bdce-644ab9bf77ef'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:45:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-3e33b1ae-7e2e-46d3-ad92-0b385af6f678 tempest-VolumesMetadataTest-588513960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:45:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-3e33b1ae-7e2e-46d3-ad92-0b385af6f678 tempest-VolumesMetadataTest-588513960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:45:23 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-3e33b1ae-7e2e-46d3-ad92-0b385af6f678 tempest-VolumesMetadataTest-588513960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:45:23 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-3e33b1ae-7e2e-46d3-ad92-0b385af6f678 tempest-VolumesMetadataTest-588513960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:45:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-3e33b1ae-7e2e-46d3-ad92-0b385af6f678 tempest-VolumesMetadataTest-588513960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:45:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3e33b1ae-7e2e-46d3-ad92-0b385af6f678 tempest-VolumesMetadataTest-588513960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:45:23 devstack sudo[91965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:45:23 devstack sudo[91965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:45:24 devstack sudo[91965]: pam_unix(sudo:session): session closed for user root Sep 08 06:45:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3e33b1ae-7e2e-46d3-ad92-0b385af6f678 tempest-VolumesMetadataTest-588513960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.295s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:45:24 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-3e33b1ae-7e2e-46d3-ad92-0b385af6f678 tempest-VolumesMetadataTest-588513960 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:45:24 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-3e33b1ae-7e2e-46d3-ad92-0b385af6f678 tempest-VolumesMetadataTest-588513960 None] Deleted volume successfully. Sep 08 06:45:24 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-3e33b1ae-7e2e-46d3-ad92-0b385af6f678 tempest-VolumesMetadataTest-588513960 None] Lock "cinder-ec4d4944-93cf-45d3-938d-cb338756e59b-delete_volume" released by "delete_volume" :: held 1.342s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:45:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-599af15d-879e-411b-985e-3c4e3c0c6815 req-3144af0b-375a-4713-81b2-88f80a602e82 tempest-ServerActionsTestOtherA-1140651778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:45:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-599af15d-879e-411b-985e-3c4e3c0c6815 req-3144af0b-375a-4713-81b2-88f80a602e82 tempest-ServerActionsTestOtherA-1140651778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:45:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-599af15d-879e-411b-985e-3c4e3c0c6815 req-3144af0b-375a-4713-81b2-88f80a602e82 tempest-ServerActionsTestOtherA-1140651778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:45:24 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-599af15d-879e-411b-985e-3c4e3c0c6815 req-3144af0b-375a-4713-81b2-88f80a602e82 tempest-ServerActionsTestOtherA-1140651778 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d', 'name': 'volume-c679adbf-d2cb-46b1-8505-1418b345f941', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a0f7d2ed-49a5-49ea-8ecd-9f90cb9eb1ed', 'enforce_multipath': True} {{(pid=87507) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 06:45:24 devstack cinder-volume[87507]: INFO cinder.volume.manager [req-599af15d-879e-411b-985e-3c4e3c0c6815 req-3144af0b-375a-4713-81b2-88f80a602e82 tempest-ServerActionsTestOtherA-1140651778 None] attachment_update completed successfully. Sep 08 06:45:25 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-2019cd2f-ff46-4d87-99fa-94b10966e4c9 tempest-TaggedAttachmentsTest-1974514162 None] Acquiring lock "cinder-a50711e2-6cb8-4633-b27d-e3c8139aac33-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:45:25 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-2019cd2f-ff46-4d87-99fa-94b10966e4c9 tempest-TaggedAttachmentsTest-1974514162 None] Lock "cinder-a50711e2-6cb8-4633-b27d-e3c8139aac33-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:45:25 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-2019cd2f-ff46-4d87-99fa-94b10966e4c9 tempest-TaggedAttachmentsTest-1974514162 None] Acquiring lock "cinder-quobyte-a50711e2-6cb8-4633-b27d-e3c8139aac33" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:45:25 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-2019cd2f-ff46-4d87-99fa-94b10966e4c9 tempest-TaggedAttachmentsTest-1974514162 None] Lock "cinder-quobyte-a50711e2-6cb8-4633-b27d-e3c8139aac33" acquired by "delete_volume" :: waited 0.036s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:45:25 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e6becda-40ee-43f8-8840-640274183e48]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:45:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2019cd2f-ff46-4d87-99fa-94b10966e4c9 tempest-TaggedAttachmentsTest-1974514162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a50711e2-6cb8-4633-b27d-e3c8139aac33 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:45:25 devstack sudo[91977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a50711e2-6cb8-4633-b27d-e3c8139aac33 Sep 08 06:45:25 devstack sudo[91977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:45:26 devstack sudo[91977]: pam_unix(sudo:session): session closed for user root Sep 08 06:45:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2019cd2f-ff46-4d87-99fa-94b10966e4c9 tempest-TaggedAttachmentsTest-1974514162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a50711e2-6cb8-4633-b27d-e3c8139aac33" returned: 0 in 0.507s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:45:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2019cd2f-ff46-4d87-99fa-94b10966e4c9 tempest-TaggedAttachmentsTest-1974514162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a50711e2-6cb8-4633-b27d-e3c8139aac33 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:45:26 devstack sudo[91982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a50711e2-6cb8-4633-b27d-e3c8139aac33 Sep 08 06:45:26 devstack sudo[91982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:45:26 devstack sudo[91982]: pam_unix(sudo:session): session closed for user root Sep 08 06:45:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2019cd2f-ff46-4d87-99fa-94b10966e4c9 tempest-TaggedAttachmentsTest-1974514162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a50711e2-6cb8-4633-b27d-e3c8139aac33" returned: 0 in 0.290s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:45:26 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-2019cd2f-ff46-4d87-99fa-94b10966e4c9 tempest-TaggedAttachmentsTest-1974514162 None] Lock "cinder-quobyte-a50711e2-6cb8-4633-b27d-e3c8139aac33" released by "delete_volume" :: held 0.848s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:45:26 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-2019cd2f-ff46-4d87-99fa-94b10966e4c9 tempest-TaggedAttachmentsTest-1974514162 None] Created reservations ['fa4158bc-16b3-491f-b9de-b98d70646167', '20830b7d-4456-4d61-811f-dbffb9517897', 'cdd69b2a-6575-4770-8aa5-79432c61a98f', '95469f74-5829-4c7e-b905-17375219dcf9'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:45:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-2019cd2f-ff46-4d87-99fa-94b10966e4c9 tempest-TaggedAttachmentsTest-1974514162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:45:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-2019cd2f-ff46-4d87-99fa-94b10966e4c9 tempest-TaggedAttachmentsTest-1974514162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:45:26 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-2019cd2f-ff46-4d87-99fa-94b10966e4c9 tempest-TaggedAttachmentsTest-1974514162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:45:26 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-2019cd2f-ff46-4d87-99fa-94b10966e4c9 tempest-TaggedAttachmentsTest-1974514162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:45:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-2019cd2f-ff46-4d87-99fa-94b10966e4c9 tempest-TaggedAttachmentsTest-1974514162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:45:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2019cd2f-ff46-4d87-99fa-94b10966e4c9 tempest-TaggedAttachmentsTest-1974514162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:45:26 devstack sudo[91985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:45:26 devstack sudo[91985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:45:26 devstack sudo[91985]: pam_unix(sudo:session): session closed for user root Sep 08 06:45:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2019cd2f-ff46-4d87-99fa-94b10966e4c9 tempest-TaggedAttachmentsTest-1974514162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.386s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:45:26 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-2019cd2f-ff46-4d87-99fa-94b10966e4c9 tempest-TaggedAttachmentsTest-1974514162 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:45:26 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-2019cd2f-ff46-4d87-99fa-94b10966e4c9 tempest-TaggedAttachmentsTest-1974514162 None] Deleted volume successfully. Sep 08 06:45:26 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-2019cd2f-ff46-4d87-99fa-94b10966e4c9 tempest-TaggedAttachmentsTest-1974514162 None] Lock "cinder-a50711e2-6cb8-4633-b27d-e3c8139aac33-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:45:31 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a36b467-3dba-4604-8266-c602c5319e7c tempest-VolumesTransfersV357Test-2014161864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:45:31 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8a36b467-3dba-4604-8266-c602c5319e7c tempest-VolumesTransfersV357Test-2014161864 None] Flow 'volume_create_manager' (df83cab3-ed36-4cc2-8b75-1b38a18be48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:45:31 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8a36b467-3dba-4604-8266-c602c5319e7c tempest-VolumesTransfersV357Test-2014161864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (267db07a-9443-4aef-9de4-a967ac6e1882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:45:31 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8a36b467-3dba-4604-8266-c602c5319e7c tempest-VolumesTransfersV357Test-2014161864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (267db07a-9443-4aef-9de4-a967ac6e1882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:45:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-894772271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0464ca8f-acfe-4026-b855-21ee82204962,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ff9fec775d84c4f9921d947580623fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:45:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:45:32Z,use_quota=True,user_id='a6e8ba26ecee49f98912be27902e4fb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:45:31 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8a36b467-3dba-4604-8266-c602c5319e7c tempest-VolumesTransfersV357Test-2014161864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c76e7ae-ea12-412a-ab2f-ad1ea15d6dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:45:31 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8a36b467-3dba-4604-8266-c602c5319e7c tempest-VolumesTransfersV357Test-2014161864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c76e7ae-ea12-412a-ab2f-ad1ea15d6dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:45:31 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8a36b467-3dba-4604-8266-c602c5319e7c tempest-VolumesTransfersV357Test-2014161864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b81071a-945c-4a9c-bf82-4b964615caf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:45:31 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8a36b467-3dba-4604-8266-c602c5319e7c tempest-VolumesTransfersV357Test-2014161864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b81071a-945c-4a9c-bf82-4b964615caf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0464ca8f-acfe-4026-b855-21ee82204962', 'volume_name': 'volume-0464ca8f-acfe-4026-b855-21ee82204962', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:45:31 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8a36b467-3dba-4604-8266-c602c5319e7c tempest-VolumesTransfersV357Test-2014161864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (586413b9-0aea-49a0-be44-c9242c6791cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:45:31 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8a36b467-3dba-4604-8266-c602c5319e7c tempest-VolumesTransfersV357Test-2014161864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (586413b9-0aea-49a0-be44-c9242c6791cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:45:31 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8a36b467-3dba-4604-8266-c602c5319e7c tempest-VolumesTransfersV357Test-2014161864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bcc1c77-6f35-4b6e-bb5c-ad19d3989018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:45:31 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-8a36b467-3dba-4604-8266-c602c5319e7c tempest-VolumesTransfersV357Test-2014161864 None] Volume 0464ca8f-acfe-4026-b855-21ee82204962: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0464ca8f-acfe-4026-b855-21ee82204962', 'volume_size': 1} Sep 08 06:45:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8a36b467-3dba-4604-8266-c602c5319e7c tempest-VolumesTransfersV357Test-2014161864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:45:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8a36b467-3dba-4604-8266-c602c5319e7c tempest-VolumesTransfersV357Test-2014161864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:45:31 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8a36b467-3dba-4604-8266-c602c5319e7c tempest-VolumesTransfersV357Test-2014161864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:45:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-894772271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0464ca8f-acfe-4026-b855-21ee82204962,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ff9fec775d84c4f9921d947580623fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:45:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:45:32Z,use_quota=True,user_id='a6e8ba26ecee49f98912be27902e4fb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:45:31 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-8a36b467-3dba-4604-8266-c602c5319e7c tempest-VolumesTransfersV357Test-2014161864 None] Creating volume 0464ca8f-acfe-4026-b855-21ee82204962 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:45:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8a36b467-3dba-4604-8266-c602c5319e7c tempest-VolumesTransfersV357Test-2014161864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:45:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8a36b467-3dba-4604-8266-c602c5319e7c tempest-VolumesTransfersV357Test-2014161864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:45:31 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8a36b467-3dba-4604-8266-c602c5319e7c tempest-VolumesTransfersV357Test-2014161864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:45:31 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8a36b467-3dba-4604-8266-c602c5319e7c tempest-VolumesTransfersV357Test-2014161864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:45:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8a36b467-3dba-4604-8266-c602c5319e7c tempest-VolumesTransfersV357Test-2014161864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:45:31 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8a36b467-3dba-4604-8266-c602c5319e7c tempest-VolumesTransfersV357Test-2014161864 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:45:31 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-8a36b467-3dba-4604-8266-c602c5319e7c tempest-VolumesTransfersV357Test-2014161864 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:45:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8a36b467-3dba-4604-8266-c602c5319e7c tempest-VolumesTransfersV357Test-2014161864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0464ca8f-acfe-4026-b855-21ee82204962 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:45:32 devstack sudo[92415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0464ca8f-acfe-4026-b855-21ee82204962 1073741824 Sep 08 06:45:32 devstack sudo[92415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:45:32 devstack sudo[92415]: pam_unix(sudo:session): session closed for user root Sep 08 06:45:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8a36b467-3dba-4604-8266-c602c5319e7c tempest-VolumesTransfersV357Test-2014161864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0464ca8f-acfe-4026-b855-21ee82204962 1073741824" returned: 0 in 0.833s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:45:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8a36b467-3dba-4604-8266-c602c5319e7c tempest-VolumesTransfersV357Test-2014161864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0464ca8f-acfe-4026-b855-21ee82204962 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:45:32 devstack sudo[92425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0464ca8f-acfe-4026-b855-21ee82204962 Sep 08 06:45:32 devstack sudo[92425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:45:33 devstack sudo[92425]: pam_unix(sudo:session): session closed for user root Sep 08 06:45:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8a36b467-3dba-4604-8266-c602c5319e7c tempest-VolumesTransfersV357Test-2014161864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0464ca8f-acfe-4026-b855-21ee82204962" returned: 0 in 0.516s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:45:33 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8a36b467-3dba-4604-8266-c602c5319e7c tempest-VolumesTransfersV357Test-2014161864 None] <== create_volume: return (1414ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:45:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8a36b467-3dba-4604-8266-c602c5319e7c tempest-VolumesTransfersV357Test-2014161864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.418s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:45:33 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8a36b467-3dba-4604-8266-c602c5319e7c tempest-VolumesTransfersV357Test-2014161864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bcc1c77-6f35-4b6e-bb5c-ad19d3989018) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0464ca8f-acfe-4026-b855-21ee82204962', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:45:33 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8a36b467-3dba-4604-8266-c602c5319e7c tempest-VolumesTransfersV357Test-2014161864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dcccdc4-0eed-467e-8595-0b0f64b16eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:45:33 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf0a7f29-9059-4055-bae2-e317705ea707 tempest-AttachVolumeNegativeTest-1461620538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:45:33 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-bf0a7f29-9059-4055-bae2-e317705ea707 tempest-AttachVolumeNegativeTest-1461620538 None] Flow 'volume_create_manager' (64c51496-990a-433e-81a4-0f3ccbd77521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:45:33 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-bf0a7f29-9059-4055-bae2-e317705ea707 tempest-AttachVolumeNegativeTest-1461620538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7492d4c-282e-4e99-ab5d-1bc5a4da5b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:45:33 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-8a36b467-3dba-4604-8266-c602c5319e7c tempest-VolumesTransfersV357Test-2014161864 None] Volume volume-0464ca8f-acfe-4026-b855-21ee82204962 (0464ca8f-acfe-4026-b855-21ee82204962): created successfully Sep 08 06:45:33 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8a36b467-3dba-4604-8266-c602c5319e7c tempest-VolumesTransfersV357Test-2014161864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dcccdc4-0eed-467e-8595-0b0f64b16eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:45:33 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8a36b467-3dba-4604-8266-c602c5319e7c tempest-VolumesTransfersV357Test-2014161864 None] Flow 'volume_create_manager' (df83cab3-ed36-4cc2-8b75-1b38a18be48c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:45:33 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-bf0a7f29-9059-4055-bae2-e317705ea707 tempest-AttachVolumeNegativeTest-1461620538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7492d4c-282e-4e99-ab5d-1bc5a4da5b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:45:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2056186823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03d8cb92-c181-4d00-9c2a-c5ef34ba7477,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ce0c24857024850a79b0c7619a73fd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:45:33Z,use_quota=True,user_id='006c16241bf445aaa778b41186274e8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:45:33 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-bf0a7f29-9059-4055-bae2-e317705ea707 tempest-AttachVolumeNegativeTest-1461620538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b2abf84-18f4-4c3d-af73-44701cacb0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:45:33 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-bf0a7f29-9059-4055-bae2-e317705ea707 tempest-AttachVolumeNegativeTest-1461620538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b2abf84-18f4-4c3d-af73-44701cacb0a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:45:33 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-bf0a7f29-9059-4055-bae2-e317705ea707 tempest-AttachVolumeNegativeTest-1461620538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3667f67-3916-4307-bfa5-8561659ccd30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:45:33 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-bf0a7f29-9059-4055-bae2-e317705ea707 tempest-AttachVolumeNegativeTest-1461620538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3667f67-3916-4307-bfa5-8561659ccd30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03d8cb92-c181-4d00-9c2a-c5ef34ba7477', 'volume_name': 'volume-03d8cb92-c181-4d00-9c2a-c5ef34ba7477', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:45:33 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-bf0a7f29-9059-4055-bae2-e317705ea707 tempest-AttachVolumeNegativeTest-1461620538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ad82629-fec9-4524-b180-b180d947f804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:45:33 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-bf0a7f29-9059-4055-bae2-e317705ea707 tempest-AttachVolumeNegativeTest-1461620538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ad82629-fec9-4524-b180-b180d947f804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:45:33 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-bf0a7f29-9059-4055-bae2-e317705ea707 tempest-AttachVolumeNegativeTest-1461620538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35a2edd3-df52-4b70-b7b0-761a18944e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:45:33 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-bf0a7f29-9059-4055-bae2-e317705ea707 tempest-AttachVolumeNegativeTest-1461620538 None] Volume 03d8cb92-c181-4d00-9c2a-c5ef34ba7477: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03d8cb92-c181-4d00-9c2a-c5ef34ba7477', 'volume_size': 1} Sep 08 06:45:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-bf0a7f29-9059-4055-bae2-e317705ea707 tempest-AttachVolumeNegativeTest-1461620538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:45:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-bf0a7f29-9059-4055-bae2-e317705ea707 tempest-AttachVolumeNegativeTest-1461620538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:45:33 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-bf0a7f29-9059-4055-bae2-e317705ea707 tempest-AttachVolumeNegativeTest-1461620538 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:45:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2056186823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03d8cb92-c181-4d00-9c2a-c5ef34ba7477,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ce0c24857024850a79b0c7619a73fd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:45:33Z,use_quota=True,user_id='006c16241bf445aaa778b41186274e8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:45:33 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-bf0a7f29-9059-4055-bae2-e317705ea707 tempest-AttachVolumeNegativeTest-1461620538 None] Creating volume 03d8cb92-c181-4d00-9c2a-c5ef34ba7477 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:45:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-bf0a7f29-9059-4055-bae2-e317705ea707 tempest-AttachVolumeNegativeTest-1461620538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:45:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-bf0a7f29-9059-4055-bae2-e317705ea707 tempest-AttachVolumeNegativeTest-1461620538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:45:33 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-bf0a7f29-9059-4055-bae2-e317705ea707 tempest-AttachVolumeNegativeTest-1461620538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:45:33 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-bf0a7f29-9059-4055-bae2-e317705ea707 tempest-AttachVolumeNegativeTest-1461620538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:45:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-bf0a7f29-9059-4055-bae2-e317705ea707 tempest-AttachVolumeNegativeTest-1461620538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:45:33 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-bf0a7f29-9059-4055-bae2-e317705ea707 tempest-AttachVolumeNegativeTest-1461620538 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:45:33 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-bf0a7f29-9059-4055-bae2-e317705ea707 tempest-AttachVolumeNegativeTest-1461620538 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:45:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bf0a7f29-9059-4055-bae2-e317705ea707 tempest-AttachVolumeNegativeTest-1461620538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-03d8cb92-c181-4d00-9c2a-c5ef34ba7477 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:45:33 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-8a36b467-3dba-4604-8266-c602c5319e7c tempest-VolumesTransfersV357Test-2014161864 None] Created volume successfully. Sep 08 06:45:33 devstack sudo[92431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-03d8cb92-c181-4d00-9c2a-c5ef34ba7477 1073741824 Sep 08 06:45:33 devstack sudo[92431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:45:34 devstack sudo[92431]: pam_unix(sudo:session): session closed for user root Sep 08 06:45:34 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bf0a7f29-9059-4055-bae2-e317705ea707 tempest-AttachVolumeNegativeTest-1461620538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-03d8cb92-c181-4d00-9c2a-c5ef34ba7477 1073741824" returned: 0 in 0.810s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:45:34 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bf0a7f29-9059-4055-bae2-e317705ea707 tempest-AttachVolumeNegativeTest-1461620538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-03d8cb92-c181-4d00-9c2a-c5ef34ba7477 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:45:34 devstack sudo[92441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-03d8cb92-c181-4d00-9c2a-c5ef34ba7477 Sep 08 06:45:34 devstack sudo[92441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:45:34 devstack sudo[92441]: pam_unix(sudo:session): session closed for user root Sep 08 06:45:34 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bf0a7f29-9059-4055-bae2-e317705ea707 tempest-AttachVolumeNegativeTest-1461620538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-03d8cb92-c181-4d00-9c2a-c5ef34ba7477" returned: 0 in 0.352s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:45:34 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-bf0a7f29-9059-4055-bae2-e317705ea707 tempest-AttachVolumeNegativeTest-1461620538 None] <== create_volume: return (1257ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:45:34 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-bf0a7f29-9059-4055-bae2-e317705ea707 tempest-AttachVolumeNegativeTest-1461620538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.268s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:45:34 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-bf0a7f29-9059-4055-bae2-e317705ea707 tempest-AttachVolumeNegativeTest-1461620538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35a2edd3-df52-4b70-b7b0-761a18944e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03d8cb92-c181-4d00-9c2a-c5ef34ba7477', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:45:34 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-bf0a7f29-9059-4055-bae2-e317705ea707 tempest-AttachVolumeNegativeTest-1461620538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce8cd442-546e-472f-b613-b70ee8389958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:45:34 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-bf0a7f29-9059-4055-bae2-e317705ea707 tempest-AttachVolumeNegativeTest-1461620538 None] Volume volume-03d8cb92-c181-4d00-9c2a-c5ef34ba7477 (03d8cb92-c181-4d00-9c2a-c5ef34ba7477): created successfully Sep 08 06:45:34 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-bf0a7f29-9059-4055-bae2-e317705ea707 tempest-AttachVolumeNegativeTest-1461620538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce8cd442-546e-472f-b613-b70ee8389958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:45:34 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-bf0a7f29-9059-4055-bae2-e317705ea707 tempest-AttachVolumeNegativeTest-1461620538 None] Flow 'volume_create_manager' (64c51496-990a-433e-81a4-0f3ccbd77521) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:45:34 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-bf0a7f29-9059-4055-bae2-e317705ea707 tempest-AttachVolumeNegativeTest-1461620538 None] Created volume successfully. Sep 08 06:45:35 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-58d22ad4-d654-402c-a923-a3920d3ec385 tempest-VolumesTransfersV357Test-1394789408 None] Transfer volume completed successfully. Sep 08 06:45:36 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-024a8646-40c8-4d6b-8c9d-6bf7f16f15a9 tempest-VolumesTransfersV357Test-821703880 None] Acquiring lock "cinder-0464ca8f-acfe-4026-b855-21ee82204962-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:45:36 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-024a8646-40c8-4d6b-8c9d-6bf7f16f15a9 tempest-VolumesTransfersV357Test-821703880 None] Lock "cinder-0464ca8f-acfe-4026-b855-21ee82204962-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:45:36 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-024a8646-40c8-4d6b-8c9d-6bf7f16f15a9 tempest-VolumesTransfersV357Test-821703880 None] Acquiring lock "cinder-quobyte-0464ca8f-acfe-4026-b855-21ee82204962" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:45:36 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-024a8646-40c8-4d6b-8c9d-6bf7f16f15a9 tempest-VolumesTransfersV357Test-821703880 None] Lock "cinder-quobyte-0464ca8f-acfe-4026-b855-21ee82204962" acquired by "delete_volume" :: waited 0.031s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:45:36 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[855b6910-eb75-4073-911d-417ba401d878]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:45:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-024a8646-40c8-4d6b-8c9d-6bf7f16f15a9 tempest-VolumesTransfersV357Test-821703880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0464ca8f-acfe-4026-b855-21ee82204962 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:45:36 devstack sudo[92457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0464ca8f-acfe-4026-b855-21ee82204962 Sep 08 06:45:36 devstack sudo[92457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:45:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-06205008-fbf1-455b-9525-10aac82402b3 req-639f9a6f-d2d0-4c77-b065-66a1cf8eba18 tempest-AttachVolumeNegativeTest-1461620538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:45:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-06205008-fbf1-455b-9525-10aac82402b3 req-639f9a6f-d2d0-4c77-b065-66a1cf8eba18 tempest-AttachVolumeNegativeTest-1461620538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:45:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-06205008-fbf1-455b-9525-10aac82402b3 req-639f9a6f-d2d0-4c77-b065-66a1cf8eba18 tempest-AttachVolumeNegativeTest-1461620538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:45:37 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-06205008-fbf1-455b-9525-10aac82402b3 req-639f9a6f-d2d0-4c77-b065-66a1cf8eba18 tempest-AttachVolumeNegativeTest-1461620538 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d', 'name': 'volume-03d8cb92-c181-4d00-9c2a-c5ef34ba7477', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3000da51-ca42-42ca-bb0e-cd459a190798', 'enforce_multipath': True} {{(pid=87507) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 06:45:37 devstack cinder-volume[87507]: INFO cinder.volume.manager [req-06205008-fbf1-455b-9525-10aac82402b3 req-639f9a6f-d2d0-4c77-b065-66a1cf8eba18 tempest-AttachVolumeNegativeTest-1461620538 None] attachment_update completed successfully. Sep 08 06:45:37 devstack sudo[92457]: pam_unix(sudo:session): session closed for user root Sep 08 06:45:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-024a8646-40c8-4d6b-8c9d-6bf7f16f15a9 tempest-VolumesTransfersV357Test-821703880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0464ca8f-acfe-4026-b855-21ee82204962" returned: 0 in 0.771s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:45:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-024a8646-40c8-4d6b-8c9d-6bf7f16f15a9 tempest-VolumesTransfersV357Test-821703880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0464ca8f-acfe-4026-b855-21ee82204962 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:45:37 devstack sudo[92468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0464ca8f-acfe-4026-b855-21ee82204962 Sep 08 06:45:37 devstack sudo[92468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:45:37 devstack sudo[92468]: pam_unix(sudo:session): session closed for user root Sep 08 06:45:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-024a8646-40c8-4d6b-8c9d-6bf7f16f15a9 tempest-VolumesTransfersV357Test-821703880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0464ca8f-acfe-4026-b855-21ee82204962" returned: 0 in 0.432s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:45:38 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-024a8646-40c8-4d6b-8c9d-6bf7f16f15a9 tempest-VolumesTransfersV357Test-821703880 None] Lock "cinder-quobyte-0464ca8f-acfe-4026-b855-21ee82204962" released by "delete_volume" :: held 1.314s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:45:38 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-024a8646-40c8-4d6b-8c9d-6bf7f16f15a9 tempest-VolumesTransfersV357Test-821703880 None] Created reservations ['2bb91b71-5713-4fd2-92e1-1926890d58dd', '34e1f6ad-4dd8-4d54-a574-4a6ed274ccd0', '3123b8cd-0308-43d0-892b-84580fbe2d08', '2126854c-35c0-4179-be65-eec6d1816f51'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:45:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-024a8646-40c8-4d6b-8c9d-6bf7f16f15a9 tempest-VolumesTransfersV357Test-821703880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:45:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-024a8646-40c8-4d6b-8c9d-6bf7f16f15a9 tempest-VolumesTransfersV357Test-821703880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:45:38 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-024a8646-40c8-4d6b-8c9d-6bf7f16f15a9 tempest-VolumesTransfersV357Test-821703880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:45:38 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-024a8646-40c8-4d6b-8c9d-6bf7f16f15a9 tempest-VolumesTransfersV357Test-821703880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:45:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-024a8646-40c8-4d6b-8c9d-6bf7f16f15a9 tempest-VolumesTransfersV357Test-821703880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:45:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-024a8646-40c8-4d6b-8c9d-6bf7f16f15a9 tempest-VolumesTransfersV357Test-821703880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:45:38 devstack sudo[92475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:45:38 devstack sudo[92475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:45:38 devstack sudo[92475]: pam_unix(sudo:session): session closed for user root Sep 08 06:45:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-024a8646-40c8-4d6b-8c9d-6bf7f16f15a9 tempest-VolumesTransfersV357Test-821703880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.375s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:45:38 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-024a8646-40c8-4d6b-8c9d-6bf7f16f15a9 tempest-VolumesTransfersV357Test-821703880 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:45:38 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-024a8646-40c8-4d6b-8c9d-6bf7f16f15a9 tempest-VolumesTransfersV357Test-821703880 None] Deleted volume successfully. Sep 08 06:45:38 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-024a8646-40c8-4d6b-8c9d-6bf7f16f15a9 tempest-VolumesTransfersV357Test-821703880 None] Lock "cinder-0464ca8f-acfe-4026-b855-21ee82204962-delete_volume" released by "delete_volume" :: held 2.134s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:45:40 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-2956c511-3a42-4d48-bed5-1cc2f6c165ec tempest-VolumesTransfersV357Test-2014161864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:45:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2956c511-3a42-4d48-bed5-1cc2f6c165ec tempest-VolumesTransfersV357Test-2014161864 None] Flow 'volume_create_manager' (6dd355f1-299e-40c8-8809-e887dd839406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:45:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2956c511-3a42-4d48-bed5-1cc2f6c165ec tempest-VolumesTransfersV357Test-2014161864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfcaeb19-1702-447d-8c2b-b0ba0f20072f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:45:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2956c511-3a42-4d48-bed5-1cc2f6c165ec tempest-VolumesTransfersV357Test-2014161864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfcaeb19-1702-447d-8c2b-b0ba0f20072f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:45:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2648936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9ae4e6d-d7bd-43f2-ab87-654edb9435dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ff9fec775d84c4f9921d947580623fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:45:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:45:40Z,use_quota=True,user_id='a6e8ba26ecee49f98912be27902e4fb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:45:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2956c511-3a42-4d48-bed5-1cc2f6c165ec tempest-VolumesTransfersV357Test-2014161864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1895aae9-24af-4d73-b3ce-9e98c9df4a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:45:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2956c511-3a42-4d48-bed5-1cc2f6c165ec tempest-VolumesTransfersV357Test-2014161864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1895aae9-24af-4d73-b3ce-9e98c9df4a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:45:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2956c511-3a42-4d48-bed5-1cc2f6c165ec tempest-VolumesTransfersV357Test-2014161864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e65c8f11-2304-489a-8b68-8486d623519c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:45:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2956c511-3a42-4d48-bed5-1cc2f6c165ec tempest-VolumesTransfersV357Test-2014161864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e65c8f11-2304-489a-8b68-8486d623519c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9ae4e6d-d7bd-43f2-ab87-654edb9435dc', 'volume_name': 'volume-a9ae4e6d-d7bd-43f2-ab87-654edb9435dc', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:45:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2956c511-3a42-4d48-bed5-1cc2f6c165ec tempest-VolumesTransfersV357Test-2014161864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d839807-af88-48a8-be4a-cfeffc3ac8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:45:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2956c511-3a42-4d48-bed5-1cc2f6c165ec tempest-VolumesTransfersV357Test-2014161864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d839807-af88-48a8-be4a-cfeffc3ac8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:45:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2956c511-3a42-4d48-bed5-1cc2f6c165ec tempest-VolumesTransfersV357Test-2014161864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cea3b021-400d-45ce-9325-fb4753880875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:45:40 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-2956c511-3a42-4d48-bed5-1cc2f6c165ec tempest-VolumesTransfersV357Test-2014161864 None] Volume a9ae4e6d-d7bd-43f2-ab87-654edb9435dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9ae4e6d-d7bd-43f2-ab87-654edb9435dc', 'volume_size': 1} Sep 08 06:45:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-2956c511-3a42-4d48-bed5-1cc2f6c165ec tempest-VolumesTransfersV357Test-2014161864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:45:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-2956c511-3a42-4d48-bed5-1cc2f6c165ec tempest-VolumesTransfersV357Test-2014161864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:45:40 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-2956c511-3a42-4d48-bed5-1cc2f6c165ec tempest-VolumesTransfersV357Test-2014161864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:45:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2648936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9ae4e6d-d7bd-43f2-ab87-654edb9435dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ff9fec775d84c4f9921d947580623fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:45:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:45:40Z,use_quota=True,user_id='a6e8ba26ecee49f98912be27902e4fb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:45:40 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-2956c511-3a42-4d48-bed5-1cc2f6c165ec tempest-VolumesTransfersV357Test-2014161864 None] Creating volume a9ae4e6d-d7bd-43f2-ab87-654edb9435dc {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:45:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-2956c511-3a42-4d48-bed5-1cc2f6c165ec tempest-VolumesTransfersV357Test-2014161864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:45:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-2956c511-3a42-4d48-bed5-1cc2f6c165ec tempest-VolumesTransfersV357Test-2014161864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:45:40 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-2956c511-3a42-4d48-bed5-1cc2f6c165ec tempest-VolumesTransfersV357Test-2014161864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:45:40 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-2956c511-3a42-4d48-bed5-1cc2f6c165ec tempest-VolumesTransfersV357Test-2014161864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:45:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-2956c511-3a42-4d48-bed5-1cc2f6c165ec tempest-VolumesTransfersV357Test-2014161864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:45:40 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-2956c511-3a42-4d48-bed5-1cc2f6c165ec tempest-VolumesTransfersV357Test-2014161864 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:45:40 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-2956c511-3a42-4d48-bed5-1cc2f6c165ec tempest-VolumesTransfersV357Test-2014161864 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:45:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2956c511-3a42-4d48-bed5-1cc2f6c165ec tempest-VolumesTransfersV357Test-2014161864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a9ae4e6d-d7bd-43f2-ab87-654edb9435dc 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:45:40 devstack sudo[92481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a9ae4e6d-d7bd-43f2-ab87-654edb9435dc 1073741824 Sep 08 06:45:40 devstack sudo[92481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:45:40 devstack cinder-volume[87507]: INFO cinder.volume.manager [req-8481ae85-ac7a-43ed-ba7b-47b768bc70b6 req-ae268d03-c288-44d9-89bd-10bc5a68ad48 tempest-AttachVolumeNegativeTest-1461620538 None] Terminate volume connection completed successfully. Sep 08 06:45:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-8481ae85-ac7a-43ed-ba7b-47b768bc70b6 req-ae268d03-c288-44d9-89bd-10bc5a68ad48 tempest-AttachVolumeNegativeTest-1461620538 None] Deleting attachment 3000da51-ca42-42ca-bb0e-cd459a190798. {{(pid=87507) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 06:45:41 devstack sudo[92481]: pam_unix(sudo:session): session closed for user root Sep 08 06:45:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2956c511-3a42-4d48-bed5-1cc2f6c165ec tempest-VolumesTransfersV357Test-2014161864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a9ae4e6d-d7bd-43f2-ab87-654edb9435dc 1073741824" returned: 0 in 0.884s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:45:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2956c511-3a42-4d48-bed5-1cc2f6c165ec tempest-VolumesTransfersV357Test-2014161864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a9ae4e6d-d7bd-43f2-ab87-654edb9435dc {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:45:41 devstack sudo[92491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a9ae4e6d-d7bd-43f2-ab87-654edb9435dc Sep 08 06:45:41 devstack sudo[92491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:45:41 devstack sudo[92491]: pam_unix(sudo:session): session closed for user root Sep 08 06:45:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2956c511-3a42-4d48-bed5-1cc2f6c165ec tempest-VolumesTransfersV357Test-2014161864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a9ae4e6d-d7bd-43f2-ab87-654edb9435dc" returned: 0 in 0.564s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:45:41 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-2956c511-3a42-4d48-bed5-1cc2f6c165ec tempest-VolumesTransfersV357Test-2014161864 None] <== create_volume: return (1540ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:45:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-2956c511-3a42-4d48-bed5-1cc2f6c165ec tempest-VolumesTransfersV357Test-2014161864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.546s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:45:41 devstack cinder-volume[87507]: DEBUG dbcounter [-] [87507] Writing DB stats cinder:UPDATE=75,cinder:SELECT=87,cinder:INSERT=27,cinder:DELETE=7 {{(pid=87507) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 06:45:41 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2956c511-3a42-4d48-bed5-1cc2f6c165ec tempest-VolumesTransfersV357Test-2014161864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cea3b021-400d-45ce-9325-fb4753880875) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9ae4e6d-d7bd-43f2-ab87-654edb9435dc', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:45:41 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2956c511-3a42-4d48-bed5-1cc2f6c165ec tempest-VolumesTransfersV357Test-2014161864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (694d1d5f-9c21-4c9a-900a-5bf34d4d09c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:45:42 devstack cinder-volume[87507]: DEBUG dbcounter [-] [87507] Writing DB stats cinder:SELECT=88,cinder:INSERT=31,cinder:UPDATE=76,cinder:DELETE=5 {{(pid=87507) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 06:45:42 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-2956c511-3a42-4d48-bed5-1cc2f6c165ec tempest-VolumesTransfersV357Test-2014161864 None] Volume volume-a9ae4e6d-d7bd-43f2-ab87-654edb9435dc (a9ae4e6d-d7bd-43f2-ab87-654edb9435dc): created successfully Sep 08 06:45:42 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2956c511-3a42-4d48-bed5-1cc2f6c165ec tempest-VolumesTransfersV357Test-2014161864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (694d1d5f-9c21-4c9a-900a-5bf34d4d09c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:45:42 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2956c511-3a42-4d48-bed5-1cc2f6c165ec tempest-VolumesTransfersV357Test-2014161864 None] Flow 'volume_create_manager' (6dd355f1-299e-40c8-8809-e887dd839406) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:45:42 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-2956c511-3a42-4d48-bed5-1cc2f6c165ec tempest-VolumesTransfersV357Test-2014161864 None] Created volume successfully. Sep 08 06:45:43 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-21971f45-d528-4805-b749-b7510f1ec426 tempest-VolumesTransfersV357Test-821703880 None] Acquiring lock "cinder-a9ae4e6d-d7bd-43f2-ab87-654edb9435dc-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:45:43 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-21971f45-d528-4805-b749-b7510f1ec426 tempest-VolumesTransfersV357Test-821703880 None] Lock "cinder-a9ae4e6d-d7bd-43f2-ab87-654edb9435dc-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:45:44 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-21971f45-d528-4805-b749-b7510f1ec426 tempest-VolumesTransfersV357Test-821703880 None] Acquiring lock "cinder-quobyte-a9ae4e6d-d7bd-43f2-ab87-654edb9435dc" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:45:44 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-21971f45-d528-4805-b749-b7510f1ec426 tempest-VolumesTransfersV357Test-821703880 None] Lock "cinder-quobyte-a9ae4e6d-d7bd-43f2-ab87-654edb9435dc" acquired by "delete_volume" :: waited 0.026s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:45:44 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[af568794-55bd-47f5-9b92-6488b71fff87]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:45:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-21971f45-d528-4805-b749-b7510f1ec426 tempest-VolumesTransfersV357Test-821703880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a9ae4e6d-d7bd-43f2-ab87-654edb9435dc {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:45:44 devstack cinder-volume[87507]: INFO cinder.volume.manager [req-62ea6516-ac7d-4b1e-84d8-7cb2e32ec507 req-5681feb5-d427-45b0-896e-198a2888ae37 tempest-ServerActionsTestOtherA-1140651778 None] Terminate volume connection completed successfully. Sep 08 06:45:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-62ea6516-ac7d-4b1e-84d8-7cb2e32ec507 req-5681feb5-d427-45b0-896e-198a2888ae37 tempest-ServerActionsTestOtherA-1140651778 None] Deleting attachment a0f7d2ed-49a5-49ea-8ecd-9f90cb9eb1ed. {{(pid=87507) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 06:45:44 devstack sudo[92560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a9ae4e6d-d7bd-43f2-ab87-654edb9435dc Sep 08 06:45:44 devstack sudo[92560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:45:44 devstack sudo[92560]: pam_unix(sudo:session): session closed for user root Sep 08 06:45:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-21971f45-d528-4805-b749-b7510f1ec426 tempest-VolumesTransfersV357Test-821703880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a9ae4e6d-d7bd-43f2-ab87-654edb9435dc" returned: 0 in 0.669s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:45:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-21971f45-d528-4805-b749-b7510f1ec426 tempest-VolumesTransfersV357Test-821703880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a9ae4e6d-d7bd-43f2-ab87-654edb9435dc {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:45:44 devstack sudo[92570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a9ae4e6d-d7bd-43f2-ab87-654edb9435dc Sep 08 06:45:44 devstack sudo[92570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:45:45 devstack sudo[92570]: pam_unix(sudo:session): session closed for user root Sep 08 06:45:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-21971f45-d528-4805-b749-b7510f1ec426 tempest-VolumesTransfersV357Test-821703880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a9ae4e6d-d7bd-43f2-ab87-654edb9435dc" returned: 0 in 0.496s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:45:45 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-21971f45-d528-4805-b749-b7510f1ec426 tempest-VolumesTransfersV357Test-821703880 None] Lock "cinder-quobyte-a9ae4e6d-d7bd-43f2-ab87-654edb9435dc" released by "delete_volume" :: held 1.260s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:45:45 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-21971f45-d528-4805-b749-b7510f1ec426 tempest-VolumesTransfersV357Test-821703880 None] Created reservations ['21261773-1b98-4f80-a338-7b9289653c3e', 'b201db1b-30f9-4957-b240-53fec47f5af4', '728048f8-f7bc-4e99-ad8e-823b87ad024e', 'e84845fd-21fc-47d7-b323-de21a71fe980'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:45:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-21971f45-d528-4805-b749-b7510f1ec426 tempest-VolumesTransfersV357Test-821703880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:45:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-21971f45-d528-4805-b749-b7510f1ec426 tempest-VolumesTransfersV357Test-821703880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:45:45 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-21971f45-d528-4805-b749-b7510f1ec426 tempest-VolumesTransfersV357Test-821703880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:45:45 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-21971f45-d528-4805-b749-b7510f1ec426 tempest-VolumesTransfersV357Test-821703880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:45:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-21971f45-d528-4805-b749-b7510f1ec426 tempest-VolumesTransfersV357Test-821703880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:45:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-21971f45-d528-4805-b749-b7510f1ec426 tempest-VolumesTransfersV357Test-821703880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:45:45 devstack sudo[92575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:45:45 devstack sudo[92575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:45:45 devstack sudo[92575]: pam_unix(sudo:session): session closed for user root Sep 08 06:45:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-21971f45-d528-4805-b749-b7510f1ec426 tempest-VolumesTransfersV357Test-821703880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.340s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:45:45 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-21971f45-d528-4805-b749-b7510f1ec426 tempest-VolumesTransfersV357Test-821703880 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:45:45 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-21971f45-d528-4805-b749-b7510f1ec426 tempest-VolumesTransfersV357Test-821703880 None] Deleted volume successfully. Sep 08 06:45:45 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-21971f45-d528-4805-b749-b7510f1ec426 tempest-VolumesTransfersV357Test-821703880 None] Lock "cinder-a9ae4e6d-d7bd-43f2-ab87-654edb9435dc-delete_volume" released by "delete_volume" :: held 1.959s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:45:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-62ea6516-ac7d-4b1e-84d8-7cb2e32ec507 req-1d062089-ce63-4232-8221-5c617b8335c8 tempest-ServerActionsTestOtherA-1140651778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:45:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-62ea6516-ac7d-4b1e-84d8-7cb2e32ec507 req-1d062089-ce63-4232-8221-5c617b8335c8 tempest-ServerActionsTestOtherA-1140651778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:45:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-62ea6516-ac7d-4b1e-84d8-7cb2e32ec507 req-1d062089-ce63-4232-8221-5c617b8335c8 tempest-ServerActionsTestOtherA-1140651778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:45:47 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-62ea6516-ac7d-4b1e-84d8-7cb2e32ec507 req-1d062089-ce63-4232-8221-5c617b8335c8 tempest-ServerActionsTestOtherA-1140651778 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d', 'name': 'volume-c679adbf-d2cb-46b1-8505-1418b345f941', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0022743a-6d90-48df-8a42-fd034d73ba99', 'enforce_multipath': True} {{(pid=87507) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 06:45:47 devstack cinder-volume[87507]: INFO cinder.volume.manager [req-62ea6516-ac7d-4b1e-84d8-7cb2e32ec507 req-1d062089-ce63-4232-8221-5c617b8335c8 tempest-ServerActionsTestOtherA-1140651778 None] attachment_update completed successfully. Sep 08 06:45:57 devstack cinder-volume[87507]: DEBUG dbcounter [-] [87507] Writing DB stats cinder:UPDATE=12,cinder:DELETE=2,cinder:SELECT=11,cinder:INSERT=3 {{(pid=87507) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 06:45:57 devstack cinder-volume[87507]: DEBUG dbcounter [-] [87507] Writing DB stats cinder:SELECT=14,cinder:UPDATE=8,cinder:INSERT=1 {{(pid=87507) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 06:46:11 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-768a6b80-725f-4274-a017-bbbdba1d7a8e tempest-VolumesSnapshotTestJSON-581938750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:46:11 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-768a6b80-725f-4274-a017-bbbdba1d7a8e tempest-VolumesSnapshotTestJSON-581938750 None] Flow 'volume_create_manager' (6b32fc15-2a61-4a5b-9214-7836c4b6685f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:46:11 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-768a6b80-725f-4274-a017-bbbdba1d7a8e tempest-VolumesSnapshotTestJSON-581938750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fc35def-924c-4809-8941-df5caf8a7d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:46:11 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-768a6b80-725f-4274-a017-bbbdba1d7a8e tempest-VolumesSnapshotTestJSON-581938750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fc35def-924c-4809-8941-df5caf8a7d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:46:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1642056179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99678f42-a9d2-4de7-b82c-fff35032ac56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b4941bb1fb44fbbbbda64a8438bf66a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:46:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:46:11Z,use_quota=True,user_id='a8ab0d637f5f4712b0d4425f6bf56b83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:46:11 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-768a6b80-725f-4274-a017-bbbdba1d7a8e tempest-VolumesSnapshotTestJSON-581938750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a58b4f8e-2b40-4565-ba2e-3a81f5a31316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:46:11 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-768a6b80-725f-4274-a017-bbbdba1d7a8e tempest-VolumesSnapshotTestJSON-581938750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a58b4f8e-2b40-4565-ba2e-3a81f5a31316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:46:11 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-768a6b80-725f-4274-a017-bbbdba1d7a8e tempest-VolumesSnapshotTestJSON-581938750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83b81cd4-8c1f-4936-8825-b0060957c1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:46:11 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-768a6b80-725f-4274-a017-bbbdba1d7a8e tempest-VolumesSnapshotTestJSON-581938750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83b81cd4-8c1f-4936-8825-b0060957c1b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99678f42-a9d2-4de7-b82c-fff35032ac56', 'volume_name': 'volume-99678f42-a9d2-4de7-b82c-fff35032ac56', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:46:11 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-768a6b80-725f-4274-a017-bbbdba1d7a8e tempest-VolumesSnapshotTestJSON-581938750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b07806d0-9312-4804-83ea-910b2822480b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:46:11 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-768a6b80-725f-4274-a017-bbbdba1d7a8e tempest-VolumesSnapshotTestJSON-581938750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b07806d0-9312-4804-83ea-910b2822480b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:46:11 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-768a6b80-725f-4274-a017-bbbdba1d7a8e tempest-VolumesSnapshotTestJSON-581938750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c2d769c-e63d-49e9-9d4d-39ec78da1fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:46:11 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-768a6b80-725f-4274-a017-bbbdba1d7a8e tempest-VolumesSnapshotTestJSON-581938750 None] Volume 99678f42-a9d2-4de7-b82c-fff35032ac56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99678f42-a9d2-4de7-b82c-fff35032ac56', 'volume_size': 1} Sep 08 06:46:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-768a6b80-725f-4274-a017-bbbdba1d7a8e tempest-VolumesSnapshotTestJSON-581938750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:46:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-768a6b80-725f-4274-a017-bbbdba1d7a8e tempest-VolumesSnapshotTestJSON-581938750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:46:11 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-768a6b80-725f-4274-a017-bbbdba1d7a8e tempest-VolumesSnapshotTestJSON-581938750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:46:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1642056179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99678f42-a9d2-4de7-b82c-fff35032ac56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b4941bb1fb44fbbbbda64a8438bf66a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:46:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:46:11Z,use_quota=True,user_id='a8ab0d637f5f4712b0d4425f6bf56b83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:46:11 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-768a6b80-725f-4274-a017-bbbdba1d7a8e tempest-VolumesSnapshotTestJSON-581938750 None] Creating volume 99678f42-a9d2-4de7-b82c-fff35032ac56 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:46:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-768a6b80-725f-4274-a017-bbbdba1d7a8e tempest-VolumesSnapshotTestJSON-581938750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:46:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-768a6b80-725f-4274-a017-bbbdba1d7a8e tempest-VolumesSnapshotTestJSON-581938750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:46:11 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-768a6b80-725f-4274-a017-bbbdba1d7a8e tempest-VolumesSnapshotTestJSON-581938750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:46:11 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-768a6b80-725f-4274-a017-bbbdba1d7a8e tempest-VolumesSnapshotTestJSON-581938750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:46:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-768a6b80-725f-4274-a017-bbbdba1d7a8e tempest-VolumesSnapshotTestJSON-581938750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:46:11 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-768a6b80-725f-4274-a017-bbbdba1d7a8e tempest-VolumesSnapshotTestJSON-581938750 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:46:11 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-768a6b80-725f-4274-a017-bbbdba1d7a8e tempest-VolumesSnapshotTestJSON-581938750 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:46:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-768a6b80-725f-4274-a017-bbbdba1d7a8e tempest-VolumesSnapshotTestJSON-581938750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-99678f42-a9d2-4de7-b82c-fff35032ac56 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:46:11 devstack sudo[93139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-99678f42-a9d2-4de7-b82c-fff35032ac56 1073741824 Sep 08 06:46:11 devstack sudo[93139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:46:12 devstack sudo[93139]: pam_unix(sudo:session): session closed for user root Sep 08 06:46:12 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-768a6b80-725f-4274-a017-bbbdba1d7a8e tempest-VolumesSnapshotTestJSON-581938750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-99678f42-a9d2-4de7-b82c-fff35032ac56 1073741824" returned: 0 in 0.730s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:46:12 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-768a6b80-725f-4274-a017-bbbdba1d7a8e tempest-VolumesSnapshotTestJSON-581938750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-99678f42-a9d2-4de7-b82c-fff35032ac56 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:46:12 devstack sudo[93156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-99678f42-a9d2-4de7-b82c-fff35032ac56 Sep 08 06:46:12 devstack sudo[93156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:46:12 devstack sudo[93156]: pam_unix(sudo:session): session closed for user root Sep 08 06:46:12 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-768a6b80-725f-4274-a017-bbbdba1d7a8e tempest-VolumesSnapshotTestJSON-581938750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-99678f42-a9d2-4de7-b82c-fff35032ac56" returned: 0 in 0.291s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:46:12 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-768a6b80-725f-4274-a017-bbbdba1d7a8e tempest-VolumesSnapshotTestJSON-581938750 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:46:12 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-768a6b80-725f-4274-a017-bbbdba1d7a8e tempest-VolumesSnapshotTestJSON-581938750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:46:12 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-768a6b80-725f-4274-a017-bbbdba1d7a8e tempest-VolumesSnapshotTestJSON-581938750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c2d769c-e63d-49e9-9d4d-39ec78da1fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99678f42-a9d2-4de7-b82c-fff35032ac56', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:46:12 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-768a6b80-725f-4274-a017-bbbdba1d7a8e tempest-VolumesSnapshotTestJSON-581938750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9926499-eed3-4e52-9965-ffddfd7501bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:46:12 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-768a6b80-725f-4274-a017-bbbdba1d7a8e tempest-VolumesSnapshotTestJSON-581938750 None] Volume volume-99678f42-a9d2-4de7-b82c-fff35032ac56 (99678f42-a9d2-4de7-b82c-fff35032ac56): created successfully Sep 08 06:46:12 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-768a6b80-725f-4274-a017-bbbdba1d7a8e tempest-VolumesSnapshotTestJSON-581938750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9926499-eed3-4e52-9965-ffddfd7501bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:46:12 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-768a6b80-725f-4274-a017-bbbdba1d7a8e tempest-VolumesSnapshotTestJSON-581938750 None] Flow 'volume_create_manager' (6b32fc15-2a61-4a5b-9214-7836c4b6685f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:46:12 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-768a6b80-725f-4274-a017-bbbdba1d7a8e tempest-VolumesSnapshotTestJSON-581938750 None] Created volume successfully. Sep 08 06:46:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b52ed3cb-b7c2-470c-b699-15050a407e71 tempest-VolumesSnapshotTestJSON-581938750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:46:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b52ed3cb-b7c2-470c-b699-15050a407e71 tempest-VolumesSnapshotTestJSON-581938750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:46:14 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-b52ed3cb-b7c2-470c-b699-15050a407e71 tempest-VolumesSnapshotTestJSON-581938750 None] Creating offline snapshot b1c03708-1fc4-4006-8698-44f33bcd822d of volume 99678f42-a9d2-4de7-b82c-fff35032ac56 {{(pid=87507) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 06:46:14 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0b13f9-1fd4-47ed-9d35-fcf0063493cc]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:46:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b52ed3cb-b7c2-470c-b699-15050a407e71 tempest-VolumesSnapshotTestJSON-581938750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-99678f42-a9d2-4de7-b82c-fff35032ac56 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:46:14 devstack sudo[93201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-99678f42-a9d2-4de7-b82c-fff35032ac56 Sep 08 06:46:14 devstack sudo[93201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:46:15 devstack sudo[93201]: pam_unix(sudo:session): session closed for user root Sep 08 06:46:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b52ed3cb-b7c2-470c-b699-15050a407e71 tempest-VolumesSnapshotTestJSON-581938750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-99678f42-a9d2-4de7-b82c-fff35032ac56" returned: 0 in 0.701s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:46:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b52ed3cb-b7c2-470c-b699-15050a407e71 tempest-VolumesSnapshotTestJSON-581938750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-99678f42-a9d2-4de7-b82c-fff35032ac56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-99678f42-a9d2-4de7-b82c-fff35032ac56.b1c03708-1fc4-4006-8698-44f33bcd822d 1G {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:46:15 devstack sudo[93207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-99678f42-a9d2-4de7-b82c-fff35032ac56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-99678f42-a9d2-4de7-b82c-fff35032ac56.b1c03708-1fc4-4006-8698-44f33bcd822d 1G Sep 08 06:46:15 devstack sudo[93207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:46:15 devstack sudo[93207]: pam_unix(sudo:session): session closed for user root Sep 08 06:46:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b52ed3cb-b7c2-470c-b699-15050a407e71 tempest-VolumesSnapshotTestJSON-581938750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-99678f42-a9d2-4de7-b82c-fff35032ac56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-99678f42-a9d2-4de7-b82c-fff35032ac56.b1c03708-1fc4-4006-8698-44f33bcd822d 1G" returned: 0 in 0.717s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:46:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b52ed3cb-b7c2-470c-b699-15050a407e71 tempest-VolumesSnapshotTestJSON-581938750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99678f42-a9d2-4de7-b82c-fff35032ac56 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-99678f42-a9d2-4de7-b82c-fff35032ac56.b1c03708-1fc4-4006-8698-44f33bcd822d {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:46:16 devstack sudo[93214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99678f42-a9d2-4de7-b82c-fff35032ac56 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-99678f42-a9d2-4de7-b82c-fff35032ac56.b1c03708-1fc4-4006-8698-44f33bcd822d Sep 08 06:46:16 devstack sudo[93214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:46:16 devstack sudo[93214]: pam_unix(sudo:session): session closed for user root Sep 08 06:46:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b52ed3cb-b7c2-470c-b699-15050a407e71 tempest-VolumesSnapshotTestJSON-581938750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99678f42-a9d2-4de7-b82c-fff35032ac56 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-99678f42-a9d2-4de7-b82c-fff35032ac56.b1c03708-1fc4-4006-8698-44f33bcd822d" returned: 0 in 0.725s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:46:16 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-b52ed3cb-b7c2-470c-b699-15050a407e71 tempest-VolumesSnapshotTestJSON-581938750 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-99678f42-a9d2-4de7-b82c-fff35032ac56.b1c03708-1fc4-4006-8698-44f33bcd822d is being set with open permissions: ugo+rw Sep 08 06:46:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b52ed3cb-b7c2-470c-b699-15050a407e71 tempest-VolumesSnapshotTestJSON-581938750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-99678f42-a9d2-4de7-b82c-fff35032ac56.b1c03708-1fc4-4006-8698-44f33bcd822d {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:46:16 devstack sudo[93225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-99678f42-a9d2-4de7-b82c-fff35032ac56.b1c03708-1fc4-4006-8698-44f33bcd822d Sep 08 06:46:16 devstack sudo[93225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:46:17 devstack sudo[93225]: pam_unix(sudo:session): session closed for user root Sep 08 06:46:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b52ed3cb-b7c2-470c-b699-15050a407e71 tempest-VolumesSnapshotTestJSON-581938750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-99678f42-a9d2-4de7-b82c-fff35032ac56.b1c03708-1fc4-4006-8698-44f33bcd822d" returned: 0 in 0.477s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:46:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b52ed3cb-b7c2-470c-b699-15050a407e71 tempest-VolumesSnapshotTestJSON-581938750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-99678f42-a9d2-4de7-b82c-fff35032ac56.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:46:17 devstack sudo[93232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-99678f42-a9d2-4de7-b82c-fff35032ac56.info Sep 08 06:46:17 devstack sudo[93232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:46:18 devstack sudo[93232]: pam_unix(sudo:session): session closed for user root Sep 08 06:46:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b52ed3cb-b7c2-470c-b699-15050a407e71 tempest-VolumesSnapshotTestJSON-581938750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-99678f42-a9d2-4de7-b82c-fff35032ac56.info" returned: 0 in 0.796s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:46:18 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-b52ed3cb-b7c2-470c-b699-15050a407e71 tempest-VolumesSnapshotTestJSON-581938750 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-99678f42-a9d2-4de7-b82c-fff35032ac56.info is being set with open permissions: ugo+rw Sep 08 06:46:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b52ed3cb-b7c2-470c-b699-15050a407e71 tempest-VolumesSnapshotTestJSON-581938750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-99678f42-a9d2-4de7-b82c-fff35032ac56.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:46:18 devstack sudo[93250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-99678f42-a9d2-4de7-b82c-fff35032ac56.info Sep 08 06:46:18 devstack sudo[93250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:46:18 devstack sudo[93250]: pam_unix(sudo:session): session closed for user root Sep 08 06:46:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b52ed3cb-b7c2-470c-b699-15050a407e71 tempest-VolumesSnapshotTestJSON-581938750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-99678f42-a9d2-4de7-b82c-fff35032ac56.info" returned: 0 in 0.379s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:46:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b52ed3cb-b7c2-470c-b699-15050a407e71 tempest-VolumesSnapshotTestJSON-581938750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.035s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:46:18 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-b52ed3cb-b7c2-470c-b699-15050a407e71 tempest-VolumesSnapshotTestJSON-581938750 None] Create snapshot completed successfully Sep 08 06:46:19 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-052fd106-628f-49ce-9dc6-28adf8eaa160 tempest-VolumesSnapshotTestJSON-581938750 None] Acquiring lock "cinder-b1c03708-1fc4-4006-8698-44f33bcd822d-delete_snapshot" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:46:19 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-052fd106-628f-49ce-9dc6-28adf8eaa160 tempest-VolumesSnapshotTestJSON-581938750 None] Lock "cinder-b1c03708-1fc4-4006-8698-44f33bcd822d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:46:19 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-052fd106-628f-49ce-9dc6-28adf8eaa160 tempest-VolumesSnapshotTestJSON-581938750 None] Acquiring lock "cinder-quobyte-99678f42-a9d2-4de7-b82c-fff35032ac56" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:46:19 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-052fd106-628f-49ce-9dc6-28adf8eaa160 tempest-VolumesSnapshotTestJSON-581938750 None] Lock "cinder-quobyte-99678f42-a9d2-4de7-b82c-fff35032ac56" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:46:19 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-052fd106-628f-49ce-9dc6-28adf8eaa160 tempest-VolumesSnapshotTestJSON-581938750 None] Acquiring lock "cinder-quobyte-b1c03708-1fc4-4006-8698-44f33bcd822d" by "_delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:46:19 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-052fd106-628f-49ce-9dc6-28adf8eaa160 tempest-VolumesSnapshotTestJSON-581938750 None] Lock "cinder-quobyte-b1c03708-1fc4-4006-8698-44f33bcd822d" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:46:19 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-052fd106-628f-49ce-9dc6-28adf8eaa160 tempest-VolumesSnapshotTestJSON-581938750 None] Deleting offline snapshot b1c03708-1fc4-4006-8698-44f33bcd822d of volume 99678f42-a9d2-4de7-b82c-fff35032ac56 {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 06:46:19 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-052fd106-628f-49ce-9dc6-28adf8eaa160 tempest-VolumesSnapshotTestJSON-581938750 None] snapshot_file for this snap is: volume-99678f42-a9d2-4de7-b82c-fff35032ac56.b1c03708-1fc4-4006-8698-44f33bcd822d {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 06:46:19 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba904566-9ff4-4ae9-ab51-91ac10c6ae97]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:46:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-052fd106-628f-49ce-9dc6-28adf8eaa160 tempest-VolumesSnapshotTestJSON-581938750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-99678f42-a9d2-4de7-b82c-fff35032ac56.b1c03708-1fc4-4006-8698-44f33bcd822d {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:46:19 devstack sudo[93279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-99678f42-a9d2-4de7-b82c-fff35032ac56.b1c03708-1fc4-4006-8698-44f33bcd822d Sep 08 06:46:19 devstack sudo[93279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:46:20 devstack cinder-volume[87507]: DEBUG oslo_service.periodic_task [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87507) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 06:46:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:46:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:46:20 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:46:20 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:46:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:46:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:46:20 devstack sudo[93283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:46:20 devstack sudo[93283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:46:20 devstack sudo[93279]: pam_unix(sudo:session): session closed for user root Sep 08 06:46:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-052fd106-628f-49ce-9dc6-28adf8eaa160 tempest-VolumesSnapshotTestJSON-581938750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-99678f42-a9d2-4de7-b82c-fff35032ac56.b1c03708-1fc4-4006-8698-44f33bcd822d" returned: 0 in 0.662s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:46:20 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-052fd106-628f-49ce-9dc6-28adf8eaa160 tempest-VolumesSnapshotTestJSON-581938750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99678f42-a9d2-4de7-b82c-fff35032ac56(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 06:46:20 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d801b117-128e-46d0-8d29-d7eca7786158]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:46:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-052fd106-628f-49ce-9dc6-28adf8eaa160 tempest-VolumesSnapshotTestJSON-581938750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-99678f42-a9d2-4de7-b82c-fff35032ac56 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:46:20 devstack sudo[93287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-99678f42-a9d2-4de7-b82c-fff35032ac56 Sep 08 06:46:20 devstack sudo[93287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:46:20 devstack sudo[93283]: pam_unix(sudo:session): session closed for user root Sep 08 06:46:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.618s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:46:20 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:46:20 devstack cinder-volume[87507]: DEBUG oslo_service.periodic_task [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Running periodic task VolumeManager._thread_info {{(pid=87507) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 06:46:20 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] thread count: 28 {{(pid=87507) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 06:46:20 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] thread info: [<_MainThread(MainThread, started 127913129345152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87507) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 06:46:21 devstack sudo[93287]: pam_unix(sudo:session): session closed for user root Sep 08 06:46:21 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-052fd106-628f-49ce-9dc6-28adf8eaa160 tempest-VolumesSnapshotTestJSON-581938750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-99678f42-a9d2-4de7-b82c-fff35032ac56" returned: 0 in 0.651s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:46:21 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-052fd106-628f-49ce-9dc6-28adf8eaa160 tempest-VolumesSnapshotTestJSON-581938750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-99678f42-a9d2-4de7-b82c-fff35032ac56.b1c03708-1fc4-4006-8698-44f33bcd822d {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:46:21 devstack sudo[93296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-99678f42-a9d2-4de7-b82c-fff35032ac56.b1c03708-1fc4-4006-8698-44f33bcd822d Sep 08 06:46:21 devstack sudo[93296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:46:21 devstack sudo[93296]: pam_unix(sudo:session): session closed for user root Sep 08 06:46:21 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-052fd106-628f-49ce-9dc6-28adf8eaa160 tempest-VolumesSnapshotTestJSON-581938750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-99678f42-a9d2-4de7-b82c-fff35032ac56.b1c03708-1fc4-4006-8698-44f33bcd822d" returned: 0 in 0.805s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:46:21 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-052fd106-628f-49ce-9dc6-28adf8eaa160 tempest-VolumesSnapshotTestJSON-581938750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-99678f42-a9d2-4de7-b82c-fff35032ac56.b1c03708-1fc4-4006-8698-44f33bcd822d {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:46:21 devstack sudo[93316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-99678f42-a9d2-4de7-b82c-fff35032ac56.b1c03708-1fc4-4006-8698-44f33bcd822d Sep 08 06:46:21 devstack sudo[93316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:46:22 devstack cinder-volume[87507]: INFO cinder.volume.manager [req-631de64f-90ae-41fc-a7f6-4bb10d022306 req-b8909904-9c2b-4e1a-ad5b-8455ebfc48f9 tempest-ServerActionsTestOtherA-1140651778 None] Terminate volume connection completed successfully. Sep 08 06:46:22 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-631de64f-90ae-41fc-a7f6-4bb10d022306 req-b8909904-9c2b-4e1a-ad5b-8455ebfc48f9 tempest-ServerActionsTestOtherA-1140651778 None] Deleting attachment 0022743a-6d90-48df-8a42-fd034d73ba99. {{(pid=87507) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 06:46:22 devstack sudo[93316]: pam_unix(sudo:session): session closed for user root Sep 08 06:46:22 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-052fd106-628f-49ce-9dc6-28adf8eaa160 tempest-VolumesSnapshotTestJSON-581938750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-99678f42-a9d2-4de7-b82c-fff35032ac56.b1c03708-1fc4-4006-8698-44f33bcd822d" returned: 0 in 0.742s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:46:22 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-052fd106-628f-49ce-9dc6-28adf8eaa160 tempest-VolumesSnapshotTestJSON-581938750 None] Lock "cinder-quobyte-b1c03708-1fc4-4006-8698-44f33bcd822d" released by "_delete_snapshot" :: held 3.130s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:46:22 devstack cinder-volume[87507]: DEBUG cinder.coordination [req-631de64f-90ae-41fc-a7f6-4bb10d022306 req-1c673c9d-722a-48d8-b2e9-d158857a9e9e tempest-ServerActionsTestOtherA-1140651778 None] Acquiring lock "cinder-c679adbf-d2cb-46b1-8505-1418b345f941-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:46:22 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-052fd106-628f-49ce-9dc6-28adf8eaa160 tempest-VolumesSnapshotTestJSON-581938750 None] Lock "cinder-quobyte-99678f42-a9d2-4de7-b82c-fff35032ac56" released by "delete_snapshot" :: held 3.192s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:46:22 devstack cinder-volume[87507]: DEBUG cinder.coordination [req-631de64f-90ae-41fc-a7f6-4bb10d022306 req-1c673c9d-722a-48d8-b2e9-d158857a9e9e tempest-ServerActionsTestOtherA-1140651778 None] Lock "cinder-c679adbf-d2cb-46b1-8505-1418b345f941-delete_volume" acquired by "delete_volume" :: waited 0.095s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:46:22 devstack cinder-volume[87507]: DEBUG cinder.coordination [req-631de64f-90ae-41fc-a7f6-4bb10d022306 req-1c673c9d-722a-48d8-b2e9-d158857a9e9e tempest-ServerActionsTestOtherA-1140651778 None] Acquiring lock "cinder-quobyte-c679adbf-d2cb-46b1-8505-1418b345f941" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:46:22 devstack cinder-volume[87507]: DEBUG cinder.coordination [req-631de64f-90ae-41fc-a7f6-4bb10d022306 req-1c673c9d-722a-48d8-b2e9-d158857a9e9e tempest-ServerActionsTestOtherA-1140651778 None] Lock "cinder-quobyte-c679adbf-d2cb-46b1-8505-1418b345f941" acquired by "delete_volume" :: waited 0.023s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:46:22 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-052fd106-628f-49ce-9dc6-28adf8eaa160 tempest-VolumesSnapshotTestJSON-581938750 None] Created reservations ['7b860c0d-b6f6-45f7-a720-ed6afdfab0af', '94693081-aceb-4aed-82ef-966b915b3c46', 'a36b950e-40c3-4470-a2e2-f4beae33a378', '94ef4d22-e6e0-460e-ac54-ea180df0e0fd'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:46:22 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72f4d64-7cd2-452c-bbe6-8b96e342428a]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:46:22 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [req-631de64f-90ae-41fc-a7f6-4bb10d022306 req-1c673c9d-722a-48d8-b2e9-d158857a9e9e tempest-ServerActionsTestOtherA-1140651778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c679adbf-d2cb-46b1-8505-1418b345f941 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:46:23 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-052fd106-628f-49ce-9dc6-28adf8eaa160 tempest-VolumesSnapshotTestJSON-581938750 None] Delete snapshot completed successfully. Sep 08 06:46:23 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-052fd106-628f-49ce-9dc6-28adf8eaa160 tempest-VolumesSnapshotTestJSON-581938750 None] Lock "cinder-b1c03708-1fc4-4006-8698-44f33bcd822d-delete_snapshot" released by "delete_snapshot" :: held 3.908s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:46:23 devstack sudo[93366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c679adbf-d2cb-46b1-8505-1418b345f941 Sep 08 06:46:23 devstack sudo[93366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:46:23 devstack sudo[93366]: pam_unix(sudo:session): session closed for user root Sep 08 06:46:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [req-631de64f-90ae-41fc-a7f6-4bb10d022306 req-1c673c9d-722a-48d8-b2e9-d158857a9e9e tempest-ServerActionsTestOtherA-1140651778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c679adbf-d2cb-46b1-8505-1418b345f941" returned: 0 in 0.909s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:46:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [req-631de64f-90ae-41fc-a7f6-4bb10d022306 req-1c673c9d-722a-48d8-b2e9-d158857a9e9e tempest-ServerActionsTestOtherA-1140651778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c679adbf-d2cb-46b1-8505-1418b345f941 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:46:23 devstack sudo[93376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c679adbf-d2cb-46b1-8505-1418b345f941 Sep 08 06:46:23 devstack sudo[93376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:46:24 devstack sudo[93376]: pam_unix(sudo:session): session closed for user root Sep 08 06:46:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [req-631de64f-90ae-41fc-a7f6-4bb10d022306 req-1c673c9d-722a-48d8-b2e9-d158857a9e9e tempest-ServerActionsTestOtherA-1140651778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c679adbf-d2cb-46b1-8505-1418b345f941" returned: 0 in 0.424s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:46:24 devstack cinder-volume[87507]: DEBUG cinder.coordination [req-631de64f-90ae-41fc-a7f6-4bb10d022306 req-1c673c9d-722a-48d8-b2e9-d158857a9e9e tempest-ServerActionsTestOtherA-1140651778 None] Lock "cinder-quobyte-c679adbf-d2cb-46b1-8505-1418b345f941" released by "delete_volume" :: held 1.430s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:46:24 devstack cinder-volume[87507]: DEBUG cinder.quota [req-631de64f-90ae-41fc-a7f6-4bb10d022306 req-1c673c9d-722a-48d8-b2e9-d158857a9e9e tempest-ServerActionsTestOtherA-1140651778 None] Created reservations ['ac8a67cd-a85d-4be9-8594-4607f6b579ce', 'f632d8eb-33cd-49b2-aec7-0d9407581bd4', '44ca2982-2720-41a7-8574-5cde3c97b6a6', '096dc4c9-6bf9-45dd-bd2a-316774ea28bf'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:46:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-631de64f-90ae-41fc-a7f6-4bb10d022306 req-1c673c9d-722a-48d8-b2e9-d158857a9e9e tempest-ServerActionsTestOtherA-1140651778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:46:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-631de64f-90ae-41fc-a7f6-4bb10d022306 req-1c673c9d-722a-48d8-b2e9-d158857a9e9e tempest-ServerActionsTestOtherA-1140651778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:46:24 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [req-631de64f-90ae-41fc-a7f6-4bb10d022306 req-1c673c9d-722a-48d8-b2e9-d158857a9e9e tempest-ServerActionsTestOtherA-1140651778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:46:24 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [req-631de64f-90ae-41fc-a7f6-4bb10d022306 req-1c673c9d-722a-48d8-b2e9-d158857a9e9e tempest-ServerActionsTestOtherA-1140651778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:46:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-631de64f-90ae-41fc-a7f6-4bb10d022306 req-1c673c9d-722a-48d8-b2e9-d158857a9e9e tempest-ServerActionsTestOtherA-1140651778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:46:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [req-631de64f-90ae-41fc-a7f6-4bb10d022306 req-1c673c9d-722a-48d8-b2e9-d158857a9e9e tempest-ServerActionsTestOtherA-1140651778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:46:24 devstack sudo[93381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:46:24 devstack sudo[93381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:46:25 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbae806e-076e-4187-9c35-ff0605943468 tempest-VolumesSnapshotTestJSON-581938750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:46:25 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-cbae806e-076e-4187-9c35-ff0605943468 tempest-VolumesSnapshotTestJSON-581938750 None] Flow 'volume_create_manager' (b93e7451-54ff-46af-84b6-17d183726bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:46:25 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-cbae806e-076e-4187-9c35-ff0605943468 tempest-VolumesSnapshotTestJSON-581938750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e47867d3-7ce1-41c2-b8ed-25af63604413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:46:25 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-cbae806e-076e-4187-9c35-ff0605943468 tempest-VolumesSnapshotTestJSON-581938750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e47867d3-7ce1-41c2-b8ed-25af63604413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:46:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1903577199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b4941bb1fb44fbbbbda64a8438bf66a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:46:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:46:25Z,use_quota=True,user_id='a8ab0d637f5f4712b0d4425f6bf56b83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:46:25 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-cbae806e-076e-4187-9c35-ff0605943468 tempest-VolumesSnapshotTestJSON-581938750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce13a21d-1301-4288-b78b-cd19f1a2473c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:46:25 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-cbae806e-076e-4187-9c35-ff0605943468 tempest-VolumesSnapshotTestJSON-581938750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce13a21d-1301-4288-b78b-cd19f1a2473c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:46:25 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-cbae806e-076e-4187-9c35-ff0605943468 tempest-VolumesSnapshotTestJSON-581938750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc346f19-c100-414f-9cb2-9e1a48139a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:46:25 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-cbae806e-076e-4187-9c35-ff0605943468 tempest-VolumesSnapshotTestJSON-581938750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc346f19-c100-414f-9cb2-9e1a48139a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb', 'volume_name': 'volume-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:46:25 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-cbae806e-076e-4187-9c35-ff0605943468 tempest-VolumesSnapshotTestJSON-581938750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bec89a3-f432-44b4-8888-f2d055c3de54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:46:25 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-cbae806e-076e-4187-9c35-ff0605943468 tempest-VolumesSnapshotTestJSON-581938750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bec89a3-f432-44b4-8888-f2d055c3de54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:46:25 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-cbae806e-076e-4187-9c35-ff0605943468 tempest-VolumesSnapshotTestJSON-581938750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83e5d972-8212-4f59-ac78-4a5d6d13b563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:46:25 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-cbae806e-076e-4187-9c35-ff0605943468 tempest-VolumesSnapshotTestJSON-581938750 None] Volume 2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb', 'volume_size': 1} Sep 08 06:46:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-cbae806e-076e-4187-9c35-ff0605943468 tempest-VolumesSnapshotTestJSON-581938750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:46:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-cbae806e-076e-4187-9c35-ff0605943468 tempest-VolumesSnapshotTestJSON-581938750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:46:25 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-cbae806e-076e-4187-9c35-ff0605943468 tempest-VolumesSnapshotTestJSON-581938750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:46:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1903577199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b4941bb1fb44fbbbbda64a8438bf66a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:46:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:46:25Z,use_quota=True,user_id='a8ab0d637f5f4712b0d4425f6bf56b83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:46:25 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-cbae806e-076e-4187-9c35-ff0605943468 tempest-VolumesSnapshotTestJSON-581938750 None] Creating volume 2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:46:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-cbae806e-076e-4187-9c35-ff0605943468 tempest-VolumesSnapshotTestJSON-581938750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:46:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-cbae806e-076e-4187-9c35-ff0605943468 tempest-VolumesSnapshotTestJSON-581938750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:46:25 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-cbae806e-076e-4187-9c35-ff0605943468 tempest-VolumesSnapshotTestJSON-581938750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:46:25 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-cbae806e-076e-4187-9c35-ff0605943468 tempest-VolumesSnapshotTestJSON-581938750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:46:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-cbae806e-076e-4187-9c35-ff0605943468 tempest-VolumesSnapshotTestJSON-581938750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:46:25 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-cbae806e-076e-4187-9c35-ff0605943468 tempest-VolumesSnapshotTestJSON-581938750 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:46:25 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-cbae806e-076e-4187-9c35-ff0605943468 tempest-VolumesSnapshotTestJSON-581938750 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:46:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-cbae806e-076e-4187-9c35-ff0605943468 tempest-VolumesSnapshotTestJSON-581938750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:46:25 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-7db85aee-c4c4-4789-ae52-c1e5f59f6baa tempest-ServerActionsTestOtherA-1140651778 None] Acquiring lock "cinder-439c9734-e231-45ca-b475-b4a0b57f534b-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:46:25 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-7db85aee-c4c4-4789-ae52-c1e5f59f6baa tempest-ServerActionsTestOtherA-1140651778 None] Lock "cinder-439c9734-e231-45ca-b475-b4a0b57f534b-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:46:25 devstack sudo[93383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb 1073741824 Sep 08 06:46:25 devstack sudo[93383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:46:25 devstack sudo[93381]: pam_unix(sudo:session): session closed for user root Sep 08 06:46:25 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-7db85aee-c4c4-4789-ae52-c1e5f59f6baa tempest-ServerActionsTestOtherA-1140651778 None] Acquiring lock "cinder-quobyte-439c9734-e231-45ca-b475-b4a0b57f534b" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:46:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [req-631de64f-90ae-41fc-a7f6-4bb10d022306 req-1c673c9d-722a-48d8-b2e9-d158857a9e9e tempest-ServerActionsTestOtherA-1140651778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.836s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:46:25 devstack cinder-volume[87507]: DEBUG cinder.manager [req-631de64f-90ae-41fc-a7f6-4bb10d022306 req-1c673c9d-722a-48d8-b2e9-d158857a9e9e tempest-ServerActionsTestOtherA-1140651778 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:46:25 devstack cinder-volume[87507]: INFO cinder.volume.manager [req-631de64f-90ae-41fc-a7f6-4bb10d022306 req-1c673c9d-722a-48d8-b2e9-d158857a9e9e tempest-ServerActionsTestOtherA-1140651778 None] Deleted volume successfully. Sep 08 06:46:25 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-7db85aee-c4c4-4789-ae52-c1e5f59f6baa tempest-ServerActionsTestOtherA-1140651778 None] Lock "cinder-quobyte-439c9734-e231-45ca-b475-b4a0b57f534b" acquired by "delete_volume" :: waited 0.053s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:46:25 devstack cinder-volume[87507]: DEBUG cinder.coordination [req-631de64f-90ae-41fc-a7f6-4bb10d022306 req-1c673c9d-722a-48d8-b2e9-d158857a9e9e tempest-ServerActionsTestOtherA-1140651778 None] Lock "cinder-c679adbf-d2cb-46b1-8505-1418b345f941-delete_volume" released by "delete_volume" :: held 2.707s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:46:25 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ee354f-e1e7-44ad-92da-ad06b6caeb15]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:46:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7db85aee-c4c4-4789-ae52-c1e5f59f6baa tempest-ServerActionsTestOtherA-1140651778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-439c9734-e231-45ca-b475-b4a0b57f534b {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:46:25 devstack sudo[93386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-439c9734-e231-45ca-b475-b4a0b57f534b Sep 08 06:46:25 devstack sudo[93386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:46:25 devstack sudo[93383]: pam_unix(sudo:session): session closed for user root Sep 08 06:46:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-cbae806e-076e-4187-9c35-ff0605943468 tempest-VolumesSnapshotTestJSON-581938750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb 1073741824" returned: 0 in 0.750s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:46:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-cbae806e-076e-4187-9c35-ff0605943468 tempest-VolumesSnapshotTestJSON-581938750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:46:25 devstack sudo[93386]: pam_unix(sudo:session): session closed for user root Sep 08 06:46:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7db85aee-c4c4-4789-ae52-c1e5f59f6baa tempest-ServerActionsTestOtherA-1140651778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-439c9734-e231-45ca-b475-b4a0b57f534b" returned: 0 in 0.481s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:46:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7db85aee-c4c4-4789-ae52-c1e5f59f6baa tempest-ServerActionsTestOtherA-1140651778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-439c9734-e231-45ca-b475-b4a0b57f534b {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:46:26 devstack sudo[93419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb Sep 08 06:46:26 devstack sudo[93419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:46:26 devstack sudo[93420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-439c9734-e231-45ca-b475-b4a0b57f534b Sep 08 06:46:26 devstack sudo[93420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:46:26 devstack sudo[93419]: pam_unix(sudo:session): session closed for user root Sep 08 06:46:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-cbae806e-076e-4187-9c35-ff0605943468 tempest-VolumesSnapshotTestJSON-581938750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb" returned: 0 in 0.289s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:46:26 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-cbae806e-076e-4187-9c35-ff0605943468 tempest-VolumesSnapshotTestJSON-581938750 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:46:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-cbae806e-076e-4187-9c35-ff0605943468 tempest-VolumesSnapshotTestJSON-581938750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:46:26 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-cbae806e-076e-4187-9c35-ff0605943468 tempest-VolumesSnapshotTestJSON-581938750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83e5d972-8212-4f59-ac78-4a5d6d13b563) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:46:26 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-cbae806e-076e-4187-9c35-ff0605943468 tempest-VolumesSnapshotTestJSON-581938750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8b1e48b-1e6c-4f9a-846e-4eb10c16beec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:46:26 devstack sudo[93420]: pam_unix(sudo:session): session closed for user root Sep 08 06:46:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7db85aee-c4c4-4789-ae52-c1e5f59f6baa tempest-ServerActionsTestOtherA-1140651778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-439c9734-e231-45ca-b475-b4a0b57f534b" returned: 0 in 0.301s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:46:26 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-cbae806e-076e-4187-9c35-ff0605943468 tempest-VolumesSnapshotTestJSON-581938750 None] Volume volume-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb (2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb): created successfully Sep 08 06:46:26 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-cbae806e-076e-4187-9c35-ff0605943468 tempest-VolumesSnapshotTestJSON-581938750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8b1e48b-1e6c-4f9a-846e-4eb10c16beec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:46:26 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-cbae806e-076e-4187-9c35-ff0605943468 tempest-VolumesSnapshotTestJSON-581938750 None] Flow 'volume_create_manager' (b93e7451-54ff-46af-84b6-17d183726bc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:46:26 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-7db85aee-c4c4-4789-ae52-c1e5f59f6baa tempest-ServerActionsTestOtherA-1140651778 None] Lock "cinder-quobyte-439c9734-e231-45ca-b475-b4a0b57f534b" released by "delete_volume" :: held 0.874s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:46:26 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-cbae806e-076e-4187-9c35-ff0605943468 tempest-VolumesSnapshotTestJSON-581938750 None] Created volume successfully. Sep 08 06:46:26 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-7db85aee-c4c4-4789-ae52-c1e5f59f6baa tempest-ServerActionsTestOtherA-1140651778 None] Created reservations ['65472a7e-5c4a-412f-81a3-2e86eb6883e2', '6c4bf1a5-7e19-459d-a70f-b0021c2431c1', 'f8f7f739-f17f-4f16-bb48-04fda2c79b77', '6fa8dc60-0e73-46e6-b535-05f7a39ca18b'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:46:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-7db85aee-c4c4-4789-ae52-c1e5f59f6baa tempest-ServerActionsTestOtherA-1140651778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:46:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-7db85aee-c4c4-4789-ae52-c1e5f59f6baa tempest-ServerActionsTestOtherA-1140651778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:46:26 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-7db85aee-c4c4-4789-ae52-c1e5f59f6baa tempest-ServerActionsTestOtherA-1140651778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:46:26 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-7db85aee-c4c4-4789-ae52-c1e5f59f6baa tempest-ServerActionsTestOtherA-1140651778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:46:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-7db85aee-c4c4-4789-ae52-c1e5f59f6baa tempest-ServerActionsTestOtherA-1140651778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:46:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7db85aee-c4c4-4789-ae52-c1e5f59f6baa tempest-ServerActionsTestOtherA-1140651778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:46:26 devstack sudo[93425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:46:26 devstack sudo[93425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:46:26 devstack sudo[93425]: pam_unix(sudo:session): session closed for user root Sep 08 06:46:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7db85aee-c4c4-4789-ae52-c1e5f59f6baa tempest-ServerActionsTestOtherA-1140651778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.255s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:46:26 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-7db85aee-c4c4-4789-ae52-c1e5f59f6baa tempest-ServerActionsTestOtherA-1140651778 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:46:26 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-7db85aee-c4c4-4789-ae52-c1e5f59f6baa tempest-ServerActionsTestOtherA-1140651778 None] Deleted volume successfully. Sep 08 06:46:26 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-7db85aee-c4c4-4789-ae52-c1e5f59f6baa tempest-ServerActionsTestOtherA-1140651778 None] Lock "cinder-439c9734-e231-45ca-b475-b4a0b57f534b-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:46:27 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-e8c041bf-ee0d-4822-a260-bdd3312b01b2 tempest-VolumesSnapshotTestJSON-581938750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:46:27 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-e8c041bf-ee0d-4822-a260-bdd3312b01b2 tempest-VolumesSnapshotTestJSON-581938750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:46:27 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-e8c041bf-ee0d-4822-a260-bdd3312b01b2 tempest-VolumesSnapshotTestJSON-581938750 None] Creating offline snapshot d137be0d-a616-4449-b49c-63f549f298bd of volume 2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb {{(pid=87507) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 06:46:27 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e55a8ed-77e0-46b7-894f-17f38ad2c74e]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:46:27 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e8c041bf-ee0d-4822-a260-bdd3312b01b2 tempest-VolumesSnapshotTestJSON-581938750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:46:27 devstack sudo[93428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb Sep 08 06:46:27 devstack sudo[93428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:46:27 devstack sudo[93428]: pam_unix(sudo:session): session closed for user root Sep 08 06:46:27 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e8c041bf-ee0d-4822-a260-bdd3312b01b2 tempest-VolumesSnapshotTestJSON-581938750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb" returned: 0 in 0.589s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:46:27 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e8c041bf-ee0d-4822-a260-bdd3312b01b2 tempest-VolumesSnapshotTestJSON-581938750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb.d137be0d-a616-4449-b49c-63f549f298bd 1G {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:46:27 devstack sudo[93438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb.d137be0d-a616-4449-b49c-63f549f298bd 1G Sep 08 06:46:27 devstack sudo[93438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:46:28 devstack sudo[93438]: pam_unix(sudo:session): session closed for user root Sep 08 06:46:28 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e8c041bf-ee0d-4822-a260-bdd3312b01b2 tempest-VolumesSnapshotTestJSON-581938750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb.d137be0d-a616-4449-b49c-63f549f298bd 1G" returned: 0 in 0.858s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:46:28 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e8c041bf-ee0d-4822-a260-bdd3312b01b2 tempest-VolumesSnapshotTestJSON-581938750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb.d137be0d-a616-4449-b49c-63f549f298bd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:46:28 devstack sudo[93467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb.d137be0d-a616-4449-b49c-63f549f298bd Sep 08 06:46:28 devstack sudo[93467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:46:29 devstack sudo[93467]: pam_unix(sudo:session): session closed for user root Sep 08 06:46:29 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e8c041bf-ee0d-4822-a260-bdd3312b01b2 tempest-VolumesSnapshotTestJSON-581938750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb.d137be0d-a616-4449-b49c-63f549f298bd" returned: 0 in 0.411s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:46:29 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-e8c041bf-ee0d-4822-a260-bdd3312b01b2 tempest-VolumesSnapshotTestJSON-581938750 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb.d137be0d-a616-4449-b49c-63f549f298bd is being set with open permissions: ugo+rw Sep 08 06:46:29 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e8c041bf-ee0d-4822-a260-bdd3312b01b2 tempest-VolumesSnapshotTestJSON-581938750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb.d137be0d-a616-4449-b49c-63f549f298bd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:46:29 devstack sudo[93474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb.d137be0d-a616-4449-b49c-63f549f298bd Sep 08 06:46:29 devstack sudo[93474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:46:29 devstack sudo[93474]: pam_unix(sudo:session): session closed for user root Sep 08 06:46:29 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e8c041bf-ee0d-4822-a260-bdd3312b01b2 tempest-VolumesSnapshotTestJSON-581938750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb.d137be0d-a616-4449-b49c-63f549f298bd" returned: 0 in 0.304s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:46:29 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e8c041bf-ee0d-4822-a260-bdd3312b01b2 tempest-VolumesSnapshotTestJSON-581938750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:46:29 devstack sudo[93478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb.info Sep 08 06:46:29 devstack sudo[93478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:46:29 devstack sudo[93478]: pam_unix(sudo:session): session closed for user root Sep 08 06:46:29 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e8c041bf-ee0d-4822-a260-bdd3312b01b2 tempest-VolumesSnapshotTestJSON-581938750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb.info" returned: 0 in 0.364s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:46:29 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-e8c041bf-ee0d-4822-a260-bdd3312b01b2 tempest-VolumesSnapshotTestJSON-581938750 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb.info is being set with open permissions: ugo+rw Sep 08 06:46:29 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e8c041bf-ee0d-4822-a260-bdd3312b01b2 tempest-VolumesSnapshotTestJSON-581938750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:46:29 devstack sudo[93483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb.info Sep 08 06:46:29 devstack sudo[93483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:46:30 devstack sudo[93483]: pam_unix(sudo:session): session closed for user root Sep 08 06:46:30 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e8c041bf-ee0d-4822-a260-bdd3312b01b2 tempest-VolumesSnapshotTestJSON-581938750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb.info" returned: 0 in 0.374s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:46:30 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-e8c041bf-ee0d-4822-a260-bdd3312b01b2 tempest-VolumesSnapshotTestJSON-581938750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.020s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:46:30 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-e8c041bf-ee0d-4822-a260-bdd3312b01b2 tempest-VolumesSnapshotTestJSON-581938750 None] Create snapshot completed successfully Sep 08 06:46:31 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-9be28919-706c-466e-940e-d80d69c8e683 tempest-VolumesSnapshotTestJSON-581938750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:46:31 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9be28919-706c-466e-940e-d80d69c8e683 tempest-VolumesSnapshotTestJSON-581938750 None] Flow 'volume_create_manager' (af2c0568-c9ed-4f3c-a02b-b31b17810582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:46:31 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9be28919-706c-466e-940e-d80d69c8e683 tempest-VolumesSnapshotTestJSON-581938750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01164228-b810-4aae-add2-110bec389499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:46:31 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9be28919-706c-466e-940e-d80d69c8e683 tempest-VolumesSnapshotTestJSON-581938750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01164228-b810-4aae-add2-110bec389499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:46:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1547612493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=950cdf44-1fdb-4736-a6cf-9a7f0e4c482a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b4941bb1fb44fbbbbda64a8438bf66a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:46:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=d137be0d-a616-4449-b49c-63f549f298bd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:46:31Z,use_quota=True,user_id='a8ab0d637f5f4712b0d4425f6bf56b83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:46:31 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9be28919-706c-466e-940e-d80d69c8e683 tempest-VolumesSnapshotTestJSON-581938750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b924902c-acba-4a69-9f9d-33f3619bbead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:46:31 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9be28919-706c-466e-940e-d80d69c8e683 tempest-VolumesSnapshotTestJSON-581938750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b924902c-acba-4a69-9f9d-33f3619bbead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:46:31 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9be28919-706c-466e-940e-d80d69c8e683 tempest-VolumesSnapshotTestJSON-581938750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab38b544-0fd3-4759-ad9e-6f9a1c6130e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:46:31 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9be28919-706c-466e-940e-d80d69c8e683 tempest-VolumesSnapshotTestJSON-581938750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab38b544-0fd3-4759-ad9e-6f9a1c6130e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '950cdf44-1fdb-4736-a6cf-9a7f0e4c482a', 'volume_name': 'volume-950cdf44-1fdb-4736-a6cf-9a7f0e4c482a', 'volume_size': 2, 'snapshot_id': 'd137be0d-a616-4449-b49c-63f549f298bd'}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:46:31 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9be28919-706c-466e-940e-d80d69c8e683 tempest-VolumesSnapshotTestJSON-581938750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1c58d7f-6622-4f94-8929-52381bae3bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:46:31 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9be28919-706c-466e-940e-d80d69c8e683 tempest-VolumesSnapshotTestJSON-581938750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1c58d7f-6622-4f94-8929-52381bae3bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:46:31 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9be28919-706c-466e-940e-d80d69c8e683 tempest-VolumesSnapshotTestJSON-581938750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80246585-d898-4956-a07a-ac97271d1073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:46:31 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-9be28919-706c-466e-940e-d80d69c8e683 tempest-VolumesSnapshotTestJSON-581938750 None] Volume 950cdf44-1fdb-4736-a6cf-9a7f0e4c482a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-950cdf44-1fdb-4736-a6cf-9a7f0e4c482a', 'volume_size': 2, 'snapshot_id': 'd137be0d-a616-4449-b49c-63f549f298bd'} Sep 08 06:46:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-9be28919-706c-466e-940e-d80d69c8e683 tempest-VolumesSnapshotTestJSON-581938750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:46:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-9be28919-706c-466e-940e-d80d69c8e683 tempest-VolumesSnapshotTestJSON-581938750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:46:31 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-9be28919-706c-466e-940e-d80d69c8e683 tempest-VolumesSnapshotTestJSON-581938750 None] Acquiring lock "cinder-quobyte-d137be0d-a616-4449-b49c-63f549f298bd-950cdf44-1fdb-4736-a6cf-9a7f0e4c482a" by "_create_volume_from_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:46:31 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-9be28919-706c-466e-940e-d80d69c8e683 tempest-VolumesSnapshotTestJSON-581938750 None] Lock "cinder-quobyte-d137be0d-a616-4449-b49c-63f549f298bd-950cdf44-1fdb-4736-a6cf-9a7f0e4c482a" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:46:31 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-9be28919-706c-466e-940e-d80d69c8e683 tempest-VolumesSnapshotTestJSON-581938750 None] Creating volume 950cdf44-1fdb-4736-a6cf-9a7f0e4c482a from snapshot d137be0d-a616-4449-b49c-63f549f298bd {{(pid=87507) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 08 06:46:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-9be28919-706c-466e-940e-d80d69c8e683 tempest-VolumesSnapshotTestJSON-581938750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:46:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-9be28919-706c-466e-940e-d80d69c8e683 tempest-VolumesSnapshotTestJSON-581938750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:46:31 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-9be28919-706c-466e-940e-d80d69c8e683 tempest-VolumesSnapshotTestJSON-581938750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:46:31 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-9be28919-706c-466e-940e-d80d69c8e683 tempest-VolumesSnapshotTestJSON-581938750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:46:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-9be28919-706c-466e-940e-d80d69c8e683 tempest-VolumesSnapshotTestJSON-581938750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:46:31 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-9be28919-706c-466e-940e-d80d69c8e683 tempest-VolumesSnapshotTestJSON-581938750 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:46:31 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-9be28919-706c-466e-940e-d80d69c8e683 tempest-VolumesSnapshotTestJSON-581938750 None] Acquiring lock "cinder-quobyte-950cdf44-1fdb-4736-a6cf-9a7f0e4c482a" by "_copy_volume_from_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:46:31 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-9be28919-706c-466e-940e-d80d69c8e683 tempest-VolumesSnapshotTestJSON-581938750 None] Lock "cinder-quobyte-950cdf44-1fdb-4736-a6cf-9a7f0e4c482a" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:46:31 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-9be28919-706c-466e-940e-d80d69c8e683 tempest-VolumesSnapshotTestJSON-581938750 None] snapshot: d137be0d-a616-4449-b49c-63f549f298bd, volume: 950cdf44-1fdb-4736-a6cf-9a7f0e4c482a, {{(pid=87507) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 08 06:46:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-9be28919-706c-466e-940e-d80d69c8e683 tempest-VolumesSnapshotTestJSON-581938750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:46:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-9be28919-706c-466e-940e-d80d69c8e683 tempest-VolumesSnapshotTestJSON-581938750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:46:31 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-9be28919-706c-466e-940e-d80d69c8e683 tempest-VolumesSnapshotTestJSON-581938750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:46:31 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-9be28919-706c-466e-940e-d80d69c8e683 tempest-VolumesSnapshotTestJSON-581938750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:46:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-9be28919-706c-466e-940e-d80d69c8e683 tempest-VolumesSnapshotTestJSON-581938750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:46:31 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d072ac68-cd2f-4661-b69d-b9fa5a69f906]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:46:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9be28919-706c-466e-940e-d80d69c8e683 tempest-VolumesSnapshotTestJSON-581938750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb.d137be0d-a616-4449-b49c-63f549f298bd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:46:31 devstack sudo[93487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb.d137be0d-a616-4449-b49c-63f549f298bd Sep 08 06:46:31 devstack sudo[93487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:46:32 devstack sudo[93487]: pam_unix(sudo:session): session closed for user root Sep 08 06:46:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9be28919-706c-466e-940e-d80d69c8e683 tempest-VolumesSnapshotTestJSON-581938750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb.d137be0d-a616-4449-b49c-63f549f298bd" returned: 0 in 0.768s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:46:32 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-9be28919-706c-466e-940e-d80d69c8e683 tempest-VolumesSnapshotTestJSON-581938750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 06:46:32 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[58079039-bb77-4b36-914c-c16898259e37]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:46:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9be28919-706c-466e-940e-d80d69c8e683 tempest-VolumesSnapshotTestJSON-581938750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:46:32 devstack sudo[93492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb Sep 08 06:46:32 devstack sudo[93492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:46:32 devstack sudo[93492]: pam_unix(sudo:session): session closed for user root Sep 08 06:46:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9be28919-706c-466e-940e-d80d69c8e683 tempest-VolumesSnapshotTestJSON-581938750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb" returned: 0 in 0.518s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:46:32 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-9be28919-706c-466e-940e-d80d69c8e683 tempest-VolumesSnapshotTestJSON-581938750 None] will copy from snapshot at /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb {{(pid=87507) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 08 06:46:32 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-9be28919-706c-466e-940e-d80d69c8e683 tempest-VolumesSnapshotTestJSON-581938750 None] Creating direct copy from snapshot {{(pid=87507) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 08 06:46:32 devstack cinder-volume[87507]: DEBUG cinder.utils [None req-9be28919-706c-466e-940e-d80d69c8e683 tempest-VolumesSnapshotTestJSON-581938750 None] Path /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-950cdf44-1fdb-4736-a6cf-9a7f0e4c482a not found in is_blk_device check {{(pid=87507) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 08 06:46:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9be28919-706c-466e-940e-d80d69c8e683 tempest-VolumesSnapshotTestJSON-581938750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-950cdf44-1fdb-4736-a6cf-9a7f0e4c482a {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:46:32 devstack sudo[93497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-950cdf44-1fdb-4736-a6cf-9a7f0e4c482a Sep 08 06:46:32 devstack sudo[93497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:46:37 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-80bafcb7-619e-40b9-9bac-2366239de505 tempest-AttachVolumeNegativeTest-1461620538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:46:37 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-80bafcb7-619e-40b9-9bac-2366239de505 tempest-AttachVolumeNegativeTest-1461620538 None] Flow 'volume_create_manager' (555de61e-6055-40aa-8d13-a64309cd1c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:46:37 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-80bafcb7-619e-40b9-9bac-2366239de505 tempest-AttachVolumeNegativeTest-1461620538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (644d56eb-4017-4799-ac81-88331d12544c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:46:37 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-80bafcb7-619e-40b9-9bac-2366239de505 tempest-AttachVolumeNegativeTest-1461620538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (644d56eb-4017-4799-ac81-88331d12544c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:46:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1992636431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb5e4dd2-98c0-4d83-b039-49665fc65014,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ce0c24857024850a79b0c7619a73fd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:46:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:46:37Z,use_quota=True,user_id='006c16241bf445aaa778b41186274e8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:46:37 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-80bafcb7-619e-40b9-9bac-2366239de505 tempest-AttachVolumeNegativeTest-1461620538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa03d383-cfc6-49c0-aa89-eedf8a9d4cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:46:37 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-80bafcb7-619e-40b9-9bac-2366239de505 tempest-AttachVolumeNegativeTest-1461620538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa03d383-cfc6-49c0-aa89-eedf8a9d4cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:46:37 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-80bafcb7-619e-40b9-9bac-2366239de505 tempest-AttachVolumeNegativeTest-1461620538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e2719b3-5f19-4ac2-afe7-f46b2502f224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:46:37 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-80bafcb7-619e-40b9-9bac-2366239de505 tempest-AttachVolumeNegativeTest-1461620538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e2719b3-5f19-4ac2-afe7-f46b2502f224) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb5e4dd2-98c0-4d83-b039-49665fc65014', 'volume_name': 'volume-eb5e4dd2-98c0-4d83-b039-49665fc65014', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:46:37 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-80bafcb7-619e-40b9-9bac-2366239de505 tempest-AttachVolumeNegativeTest-1461620538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e5ce903-7588-4971-9816-52e6802aee56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:46:37 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-80bafcb7-619e-40b9-9bac-2366239de505 tempest-AttachVolumeNegativeTest-1461620538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e5ce903-7588-4971-9816-52e6802aee56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:46:37 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-80bafcb7-619e-40b9-9bac-2366239de505 tempest-AttachVolumeNegativeTest-1461620538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb8ee82e-a9e0-4c7d-a279-bce0471cfde8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:46:37 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-80bafcb7-619e-40b9-9bac-2366239de505 tempest-AttachVolumeNegativeTest-1461620538 None] Volume eb5e4dd2-98c0-4d83-b039-49665fc65014: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb5e4dd2-98c0-4d83-b039-49665fc65014', 'volume_size': 1} Sep 08 06:46:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-80bafcb7-619e-40b9-9bac-2366239de505 tempest-AttachVolumeNegativeTest-1461620538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:46:39 devstack sudo[93497]: pam_unix(sudo:session): session closed for user root Sep 08 06:46:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9be28919-706c-466e-940e-d80d69c8e683 tempest-VolumesSnapshotTestJSON-581938750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-950cdf44-1fdb-4736-a6cf-9a7f0e4c482a" returned: 0 in 6.340s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:46:39 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-9be28919-706c-466e-940e-d80d69c8e683 tempest-VolumesSnapshotTestJSON-581938750 None] Image conversion details: src /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb, size 1024.00 MB, duration 6.34 sec, destination /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-950cdf44-1fdb-4736-a6cf-9a7f0e4c482a {{(pid=87507) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 06:46:39 devstack cinder-volume[87507]: INFO cinder.image.image_utils [None req-9be28919-706c-466e-940e-d80d69c8e683 tempest-VolumesSnapshotTestJSON-581938750 None] Converted 1024.00 MB image at 161.49 MB/s Sep 08 06:46:39 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-9be28919-706c-466e-940e-d80d69c8e683 tempest-VolumesSnapshotTestJSON-581938750 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-950cdf44-1fdb-4736-a6cf-9a7f0e4c482a is being set with open permissions: ugo+rw Sep 08 06:46:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9be28919-706c-466e-940e-d80d69c8e683 tempest-VolumesSnapshotTestJSON-581938750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-950cdf44-1fdb-4736-a6cf-9a7f0e4c482a {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:46:39 devstack sudo[93532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-950cdf44-1fdb-4736-a6cf-9a7f0e4c482a Sep 08 06:46:39 devstack sudo[93532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:46:39 devstack sudo[93532]: pam_unix(sudo:session): session closed for user root Sep 08 06:46:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9be28919-706c-466e-940e-d80d69c8e683 tempest-VolumesSnapshotTestJSON-581938750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-950cdf44-1fdb-4736-a6cf-9a7f0e4c482a" returned: 0 in 0.294s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:46:39 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-9be28919-706c-466e-940e-d80d69c8e683 tempest-VolumesSnapshotTestJSON-581938750 None] Lock "cinder-quobyte-950cdf44-1fdb-4736-a6cf-9a7f0e4c482a" released by "_copy_volume_from_snapshot" :: held 8.037s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:46:39 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-9be28919-706c-466e-940e-d80d69c8e683 tempest-VolumesSnapshotTestJSON-581938750 None] Lock "cinder-quobyte-d137be0d-a616-4449-b49c-63f549f298bd-950cdf44-1fdb-4736-a6cf-9a7f0e4c482a" released by "_create_volume_from_snapshot" :: held 8.106s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:46:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-9be28919-706c-466e-940e-d80d69c8e683 tempest-VolumesSnapshotTestJSON-581938750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.147s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:46:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-80bafcb7-619e-40b9-9bac-2366239de505 tempest-AttachVolumeNegativeTest-1461620538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.759s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:46:39 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-80bafcb7-619e-40b9-9bac-2366239de505 tempest-AttachVolumeNegativeTest-1461620538 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:46:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1992636431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb5e4dd2-98c0-4d83-b039-49665fc65014,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ce0c24857024850a79b0c7619a73fd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:46:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:46:37Z,use_quota=True,user_id='006c16241bf445aaa778b41186274e8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:46:39 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-80bafcb7-619e-40b9-9bac-2366239de505 tempest-AttachVolumeNegativeTest-1461620538 None] Creating volume eb5e4dd2-98c0-4d83-b039-49665fc65014 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:46:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-80bafcb7-619e-40b9-9bac-2366239de505 tempest-AttachVolumeNegativeTest-1461620538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:46:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-80bafcb7-619e-40b9-9bac-2366239de505 tempest-AttachVolumeNegativeTest-1461620538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:46:39 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-80bafcb7-619e-40b9-9bac-2366239de505 tempest-AttachVolumeNegativeTest-1461620538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:46:39 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-80bafcb7-619e-40b9-9bac-2366239de505 tempest-AttachVolumeNegativeTest-1461620538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:46:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-80bafcb7-619e-40b9-9bac-2366239de505 tempest-AttachVolumeNegativeTest-1461620538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:46:39 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-80bafcb7-619e-40b9-9bac-2366239de505 tempest-AttachVolumeNegativeTest-1461620538 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:46:39 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-80bafcb7-619e-40b9-9bac-2366239de505 tempest-AttachVolumeNegativeTest-1461620538 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:46:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-80bafcb7-619e-40b9-9bac-2366239de505 tempest-AttachVolumeNegativeTest-1461620538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-eb5e4dd2-98c0-4d83-b039-49665fc65014 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:46:39 devstack sudo[93535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-eb5e4dd2-98c0-4d83-b039-49665fc65014 1073741824 Sep 08 06:46:39 devstack sudo[93535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:46:39 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9be28919-706c-466e-940e-d80d69c8e683 tempest-VolumesSnapshotTestJSON-581938750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80246585-d898-4956-a07a-ac97271d1073) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-950cdf44-1fdb-4736-a6cf-9a7f0e4c482a', 'volume_size': 2, 'snapshot_id': 'd137be0d-a616-4449-b49c-63f549f298bd'}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:46:39 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9be28919-706c-466e-940e-d80d69c8e683 tempest-VolumesSnapshotTestJSON-581938750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef6cc2ca-a66c-45cc-a182-f1aa8badb3d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:46:39 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-9be28919-706c-466e-940e-d80d69c8e683 tempest-VolumesSnapshotTestJSON-581938750 None] Volume volume-950cdf44-1fdb-4736-a6cf-9a7f0e4c482a (950cdf44-1fdb-4736-a6cf-9a7f0e4c482a): created successfully Sep 08 06:46:39 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9be28919-706c-466e-940e-d80d69c8e683 tempest-VolumesSnapshotTestJSON-581938750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef6cc2ca-a66c-45cc-a182-f1aa8badb3d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:46:39 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9be28919-706c-466e-940e-d80d69c8e683 tempest-VolumesSnapshotTestJSON-581938750 None] Flow 'volume_create_manager' (af2c0568-c9ed-4f3c-a02b-b31b17810582) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:46:39 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-9be28919-706c-466e-940e-d80d69c8e683 tempest-VolumesSnapshotTestJSON-581938750 None] Created volume successfully. Sep 08 06:46:39 devstack sudo[93535]: pam_unix(sudo:session): session closed for user root Sep 08 06:46:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-80bafcb7-619e-40b9-9bac-2366239de505 tempest-AttachVolumeNegativeTest-1461620538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-eb5e4dd2-98c0-4d83-b039-49665fc65014 1073741824" returned: 0 in 0.428s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:46:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-80bafcb7-619e-40b9-9bac-2366239de505 tempest-AttachVolumeNegativeTest-1461620538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-eb5e4dd2-98c0-4d83-b039-49665fc65014 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:46:39 devstack sudo[93541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-eb5e4dd2-98c0-4d83-b039-49665fc65014 Sep 08 06:46:39 devstack sudo[93541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:46:40 devstack sudo[93541]: pam_unix(sudo:session): session closed for user root Sep 08 06:46:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-80bafcb7-619e-40b9-9bac-2366239de505 tempest-AttachVolumeNegativeTest-1461620538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-eb5e4dd2-98c0-4d83-b039-49665fc65014" returned: 0 in 0.243s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:46:40 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-80bafcb7-619e-40b9-9bac-2366239de505 tempest-AttachVolumeNegativeTest-1461620538 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:46:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-80bafcb7-619e-40b9-9bac-2366239de505 tempest-AttachVolumeNegativeTest-1461620538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:46:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-80bafcb7-619e-40b9-9bac-2366239de505 tempest-AttachVolumeNegativeTest-1461620538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb8ee82e-a9e0-4c7d-a279-bce0471cfde8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb5e4dd2-98c0-4d83-b039-49665fc65014', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:46:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-80bafcb7-619e-40b9-9bac-2366239de505 tempest-AttachVolumeNegativeTest-1461620538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d19e70f-928b-4f1d-ad15-efada548b136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:46:40 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-80bafcb7-619e-40b9-9bac-2366239de505 tempest-AttachVolumeNegativeTest-1461620538 None] Volume volume-eb5e4dd2-98c0-4d83-b039-49665fc65014 (eb5e4dd2-98c0-4d83-b039-49665fc65014): created successfully Sep 08 06:46:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-80bafcb7-619e-40b9-9bac-2366239de505 tempest-AttachVolumeNegativeTest-1461620538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d19e70f-928b-4f1d-ad15-efada548b136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:46:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-80bafcb7-619e-40b9-9bac-2366239de505 tempest-AttachVolumeNegativeTest-1461620538 None] Flow 'volume_create_manager' (555de61e-6055-40aa-8d13-a64309cd1c2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:46:40 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-80bafcb7-619e-40b9-9bac-2366239de505 tempest-AttachVolumeNegativeTest-1461620538 None] Created volume successfully. Sep 08 06:46:40 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-be66a22d-15c6-4e7d-a06f-7e389666f22f tempest-VolumesSnapshotTestJSON-581938750 None] Acquiring lock "cinder-950cdf44-1fdb-4736-a6cf-9a7f0e4c482a-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:46:40 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-be66a22d-15c6-4e7d-a06f-7e389666f22f tempest-VolumesSnapshotTestJSON-581938750 None] Lock "cinder-950cdf44-1fdb-4736-a6cf-9a7f0e4c482a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:46:40 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-be66a22d-15c6-4e7d-a06f-7e389666f22f tempest-VolumesSnapshotTestJSON-581938750 None] Acquiring lock "cinder-quobyte-950cdf44-1fdb-4736-a6cf-9a7f0e4c482a" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:46:40 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-be66a22d-15c6-4e7d-a06f-7e389666f22f tempest-VolumesSnapshotTestJSON-581938750 None] Lock "cinder-quobyte-950cdf44-1fdb-4736-a6cf-9a7f0e4c482a" acquired by "delete_volume" :: waited 0.022s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:46:40 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5fd50e-648f-4a98-b15a-b1c886e11d74]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:46:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-be66a22d-15c6-4e7d-a06f-7e389666f22f tempest-VolumesSnapshotTestJSON-581938750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-950cdf44-1fdb-4736-a6cf-9a7f0e4c482a {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:46:40 devstack sudo[93544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-950cdf44-1fdb-4736-a6cf-9a7f0e4c482a Sep 08 06:46:40 devstack sudo[93544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:46:41 devstack sudo[93544]: pam_unix(sudo:session): session closed for user root Sep 08 06:46:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-be66a22d-15c6-4e7d-a06f-7e389666f22f tempest-VolumesSnapshotTestJSON-581938750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-950cdf44-1fdb-4736-a6cf-9a7f0e4c482a" returned: 0 in 0.449s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:46:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-be66a22d-15c6-4e7d-a06f-7e389666f22f tempest-VolumesSnapshotTestJSON-581938750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-950cdf44-1fdb-4736-a6cf-9a7f0e4c482a {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:46:41 devstack sudo[93553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-950cdf44-1fdb-4736-a6cf-9a7f0e4c482a Sep 08 06:46:41 devstack sudo[93553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:46:41 devstack sudo[93553]: pam_unix(sudo:session): session closed for user root Sep 08 06:46:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-be66a22d-15c6-4e7d-a06f-7e389666f22f tempest-VolumesSnapshotTestJSON-581938750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-950cdf44-1fdb-4736-a6cf-9a7f0e4c482a" returned: 0 in 0.332s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:46:41 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-be66a22d-15c6-4e7d-a06f-7e389666f22f tempest-VolumesSnapshotTestJSON-581938750 None] Lock "cinder-quobyte-950cdf44-1fdb-4736-a6cf-9a7f0e4c482a" released by "delete_volume" :: held 0.839s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:46:41 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-be66a22d-15c6-4e7d-a06f-7e389666f22f tempest-VolumesSnapshotTestJSON-581938750 None] Created reservations ['6a84e803-4120-4fa9-9ec3-f3b57e0eced6', '8b65670c-de0f-4197-9a5b-230b74edced5', 'da12bd86-090c-4b77-9c39-a957c8cc601d', 'd0ff4eb7-957c-4091-a4b0-115ddb070bb2'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:46:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-be66a22d-15c6-4e7d-a06f-7e389666f22f tempest-VolumesSnapshotTestJSON-581938750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:46:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-be66a22d-15c6-4e7d-a06f-7e389666f22f tempest-VolumesSnapshotTestJSON-581938750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:46:41 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-be66a22d-15c6-4e7d-a06f-7e389666f22f tempest-VolumesSnapshotTestJSON-581938750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:46:41 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-be66a22d-15c6-4e7d-a06f-7e389666f22f tempest-VolumesSnapshotTestJSON-581938750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:46:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-be66a22d-15c6-4e7d-a06f-7e389666f22f tempest-VolumesSnapshotTestJSON-581938750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:46:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-be66a22d-15c6-4e7d-a06f-7e389666f22f tempest-VolumesSnapshotTestJSON-581938750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:46:41 devstack sudo[93566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:46:41 devstack sudo[93566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:46:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-9fcd39d3-6d3b-45d6-b8d4-4eb73b1a2beb req-683e026f-d160-4dd4-92bc-356ded83b85d tempest-AttachVolumeNegativeTest-1461620538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:46:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-9fcd39d3-6d3b-45d6-b8d4-4eb73b1a2beb req-683e026f-d160-4dd4-92bc-356ded83b85d tempest-AttachVolumeNegativeTest-1461620538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:46:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-9fcd39d3-6d3b-45d6-b8d4-4eb73b1a2beb req-683e026f-d160-4dd4-92bc-356ded83b85d tempest-AttachVolumeNegativeTest-1461620538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:46:41 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-9fcd39d3-6d3b-45d6-b8d4-4eb73b1a2beb req-683e026f-d160-4dd4-92bc-356ded83b85d tempest-AttachVolumeNegativeTest-1461620538 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d', 'name': 'volume-eb5e4dd2-98c0-4d83-b039-49665fc65014', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1de7ec24-5141-41fd-a8ef-1cc6917da0a9', 'enforce_multipath': True} {{(pid=87507) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 06:46:41 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-3b90ea4f-913a-428a-912f-88e748a74c4b tempest-VolumesSnapshotTestJSON-581938750 None] Acquiring lock "cinder-d137be0d-a616-4449-b49c-63f549f298bd-delete_snapshot" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:46:41 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-3b90ea4f-913a-428a-912f-88e748a74c4b tempest-VolumesSnapshotTestJSON-581938750 None] Lock "cinder-d137be0d-a616-4449-b49c-63f549f298bd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:46:41 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-3b90ea4f-913a-428a-912f-88e748a74c4b tempest-VolumesSnapshotTestJSON-581938750 None] Acquiring lock "cinder-quobyte-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:46:41 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-3b90ea4f-913a-428a-912f-88e748a74c4b tempest-VolumesSnapshotTestJSON-581938750 None] Lock "cinder-quobyte-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:46:41 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-3b90ea4f-913a-428a-912f-88e748a74c4b tempest-VolumesSnapshotTestJSON-581938750 None] Acquiring lock "cinder-quobyte-d137be0d-a616-4449-b49c-63f549f298bd" by "_delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:46:41 devstack sudo[93566]: pam_unix(sudo:session): session closed for user root Sep 08 06:46:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-be66a22d-15c6-4e7d-a06f-7e389666f22f tempest-VolumesSnapshotTestJSON-581938750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.295s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:46:41 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-be66a22d-15c6-4e7d-a06f-7e389666f22f tempest-VolumesSnapshotTestJSON-581938750 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:46:41 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-3b90ea4f-913a-428a-912f-88e748a74c4b tempest-VolumesSnapshotTestJSON-581938750 None] Lock "cinder-quobyte-d137be0d-a616-4449-b49c-63f549f298bd" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:46:41 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-3b90ea4f-913a-428a-912f-88e748a74c4b tempest-VolumesSnapshotTestJSON-581938750 None] Deleting offline snapshot d137be0d-a616-4449-b49c-63f549f298bd of volume 2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 06:46:41 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-3b90ea4f-913a-428a-912f-88e748a74c4b tempest-VolumesSnapshotTestJSON-581938750 None] snapshot_file for this snap is: volume-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb.d137be0d-a616-4449-b49c-63f549f298bd {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 06:46:41 devstack cinder-volume[87507]: INFO cinder.volume.manager [req-9fcd39d3-6d3b-45d6-b8d4-4eb73b1a2beb req-683e026f-d160-4dd4-92bc-356ded83b85d tempest-AttachVolumeNegativeTest-1461620538 None] attachment_update completed successfully. Sep 08 06:46:41 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-be66a22d-15c6-4e7d-a06f-7e389666f22f tempest-VolumesSnapshotTestJSON-581938750 None] Deleted volume successfully. Sep 08 06:46:41 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25dfd78-517a-4e8f-b00b-d55bf228e329]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:46:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3b90ea4f-913a-428a-912f-88e748a74c4b tempest-VolumesSnapshotTestJSON-581938750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb.d137be0d-a616-4449-b49c-63f549f298bd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:46:42 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-be66a22d-15c6-4e7d-a06f-7e389666f22f tempest-VolumesSnapshotTestJSON-581938750 None] Lock "cinder-950cdf44-1fdb-4736-a6cf-9a7f0e4c482a-delete_volume" released by "delete_volume" :: held 1.436s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:46:42 devstack sudo[93569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb.d137be0d-a616-4449-b49c-63f549f298bd Sep 08 06:46:42 devstack sudo[93569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:46:42 devstack sudo[93569]: pam_unix(sudo:session): session closed for user root Sep 08 06:46:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3b90ea4f-913a-428a-912f-88e748a74c4b tempest-VolumesSnapshotTestJSON-581938750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb.d137be0d-a616-4449-b49c-63f549f298bd" returned: 0 in 0.508s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:46:42 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-3b90ea4f-913a-428a-912f-88e748a74c4b tempest-VolumesSnapshotTestJSON-581938750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 06:46:42 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf6485d-b109-4f7d-8901-a71952e4b273]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:46:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3b90ea4f-913a-428a-912f-88e748a74c4b tempest-VolumesSnapshotTestJSON-581938750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:46:42 devstack sudo[93959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb Sep 08 06:46:42 devstack sudo[93959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:46:43 devstack sudo[93959]: pam_unix(sudo:session): session closed for user root Sep 08 06:46:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3b90ea4f-913a-428a-912f-88e748a74c4b tempest-VolumesSnapshotTestJSON-581938750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb" returned: 0 in 0.603s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:46:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3b90ea4f-913a-428a-912f-88e748a74c4b tempest-VolumesSnapshotTestJSON-581938750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb.d137be0d-a616-4449-b49c-63f549f298bd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:46:43 devstack sudo[93965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb.d137be0d-a616-4449-b49c-63f549f298bd Sep 08 06:46:43 devstack sudo[93965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:46:43 devstack sudo[93965]: pam_unix(sudo:session): session closed for user root Sep 08 06:46:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3b90ea4f-913a-428a-912f-88e748a74c4b tempest-VolumesSnapshotTestJSON-581938750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb.d137be0d-a616-4449-b49c-63f549f298bd" returned: 0 in 0.395s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:46:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3b90ea4f-913a-428a-912f-88e748a74c4b tempest-VolumesSnapshotTestJSON-581938750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb.d137be0d-a616-4449-b49c-63f549f298bd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:46:43 devstack sudo[93971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb.d137be0d-a616-4449-b49c-63f549f298bd Sep 08 06:46:43 devstack sudo[93971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:46:43 devstack sudo[93971]: pam_unix(sudo:session): session closed for user root Sep 08 06:46:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3b90ea4f-913a-428a-912f-88e748a74c4b tempest-VolumesSnapshotTestJSON-581938750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb.d137be0d-a616-4449-b49c-63f549f298bd" returned: 0 in 0.341s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:46:43 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-3b90ea4f-913a-428a-912f-88e748a74c4b tempest-VolumesSnapshotTestJSON-581938750 None] Lock "cinder-quobyte-d137be0d-a616-4449-b49c-63f549f298bd" released by "_delete_snapshot" :: held 1.985s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:46:43 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-3b90ea4f-913a-428a-912f-88e748a74c4b tempest-VolumesSnapshotTestJSON-581938750 None] Lock "cinder-quobyte-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb" released by "delete_snapshot" :: held 2.026s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:46:44 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-3b90ea4f-913a-428a-912f-88e748a74c4b tempest-VolumesSnapshotTestJSON-581938750 None] Created reservations ['c125b69b-a13e-44db-a26f-2659eaad5027', '48587c68-4bce-438a-853f-f24a04118140', '24bf2c88-bcaf-4e83-b393-0a17ebcf04ca', 'd86b8d00-6477-4433-aff2-7ec7fc092b8a'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:46:44 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-3b90ea4f-913a-428a-912f-88e748a74c4b tempest-VolumesSnapshotTestJSON-581938750 None] Delete snapshot completed successfully. Sep 08 06:46:44 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-3b90ea4f-913a-428a-912f-88e748a74c4b tempest-VolumesSnapshotTestJSON-581938750 None] Lock "cinder-d137be0d-a616-4449-b49c-63f549f298bd-delete_snapshot" released by "delete_snapshot" :: held 2.232s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:46:44 devstack cinder-volume[87507]: INFO cinder.volume.manager [req-38444dc9-4f8c-481b-aa1c-310ec22e1a44 req-74ecb376-713e-42fd-82a5-32932344d041 tempest-AttachVolumeNegativeTest-1461620538 None] Terminate volume connection completed successfully. Sep 08 06:46:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-38444dc9-4f8c-481b-aa1c-310ec22e1a44 req-74ecb376-713e-42fd-82a5-32932344d041 tempest-AttachVolumeNegativeTest-1461620538 None] Deleting attachment 1de7ec24-5141-41fd-a8ef-1cc6917da0a9. {{(pid=87507) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 06:46:45 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-4d713ec0-775c-450c-9bfd-ba5efdf4f598 tempest-VolumesSnapshotTestJSON-581938750 None] Acquiring lock "cinder-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:46:45 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-4d713ec0-775c-450c-9bfd-ba5efdf4f598 tempest-VolumesSnapshotTestJSON-581938750 None] Lock "cinder-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:46:45 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-4d713ec0-775c-450c-9bfd-ba5efdf4f598 tempest-VolumesSnapshotTestJSON-581938750 None] Acquiring lock "cinder-quobyte-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:46:45 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-4d713ec0-775c-450c-9bfd-ba5efdf4f598 tempest-VolumesSnapshotTestJSON-581938750 None] Lock "cinder-quobyte-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb" acquired by "delete_volume" :: waited 0.048s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:46:45 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8cb1ef4-19c8-4695-ac91-bcc5b4c5828f]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:46:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4d713ec0-775c-450c-9bfd-ba5efdf4f598 tempest-VolumesSnapshotTestJSON-581938750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:46:45 devstack sudo[94001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb Sep 08 06:46:45 devstack sudo[94001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:46:45 devstack sudo[94001]: pam_unix(sudo:session): session closed for user root Sep 08 06:46:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4d713ec0-775c-450c-9bfd-ba5efdf4f598 tempest-VolumesSnapshotTestJSON-581938750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb" returned: 0 in 0.472s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:46:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4d713ec0-775c-450c-9bfd-ba5efdf4f598 tempest-VolumesSnapshotTestJSON-581938750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:46:45 devstack sudo[94008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb Sep 08 06:46:45 devstack sudo[94008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:46:46 devstack sudo[94008]: pam_unix(sudo:session): session closed for user root Sep 08 06:46:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4d713ec0-775c-450c-9bfd-ba5efdf4f598 tempest-VolumesSnapshotTestJSON-581938750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb" returned: 0 in 0.417s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:46:46 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-4d713ec0-775c-450c-9bfd-ba5efdf4f598 tempest-VolumesSnapshotTestJSON-581938750 None] Lock "cinder-quobyte-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb" released by "delete_volume" :: held 0.980s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:46:46 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-4d713ec0-775c-450c-9bfd-ba5efdf4f598 tempest-VolumesSnapshotTestJSON-581938750 None] Created reservations ['fb55faa5-1ba0-41f9-b835-3f193cb55ce6', 'c8dee13c-26bd-490a-9424-a3363671707d', '5259920e-f997-4b95-a047-a947b124b1ab', '5ac9c11a-8afa-4e13-8326-552a3b13a6f8'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:46:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4d713ec0-775c-450c-9bfd-ba5efdf4f598 tempest-VolumesSnapshotTestJSON-581938750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:46:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4d713ec0-775c-450c-9bfd-ba5efdf4f598 tempest-VolumesSnapshotTestJSON-581938750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:46:46 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-4d713ec0-775c-450c-9bfd-ba5efdf4f598 tempest-VolumesSnapshotTestJSON-581938750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:46:46 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-4d713ec0-775c-450c-9bfd-ba5efdf4f598 tempest-VolumesSnapshotTestJSON-581938750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:46:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4d713ec0-775c-450c-9bfd-ba5efdf4f598 tempest-VolumesSnapshotTestJSON-581938750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:46:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4d713ec0-775c-450c-9bfd-ba5efdf4f598 tempest-VolumesSnapshotTestJSON-581938750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:46:46 devstack sudo[94032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:46:46 devstack sudo[94032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:46:46 devstack sudo[94032]: pam_unix(sudo:session): session closed for user root Sep 08 06:46:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4d713ec0-775c-450c-9bfd-ba5efdf4f598 tempest-VolumesSnapshotTestJSON-581938750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.295s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:46:46 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-4d713ec0-775c-450c-9bfd-ba5efdf4f598 tempest-VolumesSnapshotTestJSON-581938750 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:46:46 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-4d713ec0-775c-450c-9bfd-ba5efdf4f598 tempest-VolumesSnapshotTestJSON-581938750 None] Deleted volume successfully. Sep 08 06:46:46 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-4d713ec0-775c-450c-9bfd-ba5efdf4f598 tempest-VolumesSnapshotTestJSON-581938750 None] Lock "cinder-2ee28467-dfaf-4b2c-b4fc-2e4a92754fdb-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:46:48 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-20d7d0d3-d0ed-44a3-ae12-79ced41b3ec0 tempest-VolumesSnapshotTestJSON-581938750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:46:48 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-20d7d0d3-d0ed-44a3-ae12-79ced41b3ec0 tempest-VolumesSnapshotTestJSON-581938750 None] Flow 'volume_create_manager' (882bb84f-8aa7-4393-80d6-9733a37f3f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:46:48 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-20d7d0d3-d0ed-44a3-ae12-79ced41b3ec0 tempest-VolumesSnapshotTestJSON-581938750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95a0533f-4dfe-4923-949d-369db2a99c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:46:48 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-20d7d0d3-d0ed-44a3-ae12-79ced41b3ec0 tempest-VolumesSnapshotTestJSON-581938750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95a0533f-4dfe-4923-949d-369db2a99c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:46:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-670375940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b4941bb1fb44fbbbbda64a8438bf66a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:46:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:46:48Z,use_quota=True,user_id='a8ab0d637f5f4712b0d4425f6bf56b83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:46:48 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-20d7d0d3-d0ed-44a3-ae12-79ced41b3ec0 tempest-VolumesSnapshotTestJSON-581938750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (959b35dd-3ae5-4cec-a7fd-d439cbacb465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:46:48 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-20d7d0d3-d0ed-44a3-ae12-79ced41b3ec0 tempest-VolumesSnapshotTestJSON-581938750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (959b35dd-3ae5-4cec-a7fd-d439cbacb465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:46:48 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-20d7d0d3-d0ed-44a3-ae12-79ced41b3ec0 tempest-VolumesSnapshotTestJSON-581938750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b862907-b60c-4114-b9bc-e298f03dc289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:46:48 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-20d7d0d3-d0ed-44a3-ae12-79ced41b3ec0 tempest-VolumesSnapshotTestJSON-581938750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b862907-b60c-4114-b9bc-e298f03dc289) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0', 'volume_name': 'volume-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:46:48 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-20d7d0d3-d0ed-44a3-ae12-79ced41b3ec0 tempest-VolumesSnapshotTestJSON-581938750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02c6b20a-d766-46ed-98d1-5a73e6f9ffca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:46:48 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-20d7d0d3-d0ed-44a3-ae12-79ced41b3ec0 tempest-VolumesSnapshotTestJSON-581938750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02c6b20a-d766-46ed-98d1-5a73e6f9ffca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:46:48 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-20d7d0d3-d0ed-44a3-ae12-79ced41b3ec0 tempest-VolumesSnapshotTestJSON-581938750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3192a09-4421-4a8c-b7b7-87b4cb9a4618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:46:48 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-20d7d0d3-d0ed-44a3-ae12-79ced41b3ec0 tempest-VolumesSnapshotTestJSON-581938750 None] Volume c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0', 'volume_size': 1} Sep 08 06:46:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-20d7d0d3-d0ed-44a3-ae12-79ced41b3ec0 tempest-VolumesSnapshotTestJSON-581938750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:46:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-20d7d0d3-d0ed-44a3-ae12-79ced41b3ec0 tempest-VolumesSnapshotTestJSON-581938750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:46:48 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-20d7d0d3-d0ed-44a3-ae12-79ced41b3ec0 tempest-VolumesSnapshotTestJSON-581938750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:46:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-670375940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b4941bb1fb44fbbbbda64a8438bf66a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:46:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:46:48Z,use_quota=True,user_id='a8ab0d637f5f4712b0d4425f6bf56b83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:46:48 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-20d7d0d3-d0ed-44a3-ae12-79ced41b3ec0 tempest-VolumesSnapshotTestJSON-581938750 None] Creating volume c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:46:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-20d7d0d3-d0ed-44a3-ae12-79ced41b3ec0 tempest-VolumesSnapshotTestJSON-581938750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:46:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-20d7d0d3-d0ed-44a3-ae12-79ced41b3ec0 tempest-VolumesSnapshotTestJSON-581938750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:46:48 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-20d7d0d3-d0ed-44a3-ae12-79ced41b3ec0 tempest-VolumesSnapshotTestJSON-581938750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:46:48 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-20d7d0d3-d0ed-44a3-ae12-79ced41b3ec0 tempest-VolumesSnapshotTestJSON-581938750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:46:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-20d7d0d3-d0ed-44a3-ae12-79ced41b3ec0 tempest-VolumesSnapshotTestJSON-581938750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:46:48 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-20d7d0d3-d0ed-44a3-ae12-79ced41b3ec0 tempest-VolumesSnapshotTestJSON-581938750 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:46:48 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-20d7d0d3-d0ed-44a3-ae12-79ced41b3ec0 tempest-VolumesSnapshotTestJSON-581938750 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:46:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-20d7d0d3-d0ed-44a3-ae12-79ced41b3ec0 tempest-VolumesSnapshotTestJSON-581938750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:46:48 devstack sudo[94038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0 1073741824 Sep 08 06:46:48 devstack sudo[94038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:46:48 devstack sudo[94038]: pam_unix(sudo:session): session closed for user root Sep 08 06:46:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-20d7d0d3-d0ed-44a3-ae12-79ced41b3ec0 tempest-VolumesSnapshotTestJSON-581938750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0 1073741824" returned: 0 in 0.510s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:46:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-20d7d0d3-d0ed-44a3-ae12-79ced41b3ec0 tempest-VolumesSnapshotTestJSON-581938750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:46:48 devstack sudo[94045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0 Sep 08 06:46:48 devstack sudo[94045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:46:49 devstack sudo[94045]: pam_unix(sudo:session): session closed for user root Sep 08 06:46:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-20d7d0d3-d0ed-44a3-ae12-79ced41b3ec0 tempest-VolumesSnapshotTestJSON-581938750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0" returned: 0 in 0.282s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:46:49 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-20d7d0d3-d0ed-44a3-ae12-79ced41b3ec0 tempest-VolumesSnapshotTestJSON-581938750 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:46:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-20d7d0d3-d0ed-44a3-ae12-79ced41b3ec0 tempest-VolumesSnapshotTestJSON-581938750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:46:49 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-20d7d0d3-d0ed-44a3-ae12-79ced41b3ec0 tempest-VolumesSnapshotTestJSON-581938750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3192a09-4421-4a8c-b7b7-87b4cb9a4618) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:46:49 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-20d7d0d3-d0ed-44a3-ae12-79ced41b3ec0 tempest-VolumesSnapshotTestJSON-581938750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c618bf73-8ef5-41f0-b286-82e938b32a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:46:49 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-20d7d0d3-d0ed-44a3-ae12-79ced41b3ec0 tempest-VolumesSnapshotTestJSON-581938750 None] Volume volume-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0 (c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0): created successfully Sep 08 06:46:49 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-20d7d0d3-d0ed-44a3-ae12-79ced41b3ec0 tempest-VolumesSnapshotTestJSON-581938750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c618bf73-8ef5-41f0-b286-82e938b32a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:46:49 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-20d7d0d3-d0ed-44a3-ae12-79ced41b3ec0 tempest-VolumesSnapshotTestJSON-581938750 None] Flow 'volume_create_manager' (882bb84f-8aa7-4393-80d6-9733a37f3f33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:46:49 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-20d7d0d3-d0ed-44a3-ae12-79ced41b3ec0 tempest-VolumesSnapshotTestJSON-581938750 None] Created volume successfully. Sep 08 06:46:50 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-35720556-7d0d-45ff-bbfd-d0f6334898f1 tempest-AttachVolumeTestJSON-921065048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:46:50 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-35720556-7d0d-45ff-bbfd-d0f6334898f1 tempest-AttachVolumeTestJSON-921065048 None] Flow 'volume_create_manager' (b9c687e5-5076-4d93-98c8-bd098dd168ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:46:50 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-35720556-7d0d-45ff-bbfd-d0f6334898f1 tempest-AttachVolumeTestJSON-921065048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f36fef17-6512-46da-a33e-557c14dcc4dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:46:50 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-35720556-7d0d-45ff-bbfd-d0f6334898f1 tempest-AttachVolumeTestJSON-921065048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f36fef17-6512-46da-a33e-557c14dcc4dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:46:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1211093888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05a9c336-6790-414a-9df8-7d73202be656,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d24378ce46b49c998e4274f6641dc7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:46:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:46:50Z,use_quota=True,user_id='be05327e06eb4b9d9c691b01580cfdf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:46:50 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-35720556-7d0d-45ff-bbfd-d0f6334898f1 tempest-AttachVolumeTestJSON-921065048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1080ac94-a112-42ad-a3a9-101676bb223a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:46:50 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-35720556-7d0d-45ff-bbfd-d0f6334898f1 tempest-AttachVolumeTestJSON-921065048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1080ac94-a112-42ad-a3a9-101676bb223a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:46:50 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-35720556-7d0d-45ff-bbfd-d0f6334898f1 tempest-AttachVolumeTestJSON-921065048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e374a13-4882-4f0c-9b77-ed6ced3edd4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:46:50 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-35720556-7d0d-45ff-bbfd-d0f6334898f1 tempest-AttachVolumeTestJSON-921065048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e374a13-4882-4f0c-9b77-ed6ced3edd4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05a9c336-6790-414a-9df8-7d73202be656', 'volume_name': 'volume-05a9c336-6790-414a-9df8-7d73202be656', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:46:50 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-35720556-7d0d-45ff-bbfd-d0f6334898f1 tempest-AttachVolumeTestJSON-921065048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b418b88-ac39-446c-93b7-82ec1e577e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:46:50 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-35720556-7d0d-45ff-bbfd-d0f6334898f1 tempest-AttachVolumeTestJSON-921065048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b418b88-ac39-446c-93b7-82ec1e577e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:46:50 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-35720556-7d0d-45ff-bbfd-d0f6334898f1 tempest-AttachVolumeTestJSON-921065048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d3d28cf-c624-41ab-ba07-d09cb0dc0ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:46:50 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-35720556-7d0d-45ff-bbfd-d0f6334898f1 tempest-AttachVolumeTestJSON-921065048 None] Volume 05a9c336-6790-414a-9df8-7d73202be656: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05a9c336-6790-414a-9df8-7d73202be656', 'volume_size': 1} Sep 08 06:46:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-35720556-7d0d-45ff-bbfd-d0f6334898f1 tempest-AttachVolumeTestJSON-921065048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:46:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-35720556-7d0d-45ff-bbfd-d0f6334898f1 tempest-AttachVolumeTestJSON-921065048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:46:50 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-35720556-7d0d-45ff-bbfd-d0f6334898f1 tempest-AttachVolumeTestJSON-921065048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:46:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1211093888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05a9c336-6790-414a-9df8-7d73202be656,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d24378ce46b49c998e4274f6641dc7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:46:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:46:50Z,use_quota=True,user_id='be05327e06eb4b9d9c691b01580cfdf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:46:50 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-35720556-7d0d-45ff-bbfd-d0f6334898f1 tempest-AttachVolumeTestJSON-921065048 None] Creating volume 05a9c336-6790-414a-9df8-7d73202be656 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:46:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-35720556-7d0d-45ff-bbfd-d0f6334898f1 tempest-AttachVolumeTestJSON-921065048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:46:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-35720556-7d0d-45ff-bbfd-d0f6334898f1 tempest-AttachVolumeTestJSON-921065048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:46:50 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-35720556-7d0d-45ff-bbfd-d0f6334898f1 tempest-AttachVolumeTestJSON-921065048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:46:50 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-35720556-7d0d-45ff-bbfd-d0f6334898f1 tempest-AttachVolumeTestJSON-921065048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:46:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-35720556-7d0d-45ff-bbfd-d0f6334898f1 tempest-AttachVolumeTestJSON-921065048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:46:50 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-35720556-7d0d-45ff-bbfd-d0f6334898f1 tempest-AttachVolumeTestJSON-921065048 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:46:50 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-35720556-7d0d-45ff-bbfd-d0f6334898f1 tempest-AttachVolumeTestJSON-921065048 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:46:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-35720556-7d0d-45ff-bbfd-d0f6334898f1 tempest-AttachVolumeTestJSON-921065048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-05a9c336-6790-414a-9df8-7d73202be656 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:46:50 devstack sudo[94054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-05a9c336-6790-414a-9df8-7d73202be656 1073741824 Sep 08 06:46:50 devstack sudo[94054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:46:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-468b84d9-9c66-4ff8-b446-44a5ada6c099 tempest-VolumesSnapshotTestJSON-581938750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:46:50 devstack sudo[94054]: pam_unix(sudo:session): session closed for user root Sep 08 06:46:50 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-817cf74f-3ec7-4f8b-8623-4079c934f9e9 tempest-AttachVolumeNegativeTest-1461620538 None] Acquiring lock "cinder-eb5e4dd2-98c0-4d83-b039-49665fc65014-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:46:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-35720556-7d0d-45ff-bbfd-d0f6334898f1 tempest-AttachVolumeTestJSON-921065048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-05a9c336-6790-414a-9df8-7d73202be656 1073741824" returned: 0 in 0.622s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:46:50 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-817cf74f-3ec7-4f8b-8623-4079c934f9e9 tempest-AttachVolumeNegativeTest-1461620538 None] Lock "cinder-eb5e4dd2-98c0-4d83-b039-49665fc65014-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:46:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-35720556-7d0d-45ff-bbfd-d0f6334898f1 tempest-AttachVolumeTestJSON-921065048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-05a9c336-6790-414a-9df8-7d73202be656 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:46:50 devstack sudo[94060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-05a9c336-6790-414a-9df8-7d73202be656 Sep 08 06:46:50 devstack sudo[94060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:46:50 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-817cf74f-3ec7-4f8b-8623-4079c934f9e9 tempest-AttachVolumeNegativeTest-1461620538 None] Acquiring lock "cinder-quobyte-eb5e4dd2-98c0-4d83-b039-49665fc65014" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:46:50 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-817cf74f-3ec7-4f8b-8623-4079c934f9e9 tempest-AttachVolumeNegativeTest-1461620538 None] Lock "cinder-quobyte-eb5e4dd2-98c0-4d83-b039-49665fc65014" acquired by "delete_volume" :: waited 0.027s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:46:50 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a849259-bc65-42c9-92e4-4ae944bd3784]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:46:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-817cf74f-3ec7-4f8b-8623-4079c934f9e9 tempest-AttachVolumeNegativeTest-1461620538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-eb5e4dd2-98c0-4d83-b039-49665fc65014 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:46:51 devstack sudo[94062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-eb5e4dd2-98c0-4d83-b039-49665fc65014 Sep 08 06:46:51 devstack sudo[94062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:46:51 devstack sudo[94060]: pam_unix(sudo:session): session closed for user root Sep 08 06:46:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-35720556-7d0d-45ff-bbfd-d0f6334898f1 tempest-AttachVolumeTestJSON-921065048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-05a9c336-6790-414a-9df8-7d73202be656" returned: 0 in 0.372s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:46:51 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-35720556-7d0d-45ff-bbfd-d0f6334898f1 tempest-AttachVolumeTestJSON-921065048 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:46:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-35720556-7d0d-45ff-bbfd-d0f6334898f1 tempest-AttachVolumeTestJSON-921065048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:46:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-468b84d9-9c66-4ff8-b446-44a5ada6c099 tempest-VolumesSnapshotTestJSON-581938750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.699s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:46:51 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-35720556-7d0d-45ff-bbfd-d0f6334898f1 tempest-AttachVolumeTestJSON-921065048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d3d28cf-c624-41ab-ba07-d09cb0dc0ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05a9c336-6790-414a-9df8-7d73202be656', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:46:51 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-35720556-7d0d-45ff-bbfd-d0f6334898f1 tempest-AttachVolumeTestJSON-921065048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9a612b7-848b-475c-9a07-f847e7a458a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:46:51 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-468b84d9-9c66-4ff8-b446-44a5ada6c099 tempest-VolumesSnapshotTestJSON-581938750 None] Creating offline snapshot 34896d66-a4d3-4711-b676-f594a1c13806 of volume c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0 {{(pid=87507) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 06:46:51 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-35720556-7d0d-45ff-bbfd-d0f6334898f1 tempest-AttachVolumeTestJSON-921065048 None] Volume volume-05a9c336-6790-414a-9df8-7d73202be656 (05a9c336-6790-414a-9df8-7d73202be656): created successfully Sep 08 06:46:51 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-35720556-7d0d-45ff-bbfd-d0f6334898f1 tempest-AttachVolumeTestJSON-921065048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9a612b7-848b-475c-9a07-f847e7a458a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:46:51 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-35720556-7d0d-45ff-bbfd-d0f6334898f1 tempest-AttachVolumeTestJSON-921065048 None] Flow 'volume_create_manager' (b9c687e5-5076-4d93-98c8-bd098dd168ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:46:51 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2793aa-d9e9-4c77-a58e-b63c29e2f43b]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:46:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-468b84d9-9c66-4ff8-b446-44a5ada6c099 tempest-VolumesSnapshotTestJSON-581938750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:46:51 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-35720556-7d0d-45ff-bbfd-d0f6334898f1 tempest-AttachVolumeTestJSON-921065048 None] Created volume successfully. Sep 08 06:46:51 devstack sudo[94062]: pam_unix(sudo:session): session closed for user root Sep 08 06:46:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-817cf74f-3ec7-4f8b-8623-4079c934f9e9 tempest-AttachVolumeNegativeTest-1461620538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-eb5e4dd2-98c0-4d83-b039-49665fc65014" returned: 0 in 0.494s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:46:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-817cf74f-3ec7-4f8b-8623-4079c934f9e9 tempest-AttachVolumeNegativeTest-1461620538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-eb5e4dd2-98c0-4d83-b039-49665fc65014 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:46:51 devstack sudo[94066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0 Sep 08 06:46:51 devstack sudo[94066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:46:51 devstack sudo[94069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-eb5e4dd2-98c0-4d83-b039-49665fc65014 Sep 08 06:46:51 devstack sudo[94069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:46:51 devstack sudo[94069]: pam_unix(sudo:session): session closed for user root Sep 08 06:46:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-817cf74f-3ec7-4f8b-8623-4079c934f9e9 tempest-AttachVolumeNegativeTest-1461620538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-eb5e4dd2-98c0-4d83-b039-49665fc65014" returned: 0 in 0.302s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:46:51 devstack sudo[94066]: pam_unix(sudo:session): session closed for user root Sep 08 06:46:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-468b84d9-9c66-4ff8-b446-44a5ada6c099 tempest-VolumesSnapshotTestJSON-581938750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0" returned: 0 in 0.446s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:46:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-468b84d9-9c66-4ff8-b446-44a5ada6c099 tempest-VolumesSnapshotTestJSON-581938750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0.34896d66-a4d3-4711-b676-f594a1c13806 1G {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:46:51 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-817cf74f-3ec7-4f8b-8623-4079c934f9e9 tempest-AttachVolumeNegativeTest-1461620538 None] Lock "cinder-quobyte-eb5e4dd2-98c0-4d83-b039-49665fc65014" released by "delete_volume" :: held 0.864s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:46:51 devstack sudo[94077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0.34896d66-a4d3-4711-b676-f594a1c13806 1G Sep 08 06:46:51 devstack sudo[94077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:46:51 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-817cf74f-3ec7-4f8b-8623-4079c934f9e9 tempest-AttachVolumeNegativeTest-1461620538 None] Created reservations ['916afe1e-5a48-4d98-babf-4d106d82f091', '97061faf-a42a-4dd5-81a4-19bd7197c840', '40b84c0a-130c-4337-b2fb-ba128dd59084', 'abf5f630-0c99-4019-b12a-df2e2149a244'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:46:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-817cf74f-3ec7-4f8b-8623-4079c934f9e9 tempest-AttachVolumeNegativeTest-1461620538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:46:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-817cf74f-3ec7-4f8b-8623-4079c934f9e9 tempest-AttachVolumeNegativeTest-1461620538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:46:51 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-817cf74f-3ec7-4f8b-8623-4079c934f9e9 tempest-AttachVolumeNegativeTest-1461620538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:46:51 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-817cf74f-3ec7-4f8b-8623-4079c934f9e9 tempest-AttachVolumeNegativeTest-1461620538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:46:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-817cf74f-3ec7-4f8b-8623-4079c934f9e9 tempest-AttachVolumeNegativeTest-1461620538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:46:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-817cf74f-3ec7-4f8b-8623-4079c934f9e9 tempest-AttachVolumeNegativeTest-1461620538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:46:52 devstack sudo[94079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:46:52 devstack sudo[94079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:46:52 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-bb153ad5-b783-468b-b2e9-d74c53ae928c tempest-AttachVolumeNegativeTest-1461620538 None] Acquiring lock "cinder-03d8cb92-c181-4d00-9c2a-c5ef34ba7477-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:46:52 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-bb153ad5-b783-468b-b2e9-d74c53ae928c tempest-AttachVolumeNegativeTest-1461620538 None] Lock "cinder-03d8cb92-c181-4d00-9c2a-c5ef34ba7477-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:46:52 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-bb153ad5-b783-468b-b2e9-d74c53ae928c tempest-AttachVolumeNegativeTest-1461620538 None] Acquiring lock "cinder-quobyte-03d8cb92-c181-4d00-9c2a-c5ef34ba7477" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:46:52 devstack sudo[94079]: pam_unix(sudo:session): session closed for user root Sep 08 06:46:52 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-bb153ad5-b783-468b-b2e9-d74c53ae928c tempest-AttachVolumeNegativeTest-1461620538 None] Lock "cinder-quobyte-03d8cb92-c181-4d00-9c2a-c5ef34ba7477" acquired by "delete_volume" :: waited 0.026s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:46:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-817cf74f-3ec7-4f8b-8623-4079c934f9e9 tempest-AttachVolumeNegativeTest-1461620538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.370s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:46:52 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-817cf74f-3ec7-4f8b-8623-4079c934f9e9 tempest-AttachVolumeNegativeTest-1461620538 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:46:52 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f691538f-dba4-49f0-af62-738acf055977]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:46:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bb153ad5-b783-468b-b2e9-d74c53ae928c tempest-AttachVolumeNegativeTest-1461620538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-03d8cb92-c181-4d00-9c2a-c5ef34ba7477 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:46:52 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-817cf74f-3ec7-4f8b-8623-4079c934f9e9 tempest-AttachVolumeNegativeTest-1461620538 None] Deleted volume successfully. Sep 08 06:46:52 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-817cf74f-3ec7-4f8b-8623-4079c934f9e9 tempest-AttachVolumeNegativeTest-1461620538 None] Lock "cinder-eb5e4dd2-98c0-4d83-b039-49665fc65014-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:46:52 devstack sudo[94087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-03d8cb92-c181-4d00-9c2a-c5ef34ba7477 Sep 08 06:46:52 devstack sudo[94087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:46:52 devstack sudo[94077]: pam_unix(sudo:session): session closed for user root Sep 08 06:46:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-468b84d9-9c66-4ff8-b446-44a5ada6c099 tempest-VolumesSnapshotTestJSON-581938750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0.34896d66-a4d3-4711-b676-f594a1c13806 1G" returned: 0 in 0.850s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:46:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-468b84d9-9c66-4ff8-b446-44a5ada6c099 tempest-VolumesSnapshotTestJSON-581938750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0.34896d66-a4d3-4711-b676-f594a1c13806 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:46:52 devstack sudo[94093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0.34896d66-a4d3-4711-b676-f594a1c13806 Sep 08 06:46:52 devstack sudo[94093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:46:52 devstack sudo[94087]: pam_unix(sudo:session): session closed for user root Sep 08 06:46:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bb153ad5-b783-468b-b2e9-d74c53ae928c tempest-AttachVolumeNegativeTest-1461620538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-03d8cb92-c181-4d00-9c2a-c5ef34ba7477" returned: 0 in 0.510s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:46:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bb153ad5-b783-468b-b2e9-d74c53ae928c tempest-AttachVolumeNegativeTest-1461620538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-03d8cb92-c181-4d00-9c2a-c5ef34ba7477 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:46:52 devstack sudo[94098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-03d8cb92-c181-4d00-9c2a-c5ef34ba7477 Sep 08 06:46:52 devstack sudo[94098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:46:53 devstack sudo[94093]: pam_unix(sudo:session): session closed for user root Sep 08 06:46:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-468b84d9-9c66-4ff8-b446-44a5ada6c099 tempest-VolumesSnapshotTestJSON-581938750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0.34896d66-a4d3-4711-b676-f594a1c13806" returned: 0 in 0.479s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:46:53 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-468b84d9-9c66-4ff8-b446-44a5ada6c099 tempest-VolumesSnapshotTestJSON-581938750 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0.34896d66-a4d3-4711-b676-f594a1c13806 is being set with open permissions: ugo+rw Sep 08 06:46:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-468b84d9-9c66-4ff8-b446-44a5ada6c099 tempest-VolumesSnapshotTestJSON-581938750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0.34896d66-a4d3-4711-b676-f594a1c13806 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:46:53 devstack sudo[94105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0.34896d66-a4d3-4711-b676-f594a1c13806 Sep 08 06:46:53 devstack sudo[94105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:46:53 devstack sudo[94098]: pam_unix(sudo:session): session closed for user root Sep 08 06:46:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bb153ad5-b783-468b-b2e9-d74c53ae928c tempest-AttachVolumeNegativeTest-1461620538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-03d8cb92-c181-4d00-9c2a-c5ef34ba7477" returned: 0 in 0.390s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:46:53 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-bb153ad5-b783-468b-b2e9-d74c53ae928c tempest-AttachVolumeNegativeTest-1461620538 None] Lock "cinder-quobyte-03d8cb92-c181-4d00-9c2a-c5ef34ba7477" released by "delete_volume" :: held 0.990s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:46:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-2d2bb178-7a82-4032-9b06-66dad8e4ea9e req-bae63dfe-e97a-450f-b568-4b5127e08616 tempest-AttachVolumeTestJSON-921065048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:46:53 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-bb153ad5-b783-468b-b2e9-d74c53ae928c tempest-AttachVolumeNegativeTest-1461620538 None] Created reservations ['f075da89-39b0-4de1-854e-be58c6ed9725', '4e9e5f60-a2b3-4d0d-9968-d11d68a7473b', '6600b0f1-17b3-4247-b142-09e462087215', 'b635d1e8-272e-4eab-8cd2-fdb346ae12c7'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:46:53 devstack sudo[94105]: pam_unix(sudo:session): session closed for user root Sep 08 06:46:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-468b84d9-9c66-4ff8-b446-44a5ada6c099 tempest-VolumesSnapshotTestJSON-581938750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0.34896d66-a4d3-4711-b676-f594a1c13806" returned: 0 in 0.352s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:46:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-bb153ad5-b783-468b-b2e9-d74c53ae928c tempest-AttachVolumeNegativeTest-1461620538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:46:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-bb153ad5-b783-468b-b2e9-d74c53ae928c tempest-AttachVolumeNegativeTest-1461620538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:46:53 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-bb153ad5-b783-468b-b2e9-d74c53ae928c tempest-AttachVolumeNegativeTest-1461620538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:46:53 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-bb153ad5-b783-468b-b2e9-d74c53ae928c tempest-AttachVolumeNegativeTest-1461620538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:46:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-bb153ad5-b783-468b-b2e9-d74c53ae928c tempest-AttachVolumeNegativeTest-1461620538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:46:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bb153ad5-b783-468b-b2e9-d74c53ae928c tempest-AttachVolumeNegativeTest-1461620538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:46:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-468b84d9-9c66-4ff8-b446-44a5ada6c099 tempest-VolumesSnapshotTestJSON-581938750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:46:53 devstack sudo[94116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:46:53 devstack sudo[94116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:46:53 devstack sudo[94117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0.info Sep 08 06:46:53 devstack sudo[94117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:46:53 devstack sudo[94116]: pam_unix(sudo:session): session closed for user root Sep 08 06:46:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bb153ad5-b783-468b-b2e9-d74c53ae928c tempest-AttachVolumeNegativeTest-1461620538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.282s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:46:53 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-bb153ad5-b783-468b-b2e9-d74c53ae928c tempest-AttachVolumeNegativeTest-1461620538 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:46:53 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-bb153ad5-b783-468b-b2e9-d74c53ae928c tempest-AttachVolumeNegativeTest-1461620538 None] Deleted volume successfully. Sep 08 06:46:53 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-bb153ad5-b783-468b-b2e9-d74c53ae928c tempest-AttachVolumeNegativeTest-1461620538 None] Lock "cinder-03d8cb92-c181-4d00-9c2a-c5ef34ba7477-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:46:53 devstack sudo[94117]: pam_unix(sudo:session): session closed for user root Sep 08 06:46:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-468b84d9-9c66-4ff8-b446-44a5ada6c099 tempest-VolumesSnapshotTestJSON-581938750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0.info" returned: 0 in 0.301s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:46:53 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-468b84d9-9c66-4ff8-b446-44a5ada6c099 tempest-VolumesSnapshotTestJSON-581938750 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0.info is being set with open permissions: ugo+rw Sep 08 06:46:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-468b84d9-9c66-4ff8-b446-44a5ada6c099 tempest-VolumesSnapshotTestJSON-581938750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:46:53 devstack sudo[94122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0.info Sep 08 06:46:53 devstack sudo[94122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:46:54 devstack sudo[94122]: pam_unix(sudo:session): session closed for user root Sep 08 06:46:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-468b84d9-9c66-4ff8-b446-44a5ada6c099 tempest-VolumesSnapshotTestJSON-581938750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0.info" returned: 0 in 0.263s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:46:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-468b84d9-9c66-4ff8-b446-44a5ada6c099 tempest-VolumesSnapshotTestJSON-581938750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.886s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:46:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-2d2bb178-7a82-4032-9b06-66dad8e4ea9e req-bae63dfe-e97a-450f-b568-4b5127e08616 tempest-AttachVolumeTestJSON-921065048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.736s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:46:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-2d2bb178-7a82-4032-9b06-66dad8e4ea9e req-bae63dfe-e97a-450f-b568-4b5127e08616 tempest-AttachVolumeTestJSON-921065048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:46:54 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-468b84d9-9c66-4ff8-b446-44a5ada6c099 tempest-VolumesSnapshotTestJSON-581938750 None] Create snapshot completed successfully Sep 08 06:46:54 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-2d2bb178-7a82-4032-9b06-66dad8e4ea9e req-bae63dfe-e97a-450f-b568-4b5127e08616 tempest-AttachVolumeTestJSON-921065048 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d', 'name': 'volume-05a9c336-6790-414a-9df8-7d73202be656', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '01cb60ce-0bd2-49bb-adf7-aa7e3a539425', 'enforce_multipath': True} {{(pid=87507) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 06:46:54 devstack cinder-volume[87507]: INFO cinder.volume.manager [req-2d2bb178-7a82-4032-9b06-66dad8e4ea9e req-bae63dfe-e97a-450f-b568-4b5127e08616 tempest-AttachVolumeTestJSON-921065048 None] attachment_update completed successfully. Sep 08 06:46:54 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-ffd390f9-d11d-417e-b5b4-db1d4f576352 tempest-AttachVolumeNegativeTest-1461620538 None] Acquiring lock "cinder-aa8592cc-488a-4b2b-9dd5-038385cbe3d1-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:46:54 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-ffd390f9-d11d-417e-b5b4-db1d4f576352 tempest-AttachVolumeNegativeTest-1461620538 None] Lock "cinder-aa8592cc-488a-4b2b-9dd5-038385cbe3d1-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:46:54 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-ffd390f9-d11d-417e-b5b4-db1d4f576352 tempest-AttachVolumeNegativeTest-1461620538 None] Acquiring lock "cinder-quobyte-aa8592cc-488a-4b2b-9dd5-038385cbe3d1" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:46:54 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-ffd390f9-d11d-417e-b5b4-db1d4f576352 tempest-AttachVolumeNegativeTest-1461620538 None] Lock "cinder-quobyte-aa8592cc-488a-4b2b-9dd5-038385cbe3d1" acquired by "delete_volume" :: waited 0.054s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:46:55 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[884dc8c5-230f-4065-b9a9-29d756c7ba61]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:46:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ffd390f9-d11d-417e-b5b4-db1d4f576352 tempest-AttachVolumeNegativeTest-1461620538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-aa8592cc-488a-4b2b-9dd5-038385cbe3d1 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:46:55 devstack sudo[94507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-aa8592cc-488a-4b2b-9dd5-038385cbe3d1 Sep 08 06:46:55 devstack sudo[94507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:46:55 devstack sudo[94507]: pam_unix(sudo:session): session closed for user root Sep 08 06:46:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ffd390f9-d11d-417e-b5b4-db1d4f576352 tempest-AttachVolumeNegativeTest-1461620538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-aa8592cc-488a-4b2b-9dd5-038385cbe3d1" returned: 0 in 0.518s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:46:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ffd390f9-d11d-417e-b5b4-db1d4f576352 tempest-AttachVolumeNegativeTest-1461620538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-aa8592cc-488a-4b2b-9dd5-038385cbe3d1 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:46:55 devstack sudo[94514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-aa8592cc-488a-4b2b-9dd5-038385cbe3d1 Sep 08 06:46:55 devstack sudo[94514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:46:55 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-16adc2a7-2f15-4da0-ad30-b3e182bad803 tempest-VolumesSnapshotTestJSON-581938750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:46:55 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-16adc2a7-2f15-4da0-ad30-b3e182bad803 tempest-VolumesSnapshotTestJSON-581938750 None] Flow 'volume_create_manager' (107de428-9897-4b8a-a35f-94cf1807633f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:46:55 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-16adc2a7-2f15-4da0-ad30-b3e182bad803 tempest-VolumesSnapshotTestJSON-581938750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3603d7d1-08d2-445f-b355-bb10ee9fb609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:46:55 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-16adc2a7-2f15-4da0-ad30-b3e182bad803 tempest-VolumesSnapshotTestJSON-581938750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3603d7d1-08d2-445f-b355-bb10ee9fb609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:46:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1630417150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb5dcfbe-dc28-40c3-b281-2fb3ae9ee990,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b4941bb1fb44fbbbbda64a8438bf66a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:46:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=34896d66-a4d3-4711-b676-f594a1c13806,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:46:56Z,use_quota=True,user_id='a8ab0d637f5f4712b0d4425f6bf56b83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:46:55 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-16adc2a7-2f15-4da0-ad30-b3e182bad803 tempest-VolumesSnapshotTestJSON-581938750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67d07ebb-48df-4606-bbe9-2471a6e4a91b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:46:55 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-16adc2a7-2f15-4da0-ad30-b3e182bad803 tempest-VolumesSnapshotTestJSON-581938750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67d07ebb-48df-4606-bbe9-2471a6e4a91b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:46:55 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-16adc2a7-2f15-4da0-ad30-b3e182bad803 tempest-VolumesSnapshotTestJSON-581938750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03dbbd41-4788-4df6-8370-5ca145e1375d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:46:55 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-16adc2a7-2f15-4da0-ad30-b3e182bad803 tempest-VolumesSnapshotTestJSON-581938750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03dbbd41-4788-4df6-8370-5ca145e1375d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cb5dcfbe-dc28-40c3-b281-2fb3ae9ee990', 'volume_name': 'volume-cb5dcfbe-dc28-40c3-b281-2fb3ae9ee990', 'volume_size': 1, 'snapshot_id': '34896d66-a4d3-4711-b676-f594a1c13806'}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:46:55 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-16adc2a7-2f15-4da0-ad30-b3e182bad803 tempest-VolumesSnapshotTestJSON-581938750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2dee33b-42a7-452f-ace0-15ca4ee148a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:46:55 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-16adc2a7-2f15-4da0-ad30-b3e182bad803 tempest-VolumesSnapshotTestJSON-581938750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2dee33b-42a7-452f-ace0-15ca4ee148a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:46:55 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-16adc2a7-2f15-4da0-ad30-b3e182bad803 tempest-VolumesSnapshotTestJSON-581938750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d43165fe-93d3-45cd-8c43-adb61c242ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:46:55 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-16adc2a7-2f15-4da0-ad30-b3e182bad803 tempest-VolumesSnapshotTestJSON-581938750 None] Volume cb5dcfbe-dc28-40c3-b281-2fb3ae9ee990: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cb5dcfbe-dc28-40c3-b281-2fb3ae9ee990', 'volume_size': 1, 'snapshot_id': '34896d66-a4d3-4711-b676-f594a1c13806'} Sep 08 06:46:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-16adc2a7-2f15-4da0-ad30-b3e182bad803 tempest-VolumesSnapshotTestJSON-581938750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:46:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-16adc2a7-2f15-4da0-ad30-b3e182bad803 tempest-VolumesSnapshotTestJSON-581938750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:46:55 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-16adc2a7-2f15-4da0-ad30-b3e182bad803 tempest-VolumesSnapshotTestJSON-581938750 None] Acquiring lock "cinder-quobyte-34896d66-a4d3-4711-b676-f594a1c13806-cb5dcfbe-dc28-40c3-b281-2fb3ae9ee990" by "_create_volume_from_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:46:55 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-16adc2a7-2f15-4da0-ad30-b3e182bad803 tempest-VolumesSnapshotTestJSON-581938750 None] Lock "cinder-quobyte-34896d66-a4d3-4711-b676-f594a1c13806-cb5dcfbe-dc28-40c3-b281-2fb3ae9ee990" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:46:55 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-16adc2a7-2f15-4da0-ad30-b3e182bad803 tempest-VolumesSnapshotTestJSON-581938750 None] Creating volume cb5dcfbe-dc28-40c3-b281-2fb3ae9ee990 from snapshot 34896d66-a4d3-4711-b676-f594a1c13806 {{(pid=87507) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 08 06:46:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-16adc2a7-2f15-4da0-ad30-b3e182bad803 tempest-VolumesSnapshotTestJSON-581938750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:46:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-16adc2a7-2f15-4da0-ad30-b3e182bad803 tempest-VolumesSnapshotTestJSON-581938750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:46:55 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-16adc2a7-2f15-4da0-ad30-b3e182bad803 tempest-VolumesSnapshotTestJSON-581938750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:46:55 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-16adc2a7-2f15-4da0-ad30-b3e182bad803 tempest-VolumesSnapshotTestJSON-581938750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:46:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-16adc2a7-2f15-4da0-ad30-b3e182bad803 tempest-VolumesSnapshotTestJSON-581938750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:46:55 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-16adc2a7-2f15-4da0-ad30-b3e182bad803 tempest-VolumesSnapshotTestJSON-581938750 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:46:55 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-16adc2a7-2f15-4da0-ad30-b3e182bad803 tempest-VolumesSnapshotTestJSON-581938750 None] Acquiring lock "cinder-quobyte-cb5dcfbe-dc28-40c3-b281-2fb3ae9ee990" by "_copy_volume_from_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:46:55 devstack sudo[94514]: pam_unix(sudo:session): session closed for user root Sep 08 06:46:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ffd390f9-d11d-417e-b5b4-db1d4f576352 tempest-AttachVolumeNegativeTest-1461620538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-aa8592cc-488a-4b2b-9dd5-038385cbe3d1" returned: 0 in 0.338s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:46:55 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-ffd390f9-d11d-417e-b5b4-db1d4f576352 tempest-AttachVolumeNegativeTest-1461620538 None] Lock "cinder-quobyte-aa8592cc-488a-4b2b-9dd5-038385cbe3d1" released by "delete_volume" :: held 0.946s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:46:55 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-16adc2a7-2f15-4da0-ad30-b3e182bad803 tempest-VolumesSnapshotTestJSON-581938750 None] Lock "cinder-quobyte-cb5dcfbe-dc28-40c3-b281-2fb3ae9ee990" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:46:55 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-16adc2a7-2f15-4da0-ad30-b3e182bad803 tempest-VolumesSnapshotTestJSON-581938750 None] snapshot: 34896d66-a4d3-4711-b676-f594a1c13806, volume: cb5dcfbe-dc28-40c3-b281-2fb3ae9ee990, {{(pid=87507) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 08 06:46:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-16adc2a7-2f15-4da0-ad30-b3e182bad803 tempest-VolumesSnapshotTestJSON-581938750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:46:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-16adc2a7-2f15-4da0-ad30-b3e182bad803 tempest-VolumesSnapshotTestJSON-581938750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:46:55 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-16adc2a7-2f15-4da0-ad30-b3e182bad803 tempest-VolumesSnapshotTestJSON-581938750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:46:55 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-16adc2a7-2f15-4da0-ad30-b3e182bad803 tempest-VolumesSnapshotTestJSON-581938750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:46:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-16adc2a7-2f15-4da0-ad30-b3e182bad803 tempest-VolumesSnapshotTestJSON-581938750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:46:55 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b09c5e-ec96-4601-90e1-a09ffcbfb9f7]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:46:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-16adc2a7-2f15-4da0-ad30-b3e182bad803 tempest-VolumesSnapshotTestJSON-581938750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0.34896d66-a4d3-4711-b676-f594a1c13806 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:46:55 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-ffd390f9-d11d-417e-b5b4-db1d4f576352 tempest-AttachVolumeNegativeTest-1461620538 None] Created reservations ['f9b5137e-7745-4308-b273-df502e50604e', '02179c06-a1dd-4f5e-a429-b43bb3c24b48', '77109b82-b3d7-432f-9c14-ca2b3f67d818', '7748d826-cd99-4e4b-8309-3b9d7be0ea7f'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:46:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-ffd390f9-d11d-417e-b5b4-db1d4f576352 tempest-AttachVolumeNegativeTest-1461620538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:46:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-ffd390f9-d11d-417e-b5b4-db1d4f576352 tempest-AttachVolumeNegativeTest-1461620538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:46:56 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-ffd390f9-d11d-417e-b5b4-db1d4f576352 tempest-AttachVolumeNegativeTest-1461620538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:46:56 devstack sudo[94517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0.34896d66-a4d3-4711-b676-f594a1c13806 Sep 08 06:46:56 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-ffd390f9-d11d-417e-b5b4-db1d4f576352 tempest-AttachVolumeNegativeTest-1461620538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:46:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-ffd390f9-d11d-417e-b5b4-db1d4f576352 tempest-AttachVolumeNegativeTest-1461620538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:46:56 devstack sudo[94517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:46:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ffd390f9-d11d-417e-b5b4-db1d4f576352 tempest-AttachVolumeNegativeTest-1461620538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:46:56 devstack sudo[94519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:46:56 devstack sudo[94519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:46:56 devstack sudo[94517]: pam_unix(sudo:session): session closed for user root Sep 08 06:46:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-16adc2a7-2f15-4da0-ad30-b3e182bad803 tempest-VolumesSnapshotTestJSON-581938750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0.34896d66-a4d3-4711-b676-f594a1c13806" returned: 0 in 0.404s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:46:56 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-16adc2a7-2f15-4da0-ad30-b3e182bad803 tempest-VolumesSnapshotTestJSON-581938750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 06:46:56 devstack sudo[94519]: pam_unix(sudo:session): session closed for user root Sep 08 06:46:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ffd390f9-d11d-417e-b5b4-db1d4f576352 tempest-AttachVolumeNegativeTest-1461620538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.292s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:46:56 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-ffd390f9-d11d-417e-b5b4-db1d4f576352 tempest-AttachVolumeNegativeTest-1461620538 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:46:56 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-ffd390f9-d11d-417e-b5b4-db1d4f576352 tempest-AttachVolumeNegativeTest-1461620538 None] Deleted volume successfully. Sep 08 06:46:56 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[25311aff-c049-4334-973a-98f1c4cd1ff3]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:46:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-16adc2a7-2f15-4da0-ad30-b3e182bad803 tempest-VolumesSnapshotTestJSON-581938750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:46:56 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-ffd390f9-d11d-417e-b5b4-db1d4f576352 tempest-AttachVolumeNegativeTest-1461620538 None] Lock "cinder-aa8592cc-488a-4b2b-9dd5-038385cbe3d1-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:46:56 devstack sudo[94526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0 Sep 08 06:46:56 devstack sudo[94526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:46:56 devstack sudo[94526]: pam_unix(sudo:session): session closed for user root Sep 08 06:46:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-16adc2a7-2f15-4da0-ad30-b3e182bad803 tempest-VolumesSnapshotTestJSON-581938750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0" returned: 0 in 0.454s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:46:56 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-16adc2a7-2f15-4da0-ad30-b3e182bad803 tempest-VolumesSnapshotTestJSON-581938750 None] will copy from snapshot at /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0 {{(pid=87507) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 08 06:46:56 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-16adc2a7-2f15-4da0-ad30-b3e182bad803 tempest-VolumesSnapshotTestJSON-581938750 None] Creating direct copy from snapshot {{(pid=87507) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 08 06:46:56 devstack cinder-volume[87507]: DEBUG cinder.utils [None req-16adc2a7-2f15-4da0-ad30-b3e182bad803 tempest-VolumesSnapshotTestJSON-581938750 None] Path /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cb5dcfbe-dc28-40c3-b281-2fb3ae9ee990 not found in is_blk_device check {{(pid=87507) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 08 06:46:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-16adc2a7-2f15-4da0-ad30-b3e182bad803 tempest-VolumesSnapshotTestJSON-581938750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cb5dcfbe-dc28-40c3-b281-2fb3ae9ee990 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:46:56 devstack sudo[94532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cb5dcfbe-dc28-40c3-b281-2fb3ae9ee990 Sep 08 06:46:56 devstack sudo[94532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:47:03 devstack sudo[94532]: pam_unix(sudo:session): session closed for user root Sep 08 06:47:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-16adc2a7-2f15-4da0-ad30-b3e182bad803 tempest-VolumesSnapshotTestJSON-581938750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cb5dcfbe-dc28-40c3-b281-2fb3ae9ee990" returned: 0 in 6.875s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:47:03 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-16adc2a7-2f15-4da0-ad30-b3e182bad803 tempest-VolumesSnapshotTestJSON-581938750 None] Image conversion details: src /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0, size 1024.00 MB, duration 6.88 sec, destination /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cb5dcfbe-dc28-40c3-b281-2fb3ae9ee990 {{(pid=87507) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 06:47:03 devstack cinder-volume[87507]: INFO cinder.image.image_utils [None req-16adc2a7-2f15-4da0-ad30-b3e182bad803 tempest-VolumesSnapshotTestJSON-581938750 None] Converted 1024.00 MB image at 148.84 MB/s Sep 08 06:47:03 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-16adc2a7-2f15-4da0-ad30-b3e182bad803 tempest-VolumesSnapshotTestJSON-581938750 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cb5dcfbe-dc28-40c3-b281-2fb3ae9ee990 is being set with open permissions: ugo+rw Sep 08 06:47:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-16adc2a7-2f15-4da0-ad30-b3e182bad803 tempest-VolumesSnapshotTestJSON-581938750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cb5dcfbe-dc28-40c3-b281-2fb3ae9ee990 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:47:03 devstack sudo[94582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cb5dcfbe-dc28-40c3-b281-2fb3ae9ee990 Sep 08 06:47:03 devstack sudo[94582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:47:04 devstack sudo[94582]: pam_unix(sudo:session): session closed for user root Sep 08 06:47:04 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-16adc2a7-2f15-4da0-ad30-b3e182bad803 tempest-VolumesSnapshotTestJSON-581938750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cb5dcfbe-dc28-40c3-b281-2fb3ae9ee990" returned: 0 in 0.326s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:47:04 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-16adc2a7-2f15-4da0-ad30-b3e182bad803 tempest-VolumesSnapshotTestJSON-581938750 None] Lock "cinder-quobyte-cb5dcfbe-dc28-40c3-b281-2fb3ae9ee990" released by "_copy_volume_from_snapshot" :: held 8.175s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:47:04 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-16adc2a7-2f15-4da0-ad30-b3e182bad803 tempest-VolumesSnapshotTestJSON-581938750 None] Lock "cinder-quobyte-34896d66-a4d3-4711-b676-f594a1c13806-cb5dcfbe-dc28-40c3-b281-2fb3ae9ee990" released by "_create_volume_from_snapshot" :: held 8.304s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:47:04 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-16adc2a7-2f15-4da0-ad30-b3e182bad803 tempest-VolumesSnapshotTestJSON-581938750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.321s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:47:04 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-16adc2a7-2f15-4da0-ad30-b3e182bad803 tempest-VolumesSnapshotTestJSON-581938750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d43165fe-93d3-45cd-8c43-adb61c242ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb5dcfbe-dc28-40c3-b281-2fb3ae9ee990', 'volume_size': 1, 'snapshot_id': '34896d66-a4d3-4711-b676-f594a1c13806'}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:47:04 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-16adc2a7-2f15-4da0-ad30-b3e182bad803 tempest-VolumesSnapshotTestJSON-581938750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fe6acba-558c-401b-86aa-e1e76c52bdf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:47:04 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-16adc2a7-2f15-4da0-ad30-b3e182bad803 tempest-VolumesSnapshotTestJSON-581938750 None] Volume volume-cb5dcfbe-dc28-40c3-b281-2fb3ae9ee990 (cb5dcfbe-dc28-40c3-b281-2fb3ae9ee990): created successfully Sep 08 06:47:04 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-16adc2a7-2f15-4da0-ad30-b3e182bad803 tempest-VolumesSnapshotTestJSON-581938750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fe6acba-558c-401b-86aa-e1e76c52bdf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:47:04 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-16adc2a7-2f15-4da0-ad30-b3e182bad803 tempest-VolumesSnapshotTestJSON-581938750 None] Flow 'volume_create_manager' (107de428-9897-4b8a-a35f-94cf1807633f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:47:04 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-16adc2a7-2f15-4da0-ad30-b3e182bad803 tempest-VolumesSnapshotTestJSON-581938750 None] Created volume successfully. Sep 08 06:47:04 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-7e1010d9-4743-4fe5-a282-a9a42145b1cb tempest-VolumesSnapshotTestJSON-581938750 None] Acquiring lock "cinder-cb5dcfbe-dc28-40c3-b281-2fb3ae9ee990-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:47:04 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-7e1010d9-4743-4fe5-a282-a9a42145b1cb tempest-VolumesSnapshotTestJSON-581938750 None] Lock "cinder-cb5dcfbe-dc28-40c3-b281-2fb3ae9ee990-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:47:05 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-7e1010d9-4743-4fe5-a282-a9a42145b1cb tempest-VolumesSnapshotTestJSON-581938750 None] Acquiring lock "cinder-quobyte-cb5dcfbe-dc28-40c3-b281-2fb3ae9ee990" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:47:05 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-7e1010d9-4743-4fe5-a282-a9a42145b1cb tempest-VolumesSnapshotTestJSON-581938750 None] Lock "cinder-quobyte-cb5dcfbe-dc28-40c3-b281-2fb3ae9ee990" acquired by "delete_volume" :: waited 0.021s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:47:05 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fae440c-66a9-4543-86e6-6ec70dbb2a38]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:47:05 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7e1010d9-4743-4fe5-a282-a9a42145b1cb tempest-VolumesSnapshotTestJSON-581938750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cb5dcfbe-dc28-40c3-b281-2fb3ae9ee990 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:47:05 devstack sudo[94611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cb5dcfbe-dc28-40c3-b281-2fb3ae9ee990 Sep 08 06:47:05 devstack sudo[94611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:47:05 devstack sudo[94611]: pam_unix(sudo:session): session closed for user root Sep 08 06:47:05 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7e1010d9-4743-4fe5-a282-a9a42145b1cb tempest-VolumesSnapshotTestJSON-581938750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cb5dcfbe-dc28-40c3-b281-2fb3ae9ee990" returned: 0 in 0.422s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:47:05 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7e1010d9-4743-4fe5-a282-a9a42145b1cb tempest-VolumesSnapshotTestJSON-581938750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cb5dcfbe-dc28-40c3-b281-2fb3ae9ee990 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:47:05 devstack sudo[94617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cb5dcfbe-dc28-40c3-b281-2fb3ae9ee990 Sep 08 06:47:05 devstack sudo[94617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:47:05 devstack sudo[94617]: pam_unix(sudo:session): session closed for user root Sep 08 06:47:05 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7e1010d9-4743-4fe5-a282-a9a42145b1cb tempest-VolumesSnapshotTestJSON-581938750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cb5dcfbe-dc28-40c3-b281-2fb3ae9ee990" returned: 0 in 0.303s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:47:05 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-7e1010d9-4743-4fe5-a282-a9a42145b1cb tempest-VolumesSnapshotTestJSON-581938750 None] Lock "cinder-quobyte-cb5dcfbe-dc28-40c3-b281-2fb3ae9ee990" released by "delete_volume" :: held 0.791s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:47:05 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-7e1010d9-4743-4fe5-a282-a9a42145b1cb tempest-VolumesSnapshotTestJSON-581938750 None] Created reservations ['95336a95-67c5-49d5-bef8-32687e1f5bc9', '73d05531-44b2-4ff6-a44c-4745e76ff59a', '555050bb-4155-41cd-b2ce-49c7002447ce', 'fb60e131-1aa3-4d13-8e11-fd37f340d485'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:47:06 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-7e1010d9-4743-4fe5-a282-a9a42145b1cb tempest-VolumesSnapshotTestJSON-581938750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:47:06 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-7e1010d9-4743-4fe5-a282-a9a42145b1cb tempest-VolumesSnapshotTestJSON-581938750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:47:06 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-7e1010d9-4743-4fe5-a282-a9a42145b1cb tempest-VolumesSnapshotTestJSON-581938750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:47:06 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-7e1010d9-4743-4fe5-a282-a9a42145b1cb tempest-VolumesSnapshotTestJSON-581938750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:47:06 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-7e1010d9-4743-4fe5-a282-a9a42145b1cb tempest-VolumesSnapshotTestJSON-581938750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:47:06 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7e1010d9-4743-4fe5-a282-a9a42145b1cb tempest-VolumesSnapshotTestJSON-581938750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:47:06 devstack sudo[94620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:47:06 devstack sudo[94620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:47:06 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-9565812b-11fa-4c49-822a-a3dff244dfc1 tempest-VolumesSnapshotTestJSON-581938750 None] Acquiring lock "cinder-34896d66-a4d3-4711-b676-f594a1c13806-delete_snapshot" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:47:06 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-9565812b-11fa-4c49-822a-a3dff244dfc1 tempest-VolumesSnapshotTestJSON-581938750 None] Lock "cinder-34896d66-a4d3-4711-b676-f594a1c13806-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:47:06 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-9565812b-11fa-4c49-822a-a3dff244dfc1 tempest-VolumesSnapshotTestJSON-581938750 None] Acquiring lock "cinder-quobyte-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:47:06 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-9565812b-11fa-4c49-822a-a3dff244dfc1 tempest-VolumesSnapshotTestJSON-581938750 None] Lock "cinder-quobyte-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:47:06 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-9565812b-11fa-4c49-822a-a3dff244dfc1 tempest-VolumesSnapshotTestJSON-581938750 None] Acquiring lock "cinder-quobyte-34896d66-a4d3-4711-b676-f594a1c13806" by "_delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:47:06 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-9565812b-11fa-4c49-822a-a3dff244dfc1 tempest-VolumesSnapshotTestJSON-581938750 None] Lock "cinder-quobyte-34896d66-a4d3-4711-b676-f594a1c13806" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:47:06 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-9565812b-11fa-4c49-822a-a3dff244dfc1 tempest-VolumesSnapshotTestJSON-581938750 None] Deleting offline snapshot 34896d66-a4d3-4711-b676-f594a1c13806 of volume c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0 {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 06:47:06 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-9565812b-11fa-4c49-822a-a3dff244dfc1 tempest-VolumesSnapshotTestJSON-581938750 None] snapshot_file for this snap is: volume-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0.34896d66-a4d3-4711-b676-f594a1c13806 {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 06:47:06 devstack sudo[94620]: pam_unix(sudo:session): session closed for user root Sep 08 06:47:06 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4d7740-892d-49f4-a8b7-7fdf51c79738]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:47:06 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9565812b-11fa-4c49-822a-a3dff244dfc1 tempest-VolumesSnapshotTestJSON-581938750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0.34896d66-a4d3-4711-b676-f594a1c13806 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:47:06 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7e1010d9-4743-4fe5-a282-a9a42145b1cb tempest-VolumesSnapshotTestJSON-581938750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.497s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:47:06 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-7e1010d9-4743-4fe5-a282-a9a42145b1cb tempest-VolumesSnapshotTestJSON-581938750 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:47:06 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-7e1010d9-4743-4fe5-a282-a9a42145b1cb tempest-VolumesSnapshotTestJSON-581938750 None] Deleted volume successfully. Sep 08 06:47:06 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-7e1010d9-4743-4fe5-a282-a9a42145b1cb tempest-VolumesSnapshotTestJSON-581938750 None] Lock "cinder-cb5dcfbe-dc28-40c3-b281-2fb3ae9ee990-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:47:06 devstack sudo[94631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0.34896d66-a4d3-4711-b676-f594a1c13806 Sep 08 06:47:06 devstack sudo[94631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:47:07 devstack sudo[94631]: pam_unix(sudo:session): session closed for user root Sep 08 06:47:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9565812b-11fa-4c49-822a-a3dff244dfc1 tempest-VolumesSnapshotTestJSON-581938750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0.34896d66-a4d3-4711-b676-f594a1c13806" returned: 0 in 0.614s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:47:07 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-9565812b-11fa-4c49-822a-a3dff244dfc1 tempest-VolumesSnapshotTestJSON-581938750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 06:47:07 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc311f1-7b9b-4720-b297-cf700751df1d]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:47:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9565812b-11fa-4c49-822a-a3dff244dfc1 tempest-VolumesSnapshotTestJSON-581938750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:47:07 devstack sudo[94737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0 Sep 08 06:47:07 devstack sudo[94737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:47:07 devstack sudo[94737]: pam_unix(sudo:session): session closed for user root Sep 08 06:47:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9565812b-11fa-4c49-822a-a3dff244dfc1 tempest-VolumesSnapshotTestJSON-581938750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0" returned: 0 in 0.718s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:47:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9565812b-11fa-4c49-822a-a3dff244dfc1 tempest-VolumesSnapshotTestJSON-581938750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0.34896d66-a4d3-4711-b676-f594a1c13806 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:47:07 devstack sudo[94756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0.34896d66-a4d3-4711-b676-f594a1c13806 Sep 08 06:47:07 devstack sudo[94756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:47:08 devstack sudo[94756]: pam_unix(sudo:session): session closed for user root Sep 08 06:47:08 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9565812b-11fa-4c49-822a-a3dff244dfc1 tempest-VolumesSnapshotTestJSON-581938750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0.34896d66-a4d3-4711-b676-f594a1c13806" returned: 0 in 0.680s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:47:08 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9565812b-11fa-4c49-822a-a3dff244dfc1 tempest-VolumesSnapshotTestJSON-581938750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0.34896d66-a4d3-4711-b676-f594a1c13806 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:47:08 devstack sudo[95123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0.34896d66-a4d3-4711-b676-f594a1c13806 Sep 08 06:47:08 devstack sudo[95123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:47:09 devstack sudo[95123]: pam_unix(sudo:session): session closed for user root Sep 08 06:47:09 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9565812b-11fa-4c49-822a-a3dff244dfc1 tempest-VolumesSnapshotTestJSON-581938750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0.34896d66-a4d3-4711-b676-f594a1c13806" returned: 0 in 0.590s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:47:09 devstack cinder-volume[87507]: DEBUG dbcounter [-] [87507] Writing DB stats cinder:SELECT=109,cinder:UPDATE=100,cinder:INSERT=25,cinder:DELETE=7 {{(pid=87507) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 06:47:09 devstack cinder-volume[87507]: DEBUG dbcounter [-] [87507] Writing DB stats cinder:UPDATE=109,cinder:SELECT=93,cinder:INSERT=25,cinder:DELETE=11 {{(pid=87507) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 06:47:09 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-9565812b-11fa-4c49-822a-a3dff244dfc1 tempest-VolumesSnapshotTestJSON-581938750 None] Lock "cinder-quobyte-34896d66-a4d3-4711-b676-f594a1c13806" released by "_delete_snapshot" :: held 2.866s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:47:09 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-9565812b-11fa-4c49-822a-a3dff244dfc1 tempest-VolumesSnapshotTestJSON-581938750 None] Lock "cinder-quobyte-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0" released by "delete_snapshot" :: held 2.917s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:47:09 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-9565812b-11fa-4c49-822a-a3dff244dfc1 tempest-VolumesSnapshotTestJSON-581938750 None] Created reservations ['a947d94d-f2d7-4ecd-a9d1-603350d1a81e', 'c96a7578-05ad-48dc-abb3-097a1aef7a4a', 'ac853610-74d7-48b1-b079-c990bdde3fef', '935a5fbe-fa90-4cd3-a70f-37dc0ab4b5a3'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:47:09 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-9565812b-11fa-4c49-822a-a3dff244dfc1 tempest-VolumesSnapshotTestJSON-581938750 None] Delete snapshot completed successfully. Sep 08 06:47:09 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-9565812b-11fa-4c49-822a-a3dff244dfc1 tempest-VolumesSnapshotTestJSON-581938750 None] Lock "cinder-34896d66-a4d3-4711-b676-f594a1c13806-delete_snapshot" released by "delete_snapshot" :: held 3.180s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:47:09 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-b1298560-7211-41a5-bd19-98fb6406589a tempest-VolumesSnapshotTestJSON-581938750 None] Acquiring lock "cinder-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:47:09 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-b1298560-7211-41a5-bd19-98fb6406589a tempest-VolumesSnapshotTestJSON-581938750 None] Lock "cinder-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:47:09 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-b1298560-7211-41a5-bd19-98fb6406589a tempest-VolumesSnapshotTestJSON-581938750 None] Acquiring lock "cinder-quobyte-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:47:10 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-b1298560-7211-41a5-bd19-98fb6406589a tempest-VolumesSnapshotTestJSON-581938750 None] Lock "cinder-quobyte-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0" acquired by "delete_volume" :: waited 0.070s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:47:10 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6747f825-c7cb-4cd3-900f-122143dfc066]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:47:10 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b1298560-7211-41a5-bd19-98fb6406589a tempest-VolumesSnapshotTestJSON-581938750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:47:10 devstack sudo[95148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0 Sep 08 06:47:10 devstack sudo[95148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:47:10 devstack sudo[95148]: pam_unix(sudo:session): session closed for user root Sep 08 06:47:10 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b1298560-7211-41a5-bd19-98fb6406589a tempest-VolumesSnapshotTestJSON-581938750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0" returned: 0 in 0.820s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:47:10 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b1298560-7211-41a5-bd19-98fb6406589a tempest-VolumesSnapshotTestJSON-581938750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:47:11 devstack sudo[95163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0 Sep 08 06:47:11 devstack sudo[95163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:47:11 devstack sudo[95163]: pam_unix(sudo:session): session closed for user root Sep 08 06:47:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b1298560-7211-41a5-bd19-98fb6406589a tempest-VolumesSnapshotTestJSON-581938750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0" returned: 0 in 1.040s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:47:12 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-b1298560-7211-41a5-bd19-98fb6406589a tempest-VolumesSnapshotTestJSON-581938750 None] Lock "cinder-quobyte-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0" released by "delete_volume" :: held 2.038s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:47:12 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-b1298560-7211-41a5-bd19-98fb6406589a tempest-VolumesSnapshotTestJSON-581938750 None] Created reservations ['877f62dc-c22d-4a83-b8b5-95e080313727', 'd3a1530a-da23-4409-a69b-69793a822c4c', 'bd9fce99-6f00-4abb-ba4b-e3a6f0423779', 'f52e3bec-17ac-47f3-919e-cd4f51f9f52a'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:47:12 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b1298560-7211-41a5-bd19-98fb6406589a tempest-VolumesSnapshotTestJSON-581938750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:47:12 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b1298560-7211-41a5-bd19-98fb6406589a tempest-VolumesSnapshotTestJSON-581938750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.015s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:47:12 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-b1298560-7211-41a5-bd19-98fb6406589a tempest-VolumesSnapshotTestJSON-581938750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:47:12 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-b1298560-7211-41a5-bd19-98fb6406589a tempest-VolumesSnapshotTestJSON-581938750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:47:12 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b1298560-7211-41a5-bd19-98fb6406589a tempest-VolumesSnapshotTestJSON-581938750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.051s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:47:12 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b1298560-7211-41a5-bd19-98fb6406589a tempest-VolumesSnapshotTestJSON-581938750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:47:12 devstack sudo[95228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:47:12 devstack sudo[95228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:47:13 devstack sudo[95228]: pam_unix(sudo:session): session closed for user root Sep 08 06:47:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b1298560-7211-41a5-bd19-98fb6406589a tempest-VolumesSnapshotTestJSON-581938750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.937s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:47:13 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-b1298560-7211-41a5-bd19-98fb6406589a tempest-VolumesSnapshotTestJSON-581938750 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:47:13 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-b1298560-7211-41a5-bd19-98fb6406589a tempest-VolumesSnapshotTestJSON-581938750 None] Deleted volume successfully. Sep 08 06:47:13 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-b1298560-7211-41a5-bd19-98fb6406589a tempest-VolumesSnapshotTestJSON-581938750 None] Lock "cinder-c1fd13c0-17ed-4aaf-8d6c-6c2b65f539f0-delete_volume" released by "delete_volume" :: held 4.103s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:47:14 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-0b7302c3-8ff1-47a5-8e59-584d2c701b87 tempest-VolumesSnapshotTestJSON-581938750 None] Acquiring lock "cinder-99678f42-a9d2-4de7-b82c-fff35032ac56-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:47:14 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-0b7302c3-8ff1-47a5-8e59-584d2c701b87 tempest-VolumesSnapshotTestJSON-581938750 None] Lock "cinder-99678f42-a9d2-4de7-b82c-fff35032ac56-delete_volume" acquired by "delete_volume" :: waited 0.115s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:47:14 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-0b7302c3-8ff1-47a5-8e59-584d2c701b87 tempest-VolumesSnapshotTestJSON-581938750 None] Acquiring lock "cinder-quobyte-99678f42-a9d2-4de7-b82c-fff35032ac56" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:47:14 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-0b7302c3-8ff1-47a5-8e59-584d2c701b87 tempest-VolumesSnapshotTestJSON-581938750 None] Lock "cinder-quobyte-99678f42-a9d2-4de7-b82c-fff35032ac56" acquired by "delete_volume" :: waited 0.025s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:47:14 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef0ff28-ad82-4de4-8875-512424608d23]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:47:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0b7302c3-8ff1-47a5-8e59-584d2c701b87 tempest-VolumesSnapshotTestJSON-581938750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-99678f42-a9d2-4de7-b82c-fff35032ac56 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:47:15 devstack sudo[95292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-99678f42-a9d2-4de7-b82c-fff35032ac56 Sep 08 06:47:15 devstack sudo[95292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:47:15 devstack sudo[95292]: pam_unix(sudo:session): session closed for user root Sep 08 06:47:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0b7302c3-8ff1-47a5-8e59-584d2c701b87 tempest-VolumesSnapshotTestJSON-581938750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-99678f42-a9d2-4de7-b82c-fff35032ac56" returned: 0 in 1.098s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:47:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0b7302c3-8ff1-47a5-8e59-584d2c701b87 tempest-VolumesSnapshotTestJSON-581938750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-99678f42-a9d2-4de7-b82c-fff35032ac56 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:47:15 devstack sudo[95300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-99678f42-a9d2-4de7-b82c-fff35032ac56 Sep 08 06:47:15 devstack sudo[95300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:47:16 devstack sudo[95300]: pam_unix(sudo:session): session closed for user root Sep 08 06:47:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0b7302c3-8ff1-47a5-8e59-584d2c701b87 tempest-VolumesSnapshotTestJSON-581938750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-99678f42-a9d2-4de7-b82c-fff35032ac56" returned: 0 in 0.525s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:47:16 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-0b7302c3-8ff1-47a5-8e59-584d2c701b87 tempest-VolumesSnapshotTestJSON-581938750 None] Lock "cinder-quobyte-99678f42-a9d2-4de7-b82c-fff35032ac56" released by "delete_volume" :: held 1.868s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:47:16 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-0b7302c3-8ff1-47a5-8e59-584d2c701b87 tempest-VolumesSnapshotTestJSON-581938750 None] Created reservations ['bd5ad02a-8819-41bb-8426-f914b1f6e032', '291833f5-d32a-4134-bcf0-d464592a87db', 'd1506392-7ce4-4cce-9fe2-54d2d7e90703', 'cef3938c-1abd-4192-80e2-0d36257dbc28'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:47:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-0b7302c3-8ff1-47a5-8e59-584d2c701b87 tempest-VolumesSnapshotTestJSON-581938750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:47:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-0b7302c3-8ff1-47a5-8e59-584d2c701b87 tempest-VolumesSnapshotTestJSON-581938750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:47:16 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-0b7302c3-8ff1-47a5-8e59-584d2c701b87 tempest-VolumesSnapshotTestJSON-581938750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:47:16 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-0b7302c3-8ff1-47a5-8e59-584d2c701b87 tempest-VolumesSnapshotTestJSON-581938750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:47:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-0b7302c3-8ff1-47a5-8e59-584d2c701b87 tempest-VolumesSnapshotTestJSON-581938750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:47:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0b7302c3-8ff1-47a5-8e59-584d2c701b87 tempest-VolumesSnapshotTestJSON-581938750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:47:16 devstack sudo[95305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:47:16 devstack sudo[95305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:47:17 devstack sudo[95305]: pam_unix(sudo:session): session closed for user root Sep 08 06:47:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0b7302c3-8ff1-47a5-8e59-584d2c701b87 tempest-VolumesSnapshotTestJSON-581938750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.672s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:47:17 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-0b7302c3-8ff1-47a5-8e59-584d2c701b87 tempest-VolumesSnapshotTestJSON-581938750 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:47:17 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-0b7302c3-8ff1-47a5-8e59-584d2c701b87 tempest-VolumesSnapshotTestJSON-581938750 None] Deleted volume successfully. Sep 08 06:47:17 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-0b7302c3-8ff1-47a5-8e59-584d2c701b87 tempest-VolumesSnapshotTestJSON-581938750 None] Lock "cinder-99678f42-a9d2-4de7-b82c-fff35032ac56-delete_volume" released by "delete_volume" :: held 3.202s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:47:19 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [req-cb4190b8-3def-4c86-8d62-9810aed8a9d1 req-f34a75f5-3431-4ea9-b403-0ce972565518 tempest-VolumesGetTestJSON-709585975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:47:19 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-cb4190b8-3def-4c86-8d62-9810aed8a9d1 req-f34a75f5-3431-4ea9-b403-0ce972565518 tempest-VolumesGetTestJSON-709585975 None] Flow 'volume_create_manager' (1124d06f-5f12-4998-8383-70bcc54ea698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:47:19 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-cb4190b8-3def-4c86-8d62-9810aed8a9d1 req-f34a75f5-3431-4ea9-b403-0ce972565518 tempest-VolumesGetTestJSON-709585975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e217c6af-d1f4-4d81-bcdb-cdb763bbb547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:47:19 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-cb4190b8-3def-4c86-8d62-9810aed8a9d1 req-f34a75f5-3431-4ea9-b403-0ce972565518 tempest-VolumesGetTestJSON-709585975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e217c6af-d1f4-4d81-bcdb-cdb763bbb547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:47:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1313613324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7607df1-17af-4d13-980d-b2b7d04fd803,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='00844b41028a434886dcf5d9db2ebc4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:47:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:47:19Z,use_quota=True,user_id='19edcb779a9f43b5beac0824acf030f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:47:19 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-cb4190b8-3def-4c86-8d62-9810aed8a9d1 req-f34a75f5-3431-4ea9-b403-0ce972565518 tempest-VolumesGetTestJSON-709585975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9459cbc7-3152-49e4-8518-a0c1791aa17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:47:19 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-cb4190b8-3def-4c86-8d62-9810aed8a9d1 req-f34a75f5-3431-4ea9-b403-0ce972565518 tempest-VolumesGetTestJSON-709585975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9459cbc7-3152-49e4-8518-a0c1791aa17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:47:19 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-cb4190b8-3def-4c86-8d62-9810aed8a9d1 req-f34a75f5-3431-4ea9-b403-0ce972565518 tempest-VolumesGetTestJSON-709585975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15472ff1-41a5-49ad-b354-fefd9cdd7e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:47:19 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-cb4190b8-3def-4c86-8d62-9810aed8a9d1 req-f34a75f5-3431-4ea9-b403-0ce972565518 tempest-VolumesGetTestJSON-709585975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15472ff1-41a5-49ad-b354-fefd9cdd7e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7607df1-17af-4d13-980d-b2b7d04fd803', 'volume_name': 'volume-b7607df1-17af-4d13-980d-b2b7d04fd803', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:47:19 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-cb4190b8-3def-4c86-8d62-9810aed8a9d1 req-f34a75f5-3431-4ea9-b403-0ce972565518 tempest-VolumesGetTestJSON-709585975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55622c14-547b-4301-a716-9ac8802203d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:47:19 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-cb4190b8-3def-4c86-8d62-9810aed8a9d1 req-f34a75f5-3431-4ea9-b403-0ce972565518 tempest-VolumesGetTestJSON-709585975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55622c14-547b-4301-a716-9ac8802203d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:47:19 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-cb4190b8-3def-4c86-8d62-9810aed8a9d1 req-f34a75f5-3431-4ea9-b403-0ce972565518 tempest-VolumesGetTestJSON-709585975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0470c404-76e9-45ca-bc02-3a11f190debe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:47:19 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [req-cb4190b8-3def-4c86-8d62-9810aed8a9d1 req-f34a75f5-3431-4ea9-b403-0ce972565518 tempest-VolumesGetTestJSON-709585975 None] Volume b7607df1-17af-4d13-980d-b2b7d04fd803: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7607df1-17af-4d13-980d-b2b7d04fd803', 'volume_size': 1} Sep 08 06:47:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-cb4190b8-3def-4c86-8d62-9810aed8a9d1 req-f34a75f5-3431-4ea9-b403-0ce972565518 tempest-VolumesGetTestJSON-709585975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:47:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-cb4190b8-3def-4c86-8d62-9810aed8a9d1 req-f34a75f5-3431-4ea9-b403-0ce972565518 tempest-VolumesGetTestJSON-709585975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:47:19 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [req-cb4190b8-3def-4c86-8d62-9810aed8a9d1 req-f34a75f5-3431-4ea9-b403-0ce972565518 tempest-VolumesGetTestJSON-709585975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:47:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1313613324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7607df1-17af-4d13-980d-b2b7d04fd803,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='00844b41028a434886dcf5d9db2ebc4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:47:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:47:19Z,use_quota=True,user_id='19edcb779a9f43b5beac0824acf030f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:47:19 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [req-cb4190b8-3def-4c86-8d62-9810aed8a9d1 req-f34a75f5-3431-4ea9-b403-0ce972565518 tempest-VolumesGetTestJSON-709585975 None] Creating volume b7607df1-17af-4d13-980d-b2b7d04fd803 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:47:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-cb4190b8-3def-4c86-8d62-9810aed8a9d1 req-f34a75f5-3431-4ea9-b403-0ce972565518 tempest-VolumesGetTestJSON-709585975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:47:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-cb4190b8-3def-4c86-8d62-9810aed8a9d1 req-f34a75f5-3431-4ea9-b403-0ce972565518 tempest-VolumesGetTestJSON-709585975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:47:19 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [req-cb4190b8-3def-4c86-8d62-9810aed8a9d1 req-f34a75f5-3431-4ea9-b403-0ce972565518 tempest-VolumesGetTestJSON-709585975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:47:19 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [req-cb4190b8-3def-4c86-8d62-9810aed8a9d1 req-f34a75f5-3431-4ea9-b403-0ce972565518 tempest-VolumesGetTestJSON-709585975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:47:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-cb4190b8-3def-4c86-8d62-9810aed8a9d1 req-f34a75f5-3431-4ea9-b403-0ce972565518 tempest-VolumesGetTestJSON-709585975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:47:19 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [req-cb4190b8-3def-4c86-8d62-9810aed8a9d1 req-f34a75f5-3431-4ea9-b403-0ce972565518 tempest-VolumesGetTestJSON-709585975 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:47:19 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [req-cb4190b8-3def-4c86-8d62-9810aed8a9d1 req-f34a75f5-3431-4ea9-b403-0ce972565518 tempest-VolumesGetTestJSON-709585975 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:47:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [req-cb4190b8-3def-4c86-8d62-9810aed8a9d1 req-f34a75f5-3431-4ea9-b403-0ce972565518 tempest-VolumesGetTestJSON-709585975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b7607df1-17af-4d13-980d-b2b7d04fd803 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:47:19 devstack sudo[95315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b7607df1-17af-4d13-980d-b2b7d04fd803 1073741824 Sep 08 06:47:19 devstack sudo[95315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:47:20 devstack sudo[95315]: pam_unix(sudo:session): session closed for user root Sep 08 06:47:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [req-cb4190b8-3def-4c86-8d62-9810aed8a9d1 req-f34a75f5-3431-4ea9-b403-0ce972565518 tempest-VolumesGetTestJSON-709585975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b7607df1-17af-4d13-980d-b2b7d04fd803 1073741824" returned: 0 in 0.683s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:47:20 devstack cinder-volume[87507]: DEBUG oslo_service.periodic_task [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87507) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 06:47:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:47:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:47:20 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:47:20 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:47:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:47:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:47:20 devstack sudo[95329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:47:20 devstack sudo[95329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:47:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [req-cb4190b8-3def-4c86-8d62-9810aed8a9d1 req-f34a75f5-3431-4ea9-b403-0ce972565518 tempest-VolumesGetTestJSON-709585975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b7607df1-17af-4d13-980d-b2b7d04fd803 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:47:20 devstack sudo[95331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b7607df1-17af-4d13-980d-b2b7d04fd803 Sep 08 06:47:20 devstack sudo[95331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:47:20 devstack sudo[95331]: pam_unix(sudo:session): session closed for user root Sep 08 06:47:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [req-cb4190b8-3def-4c86-8d62-9810aed8a9d1 req-f34a75f5-3431-4ea9-b403-0ce972565518 tempest-VolumesGetTestJSON-709585975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b7607df1-17af-4d13-980d-b2b7d04fd803" returned: 0 in 0.465s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:47:20 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [req-cb4190b8-3def-4c86-8d62-9810aed8a9d1 req-f34a75f5-3431-4ea9-b403-0ce972565518 tempest-VolumesGetTestJSON-709585975 None] <== create_volume: return (1322ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:47:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-cb4190b8-3def-4c86-8d62-9810aed8a9d1 req-f34a75f5-3431-4ea9-b403-0ce972565518 tempest-VolumesGetTestJSON-709585975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.326s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:47:20 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-cb4190b8-3def-4c86-8d62-9810aed8a9d1 req-f34a75f5-3431-4ea9-b403-0ce972565518 tempest-VolumesGetTestJSON-709585975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0470c404-76e9-45ca-bc02-3a11f190debe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7607df1-17af-4d13-980d-b2b7d04fd803', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:47:20 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-cb4190b8-3def-4c86-8d62-9810aed8a9d1 req-f34a75f5-3431-4ea9-b403-0ce972565518 tempest-VolumesGetTestJSON-709585975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff952f67-d4f3-480f-929e-cadf63cdf724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:47:20 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [req-cb4190b8-3def-4c86-8d62-9810aed8a9d1 req-f34a75f5-3431-4ea9-b403-0ce972565518 tempest-VolumesGetTestJSON-709585975 None] Volume volume-b7607df1-17af-4d13-980d-b2b7d04fd803 (b7607df1-17af-4d13-980d-b2b7d04fd803): created successfully Sep 08 06:47:20 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-cb4190b8-3def-4c86-8d62-9810aed8a9d1 req-f34a75f5-3431-4ea9-b403-0ce972565518 tempest-VolumesGetTestJSON-709585975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff952f67-d4f3-480f-929e-cadf63cdf724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:47:20 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-cb4190b8-3def-4c86-8d62-9810aed8a9d1 req-f34a75f5-3431-4ea9-b403-0ce972565518 tempest-VolumesGetTestJSON-709585975 None] Flow 'volume_create_manager' (1124d06f-5f12-4998-8383-70bcc54ea698) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:47:20 devstack cinder-volume[87507]: INFO cinder.volume.manager [req-cb4190b8-3def-4c86-8d62-9810aed8a9d1 req-f34a75f5-3431-4ea9-b403-0ce972565518 tempest-VolumesGetTestJSON-709585975 None] Created volume successfully. Sep 08 06:47:20 devstack sudo[95329]: pam_unix(sudo:session): session closed for user root Sep 08 06:47:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.767s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:47:20 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:47:20 devstack cinder-volume[87507]: DEBUG oslo_service.periodic_task [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Running periodic task VolumeManager._thread_info {{(pid=87507) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 06:47:20 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] thread count: 29 {{(pid=87507) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 06:47:20 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] thread info: [<_MainThread(MainThread, started 127913129345152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87507) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 06:47:21 devstack cinder-volume[87507]: DEBUG cinder.coordination [req-41eb9867-d00d-49bd-8c99-d305434b1e11 req-e655ebd4-29a2-4362-9d51-08cc05c50d3b tempest-VolumesGetTestJSON-709585975 None] Acquiring lock "cinder-b7607df1-17af-4d13-980d-b2b7d04fd803-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:47:21 devstack cinder-volume[87507]: DEBUG cinder.coordination [req-41eb9867-d00d-49bd-8c99-d305434b1e11 req-e655ebd4-29a2-4362-9d51-08cc05c50d3b tempest-VolumesGetTestJSON-709585975 None] Lock "cinder-b7607df1-17af-4d13-980d-b2b7d04fd803-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:47:22 devstack cinder-volume[87507]: DEBUG cinder.coordination [req-41eb9867-d00d-49bd-8c99-d305434b1e11 req-e655ebd4-29a2-4362-9d51-08cc05c50d3b tempest-VolumesGetTestJSON-709585975 None] Acquiring lock "cinder-quobyte-b7607df1-17af-4d13-980d-b2b7d04fd803" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:47:22 devstack cinder-volume[87507]: DEBUG cinder.coordination [req-41eb9867-d00d-49bd-8c99-d305434b1e11 req-e655ebd4-29a2-4362-9d51-08cc05c50d3b tempest-VolumesGetTestJSON-709585975 None] Lock "cinder-quobyte-b7607df1-17af-4d13-980d-b2b7d04fd803" acquired by "delete_volume" :: waited 0.047s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:47:22 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[14aafa53-362a-4160-83b8-a8564155d082]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:47:22 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [req-41eb9867-d00d-49bd-8c99-d305434b1e11 req-e655ebd4-29a2-4362-9d51-08cc05c50d3b tempest-VolumesGetTestJSON-709585975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b7607df1-17af-4d13-980d-b2b7d04fd803 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:47:22 devstack sudo[95360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b7607df1-17af-4d13-980d-b2b7d04fd803 Sep 08 06:47:22 devstack sudo[95360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:47:22 devstack sudo[95360]: pam_unix(sudo:session): session closed for user root Sep 08 06:47:22 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [req-41eb9867-d00d-49bd-8c99-d305434b1e11 req-e655ebd4-29a2-4362-9d51-08cc05c50d3b tempest-VolumesGetTestJSON-709585975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b7607df1-17af-4d13-980d-b2b7d04fd803" returned: 0 in 0.852s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:47:22 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [req-41eb9867-d00d-49bd-8c99-d305434b1e11 req-e655ebd4-29a2-4362-9d51-08cc05c50d3b tempest-VolumesGetTestJSON-709585975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b7607df1-17af-4d13-980d-b2b7d04fd803 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:47:23 devstack sudo[95367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b7607df1-17af-4d13-980d-b2b7d04fd803 Sep 08 06:47:23 devstack sudo[95367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:47:23 devstack sudo[95367]: pam_unix(sudo:session): session closed for user root Sep 08 06:47:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [req-41eb9867-d00d-49bd-8c99-d305434b1e11 req-e655ebd4-29a2-4362-9d51-08cc05c50d3b tempest-VolumesGetTestJSON-709585975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b7607df1-17af-4d13-980d-b2b7d04fd803" returned: 0 in 0.349s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:47:23 devstack cinder-volume[87507]: DEBUG cinder.coordination [req-41eb9867-d00d-49bd-8c99-d305434b1e11 req-e655ebd4-29a2-4362-9d51-08cc05c50d3b tempest-VolumesGetTestJSON-709585975 None] Lock "cinder-quobyte-b7607df1-17af-4d13-980d-b2b7d04fd803" released by "delete_volume" :: held 1.271s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:47:23 devstack cinder-volume[87507]: DEBUG cinder.quota [req-41eb9867-d00d-49bd-8c99-d305434b1e11 req-e655ebd4-29a2-4362-9d51-08cc05c50d3b tempest-VolumesGetTestJSON-709585975 None] Created reservations ['9aa94388-eae0-472a-b3e7-2345ff53a745', '8853210b-606c-4633-a377-7dd85f3daa19', '2dc9bcb9-acad-43b2-b4e0-9137d30f528f', '0ab91677-e4e3-4cc7-a7f8-145c36e17ef9'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:47:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-41eb9867-d00d-49bd-8c99-d305434b1e11 req-e655ebd4-29a2-4362-9d51-08cc05c50d3b tempest-VolumesGetTestJSON-709585975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:47:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-41eb9867-d00d-49bd-8c99-d305434b1e11 req-e655ebd4-29a2-4362-9d51-08cc05c50d3b tempest-VolumesGetTestJSON-709585975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:47:23 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [req-41eb9867-d00d-49bd-8c99-d305434b1e11 req-e655ebd4-29a2-4362-9d51-08cc05c50d3b tempest-VolumesGetTestJSON-709585975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:47:23 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [req-41eb9867-d00d-49bd-8c99-d305434b1e11 req-e655ebd4-29a2-4362-9d51-08cc05c50d3b tempest-VolumesGetTestJSON-709585975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:47:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-41eb9867-d00d-49bd-8c99-d305434b1e11 req-e655ebd4-29a2-4362-9d51-08cc05c50d3b tempest-VolumesGetTestJSON-709585975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:47:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [req-41eb9867-d00d-49bd-8c99-d305434b1e11 req-e655ebd4-29a2-4362-9d51-08cc05c50d3b tempest-VolumesGetTestJSON-709585975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:47:23 devstack sudo[95370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:47:23 devstack sudo[95370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:47:24 devstack sudo[95370]: pam_unix(sudo:session): session closed for user root Sep 08 06:47:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [req-41eb9867-d00d-49bd-8c99-d305434b1e11 req-e655ebd4-29a2-4362-9d51-08cc05c50d3b tempest-VolumesGetTestJSON-709585975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.551s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:47:24 devstack cinder-volume[87507]: DEBUG cinder.manager [req-41eb9867-d00d-49bd-8c99-d305434b1e11 req-e655ebd4-29a2-4362-9d51-08cc05c50d3b tempest-VolumesGetTestJSON-709585975 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:47:24 devstack cinder-volume[87507]: INFO cinder.volume.manager [req-41eb9867-d00d-49bd-8c99-d305434b1e11 req-e655ebd4-29a2-4362-9d51-08cc05c50d3b tempest-VolumesGetTestJSON-709585975 None] Deleted volume successfully. Sep 08 06:47:24 devstack cinder-volume[87507]: DEBUG cinder.coordination [req-41eb9867-d00d-49bd-8c99-d305434b1e11 req-e655ebd4-29a2-4362-9d51-08cc05c50d3b tempest-VolumesGetTestJSON-709585975 None] Lock "cinder-b7607df1-17af-4d13-980d-b2b7d04fd803-delete_volume" released by "delete_volume" :: held 2.266s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:47:26 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb57202b-9826-4753-9c03-df882b7144b1 tempest-ServerRescueNegativeTestJSON-1881373000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:47:26 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-bb57202b-9826-4753-9c03-df882b7144b1 tempest-ServerRescueNegativeTestJSON-1881373000 None] Flow 'volume_create_manager' (bbecdead-4e68-4172-bb69-b253c673934f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:47:26 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-bb57202b-9826-4753-9c03-df882b7144b1 tempest-ServerRescueNegativeTestJSON-1881373000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c14e02ec-c1c0-45fc-90d5-3a0359b5263e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:47:26 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-bb57202b-9826-4753-9c03-df882b7144b1 tempest-ServerRescueNegativeTestJSON-1881373000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c14e02ec-c1c0-45fc-90d5-3a0359b5263e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:47:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1424615419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=942c8b1d-37ee-4563-8f00-dcd688eae50f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f660836be5743fa818804e411ecc57e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:47:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:47:26Z,use_quota=True,user_id='13a11841d0064ef38f2d767aa823dc4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:47:26 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-bb57202b-9826-4753-9c03-df882b7144b1 tempest-ServerRescueNegativeTestJSON-1881373000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6482fa20-a17f-4bbb-8ab5-9de93cdd99d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:47:26 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-bb57202b-9826-4753-9c03-df882b7144b1 tempest-ServerRescueNegativeTestJSON-1881373000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6482fa20-a17f-4bbb-8ab5-9de93cdd99d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:47:26 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-bb57202b-9826-4753-9c03-df882b7144b1 tempest-ServerRescueNegativeTestJSON-1881373000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64f627ba-fcb1-408a-bc8e-be8f6326c1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:47:26 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-bb57202b-9826-4753-9c03-df882b7144b1 tempest-ServerRescueNegativeTestJSON-1881373000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64f627ba-fcb1-408a-bc8e-be8f6326c1d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '942c8b1d-37ee-4563-8f00-dcd688eae50f', 'volume_name': 'volume-942c8b1d-37ee-4563-8f00-dcd688eae50f', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:47:26 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-bb57202b-9826-4753-9c03-df882b7144b1 tempest-ServerRescueNegativeTestJSON-1881373000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18fa60bc-1f5e-4cfb-8647-4c5f1d927cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:47:26 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-bb57202b-9826-4753-9c03-df882b7144b1 tempest-ServerRescueNegativeTestJSON-1881373000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18fa60bc-1f5e-4cfb-8647-4c5f1d927cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:47:26 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-bb57202b-9826-4753-9c03-df882b7144b1 tempest-ServerRescueNegativeTestJSON-1881373000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cff2348d-20af-42dc-84e9-14657bca0416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:47:26 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-bb57202b-9826-4753-9c03-df882b7144b1 tempest-ServerRescueNegativeTestJSON-1881373000 None] Volume 942c8b1d-37ee-4563-8f00-dcd688eae50f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-942c8b1d-37ee-4563-8f00-dcd688eae50f', 'volume_size': 1} Sep 08 06:47:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-bb57202b-9826-4753-9c03-df882b7144b1 tempest-ServerRescueNegativeTestJSON-1881373000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:47:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-bb57202b-9826-4753-9c03-df882b7144b1 tempest-ServerRescueNegativeTestJSON-1881373000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:47:26 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-bb57202b-9826-4753-9c03-df882b7144b1 tempest-ServerRescueNegativeTestJSON-1881373000 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:47:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1424615419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=942c8b1d-37ee-4563-8f00-dcd688eae50f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f660836be5743fa818804e411ecc57e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:47:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:47:26Z,use_quota=True,user_id='13a11841d0064ef38f2d767aa823dc4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:47:26 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-bb57202b-9826-4753-9c03-df882b7144b1 tempest-ServerRescueNegativeTestJSON-1881373000 None] Creating volume 942c8b1d-37ee-4563-8f00-dcd688eae50f {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:47:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-bb57202b-9826-4753-9c03-df882b7144b1 tempest-ServerRescueNegativeTestJSON-1881373000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:47:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-bb57202b-9826-4753-9c03-df882b7144b1 tempest-ServerRescueNegativeTestJSON-1881373000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:47:26 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-bb57202b-9826-4753-9c03-df882b7144b1 tempest-ServerRescueNegativeTestJSON-1881373000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:47:26 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-bb57202b-9826-4753-9c03-df882b7144b1 tempest-ServerRescueNegativeTestJSON-1881373000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:47:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-bb57202b-9826-4753-9c03-df882b7144b1 tempest-ServerRescueNegativeTestJSON-1881373000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:47:26 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-bb57202b-9826-4753-9c03-df882b7144b1 tempest-ServerRescueNegativeTestJSON-1881373000 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:47:26 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-bb57202b-9826-4753-9c03-df882b7144b1 tempest-ServerRescueNegativeTestJSON-1881373000 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:47:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bb57202b-9826-4753-9c03-df882b7144b1 tempest-ServerRescueNegativeTestJSON-1881373000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-942c8b1d-37ee-4563-8f00-dcd688eae50f 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:47:26 devstack sudo[95380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-942c8b1d-37ee-4563-8f00-dcd688eae50f 1073741824 Sep 08 06:47:26 devstack sudo[95380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:47:27 devstack sudo[95380]: pam_unix(sudo:session): session closed for user root Sep 08 06:47:27 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bb57202b-9826-4753-9c03-df882b7144b1 tempest-ServerRescueNegativeTestJSON-1881373000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-942c8b1d-37ee-4563-8f00-dcd688eae50f 1073741824" returned: 0 in 0.898s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:47:27 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bb57202b-9826-4753-9c03-df882b7144b1 tempest-ServerRescueNegativeTestJSON-1881373000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-942c8b1d-37ee-4563-8f00-dcd688eae50f {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:47:27 devstack sudo[95415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-942c8b1d-37ee-4563-8f00-dcd688eae50f Sep 08 06:47:27 devstack sudo[95415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:47:28 devstack sudo[95415]: pam_unix(sudo:session): session closed for user root Sep 08 06:47:28 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bb57202b-9826-4753-9c03-df882b7144b1 tempest-ServerRescueNegativeTestJSON-1881373000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-942c8b1d-37ee-4563-8f00-dcd688eae50f" returned: 0 in 0.411s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:47:28 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-bb57202b-9826-4753-9c03-df882b7144b1 tempest-ServerRescueNegativeTestJSON-1881373000 None] <== create_volume: return (1391ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:47:28 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-bb57202b-9826-4753-9c03-df882b7144b1 tempest-ServerRescueNegativeTestJSON-1881373000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.395s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:47:28 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-bb57202b-9826-4753-9c03-df882b7144b1 tempest-ServerRescueNegativeTestJSON-1881373000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cff2348d-20af-42dc-84e9-14657bca0416) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-942c8b1d-37ee-4563-8f00-dcd688eae50f', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:47:28 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-bb57202b-9826-4753-9c03-df882b7144b1 tempest-ServerRescueNegativeTestJSON-1881373000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (362bf4f9-e75a-4dc8-a461-e95893309e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:47:28 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-bb57202b-9826-4753-9c03-df882b7144b1 tempest-ServerRescueNegativeTestJSON-1881373000 None] Volume volume-942c8b1d-37ee-4563-8f00-dcd688eae50f (942c8b1d-37ee-4563-8f00-dcd688eae50f): created successfully Sep 08 06:47:28 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-bb57202b-9826-4753-9c03-df882b7144b1 tempest-ServerRescueNegativeTestJSON-1881373000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (362bf4f9-e75a-4dc8-a461-e95893309e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:47:28 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-bb57202b-9826-4753-9c03-df882b7144b1 tempest-ServerRescueNegativeTestJSON-1881373000 None] Flow 'volume_create_manager' (bbecdead-4e68-4172-bb69-b253c673934f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:47:28 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-bb57202b-9826-4753-9c03-df882b7144b1 tempest-ServerRescueNegativeTestJSON-1881373000 None] Created volume successfully. Sep 08 06:47:33 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-bc6faa01-83ac-4d45-a8a4-3dd621a3c6bb tempest-GroupSnapshotsTest-1581907882 None] Group tempest-GroupSnapshotsTest-Group-1662412784: creating Sep 08 06:47:33 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-bc6faa01-83ac-4d45-a8a4-3dd621a3c6bb tempest-GroupSnapshotsTest-1581907882 None] Group tempest-GroupSnapshotsTest-Group-1662412784: created successfully Sep 08 06:47:33 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-bc6faa01-83ac-4d45-a8a4-3dd621a3c6bb tempest-GroupSnapshotsTest-1581907882 None] Create group completed successfully. Sep 08 06:47:35 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-a32adbb9-da52-41e6-903d-e53f4f9ea6ec tempest-GroupSnapshotsTest-1581907882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:47:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a32adbb9-da52-41e6-903d-e53f4f9ea6ec tempest-GroupSnapshotsTest-1581907882 None] Flow 'volume_create_manager' (0bd65b6c-ba72-43df-84e5-08d2cfc17466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:47:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a32adbb9-da52-41e6-903d-e53f4f9ea6ec tempest-GroupSnapshotsTest-1581907882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d14dfd02-8dd9-4390-aca6-cc1b27b85a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:47:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a32adbb9-da52-41e6-903d-e53f4f9ea6ec tempest-GroupSnapshotsTest-1581907882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d14dfd02-8dd9-4390-aca6-cc1b27b85a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:47:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1134885667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=163f03fc-2d36-4528-92c9-7f437750106a,host='devstack@QuobyteHD#QuobyteHD',id=dd8b16d3-91bb-44ca-bb99-088db965c710,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b968bdc7dff4a92ba2e67485c6e29c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:47:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:47:36Z,use_quota=True,user_id='659c95d7250a4fadb3b8dacbb72d4b5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af03ba69-da69-451d-8dbf-82889814851b),volume_type_id=af03ba69-da69-451d-8dbf-82889814851b)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:47:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a32adbb9-da52-41e6-903d-e53f4f9ea6ec tempest-GroupSnapshotsTest-1581907882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09f21f44-28b2-4d05-924f-d52321353659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:47:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a32adbb9-da52-41e6-903d-e53f4f9ea6ec tempest-GroupSnapshotsTest-1581907882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09f21f44-28b2-4d05-924f-d52321353659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:47:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a32adbb9-da52-41e6-903d-e53f4f9ea6ec tempest-GroupSnapshotsTest-1581907882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ccaa32a-f80c-4c65-b90d-f4c93effbf7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:47:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a32adbb9-da52-41e6-903d-e53f4f9ea6ec tempest-GroupSnapshotsTest-1581907882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ccaa32a-f80c-4c65-b90d-f4c93effbf7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd8b16d3-91bb-44ca-bb99-088db965c710', 'volume_name': 'volume-dd8b16d3-91bb-44ca-bb99-088db965c710', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:47:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a32adbb9-da52-41e6-903d-e53f4f9ea6ec tempest-GroupSnapshotsTest-1581907882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fecd817-dc29-4514-80b2-768cd89707b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:47:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a32adbb9-da52-41e6-903d-e53f4f9ea6ec tempest-GroupSnapshotsTest-1581907882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fecd817-dc29-4514-80b2-768cd89707b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:47:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a32adbb9-da52-41e6-903d-e53f4f9ea6ec tempest-GroupSnapshotsTest-1581907882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a4bb85c-896b-4b4b-90ba-f57d306874d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:47:35 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-a32adbb9-da52-41e6-903d-e53f4f9ea6ec tempest-GroupSnapshotsTest-1581907882 None] Volume dd8b16d3-91bb-44ca-bb99-088db965c710: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd8b16d3-91bb-44ca-bb99-088db965c710', 'volume_size': 1} Sep 08 06:47:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a32adbb9-da52-41e6-903d-e53f4f9ea6ec tempest-GroupSnapshotsTest-1581907882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:47:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a32adbb9-da52-41e6-903d-e53f4f9ea6ec tempest-GroupSnapshotsTest-1581907882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:47:35 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-a32adbb9-da52-41e6-903d-e53f4f9ea6ec tempest-GroupSnapshotsTest-1581907882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=163f03fc-2d36-4528-92c9-7f437750106a,created_at=2026-09-08T04:47:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1134885667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=163f03fc-2d36-4528-92c9-7f437750106a,host='devstack@QuobyteHD#QuobyteHD',id=dd8b16d3-91bb-44ca-bb99-088db965c710,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b968bdc7dff4a92ba2e67485c6e29c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:47:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:47:36Z,use_quota=True,user_id='659c95d7250a4fadb3b8dacbb72d4b5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af03ba69-da69-451d-8dbf-82889814851b),volume_type_id=af03ba69-da69-451d-8dbf-82889814851b)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:47:35 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-a32adbb9-da52-41e6-903d-e53f4f9ea6ec tempest-GroupSnapshotsTest-1581907882 None] Creating volume dd8b16d3-91bb-44ca-bb99-088db965c710 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:47:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a32adbb9-da52-41e6-903d-e53f4f9ea6ec tempest-GroupSnapshotsTest-1581907882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:47:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a32adbb9-da52-41e6-903d-e53f4f9ea6ec tempest-GroupSnapshotsTest-1581907882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:47:35 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-a32adbb9-da52-41e6-903d-e53f4f9ea6ec tempest-GroupSnapshotsTest-1581907882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:47:35 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-a32adbb9-da52-41e6-903d-e53f4f9ea6ec tempest-GroupSnapshotsTest-1581907882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:47:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a32adbb9-da52-41e6-903d-e53f4f9ea6ec tempest-GroupSnapshotsTest-1581907882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:47:35 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-a32adbb9-da52-41e6-903d-e53f4f9ea6ec tempest-GroupSnapshotsTest-1581907882 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:47:35 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-a32adbb9-da52-41e6-903d-e53f4f9ea6ec tempest-GroupSnapshotsTest-1581907882 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:47:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a32adbb9-da52-41e6-903d-e53f4f9ea6ec tempest-GroupSnapshotsTest-1581907882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dd8b16d3-91bb-44ca-bb99-088db965c710 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:47:35 devstack sudo[95465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dd8b16d3-91bb-44ca-bb99-088db965c710 1073741824 Sep 08 06:47:35 devstack sudo[95465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:47:36 devstack sudo[95465]: pam_unix(sudo:session): session closed for user root Sep 08 06:47:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a32adbb9-da52-41e6-903d-e53f4f9ea6ec tempest-GroupSnapshotsTest-1581907882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dd8b16d3-91bb-44ca-bb99-088db965c710 1073741824" returned: 0 in 1.006s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:47:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a32adbb9-da52-41e6-903d-e53f4f9ea6ec tempest-GroupSnapshotsTest-1581907882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dd8b16d3-91bb-44ca-bb99-088db965c710 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:47:37 devstack sudo[95471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dd8b16d3-91bb-44ca-bb99-088db965c710 Sep 08 06:47:37 devstack sudo[95471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:47:37 devstack sudo[95471]: pam_unix(sudo:session): session closed for user root Sep 08 06:47:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a32adbb9-da52-41e6-903d-e53f4f9ea6ec tempest-GroupSnapshotsTest-1581907882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dd8b16d3-91bb-44ca-bb99-088db965c710" returned: 0 in 0.328s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:47:37 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-a32adbb9-da52-41e6-903d-e53f4f9ea6ec tempest-GroupSnapshotsTest-1581907882 None] <== create_volume: return (1433ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:47:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a32adbb9-da52-41e6-903d-e53f4f9ea6ec tempest-GroupSnapshotsTest-1581907882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.439s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:47:37 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a32adbb9-da52-41e6-903d-e53f4f9ea6ec tempest-GroupSnapshotsTest-1581907882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a4bb85c-896b-4b4b-90ba-f57d306874d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd8b16d3-91bb-44ca-bb99-088db965c710', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:47:37 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a32adbb9-da52-41e6-903d-e53f4f9ea6ec tempest-GroupSnapshotsTest-1581907882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4db35548-baf4-47e3-bfc2-c27295dd0ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:47:37 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-a32adbb9-da52-41e6-903d-e53f4f9ea6ec tempest-GroupSnapshotsTest-1581907882 None] Volume volume-dd8b16d3-91bb-44ca-bb99-088db965c710 (dd8b16d3-91bb-44ca-bb99-088db965c710): created successfully Sep 08 06:47:37 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a32adbb9-da52-41e6-903d-e53f4f9ea6ec tempest-GroupSnapshotsTest-1581907882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4db35548-baf4-47e3-bfc2-c27295dd0ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:47:37 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a32adbb9-da52-41e6-903d-e53f4f9ea6ec tempest-GroupSnapshotsTest-1581907882 None] Flow 'volume_create_manager' (0bd65b6c-ba72-43df-84e5-08d2cfc17466) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:47:37 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-a32adbb9-da52-41e6-903d-e53f4f9ea6ec tempest-GroupSnapshotsTest-1581907882 None] Created volume successfully. Sep 08 06:47:38 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-ce37e0ac-0a0f-4be6-9b8c-45fc25bd36e1 tempest-GroupSnapshotsTest-1581907882 None] GroupSnapshot 2ec8656d-2a86-481c-bff0-3d48077b79d2: creating. Sep 08 06:47:39 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ce37e0ac-0a0f-4be6-9b8c-45fc25bd36e1 tempest-GroupSnapshotsTest-1581907882 None] Group snapshot 2ec8656d-2a86-481c-bff0-3d48077b79d2: creating. {{(pid=87507) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 08 06:47:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-ce37e0ac-0a0f-4be6-9b8c-45fc25bd36e1 tempest-GroupSnapshotsTest-1581907882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:47:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-ce37e0ac-0a0f-4be6-9b8c-45fc25bd36e1 tempest-GroupSnapshotsTest-1581907882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:47:39 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-ce37e0ac-0a0f-4be6-9b8c-45fc25bd36e1 tempest-GroupSnapshotsTest-1581907882 None] Creating offline snapshot e0dd763f-0983-4fab-9ce2-70f3f8b3359a of volume dd8b16d3-91bb-44ca-bb99-088db965c710 {{(pid=87507) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 06:47:39 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf4b1a5-8c13-4a5b-aa3f-45d60a8f148a]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:47:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ce37e0ac-0a0f-4be6-9b8c-45fc25bd36e1 tempest-GroupSnapshotsTest-1581907882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dd8b16d3-91bb-44ca-bb99-088db965c710 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:47:39 devstack sudo[95532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dd8b16d3-91bb-44ca-bb99-088db965c710 Sep 08 06:47:39 devstack sudo[95532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:47:39 devstack sudo[95532]: pam_unix(sudo:session): session closed for user root Sep 08 06:47:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ce37e0ac-0a0f-4be6-9b8c-45fc25bd36e1 tempest-GroupSnapshotsTest-1581907882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dd8b16d3-91bb-44ca-bb99-088db965c710" returned: 0 in 0.721s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:47:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ce37e0ac-0a0f-4be6-9b8c-45fc25bd36e1 tempest-GroupSnapshotsTest-1581907882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dd8b16d3-91bb-44ca-bb99-088db965c710,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dd8b16d3-91bb-44ca-bb99-088db965c710.e0dd763f-0983-4fab-9ce2-70f3f8b3359a 1G {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:47:40 devstack sudo[95537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dd8b16d3-91bb-44ca-bb99-088db965c710,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dd8b16d3-91bb-44ca-bb99-088db965c710.e0dd763f-0983-4fab-9ce2-70f3f8b3359a 1G Sep 08 06:47:40 devstack sudo[95537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:47:40 devstack sudo[95537]: pam_unix(sudo:session): session closed for user root Sep 08 06:47:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ce37e0ac-0a0f-4be6-9b8c-45fc25bd36e1 tempest-GroupSnapshotsTest-1581907882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dd8b16d3-91bb-44ca-bb99-088db965c710,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dd8b16d3-91bb-44ca-bb99-088db965c710.e0dd763f-0983-4fab-9ce2-70f3f8b3359a 1G" returned: 0 in 0.608s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:47:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ce37e0ac-0a0f-4be6-9b8c-45fc25bd36e1 tempest-GroupSnapshotsTest-1581907882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd8b16d3-91bb-44ca-bb99-088db965c710 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dd8b16d3-91bb-44ca-bb99-088db965c710.e0dd763f-0983-4fab-9ce2-70f3f8b3359a {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:47:40 devstack sudo[95545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd8b16d3-91bb-44ca-bb99-088db965c710 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dd8b16d3-91bb-44ca-bb99-088db965c710.e0dd763f-0983-4fab-9ce2-70f3f8b3359a Sep 08 06:47:40 devstack sudo[95545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:47:41 devstack sudo[95545]: pam_unix(sudo:session): session closed for user root Sep 08 06:47:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ce37e0ac-0a0f-4be6-9b8c-45fc25bd36e1 tempest-GroupSnapshotsTest-1581907882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd8b16d3-91bb-44ca-bb99-088db965c710 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dd8b16d3-91bb-44ca-bb99-088db965c710.e0dd763f-0983-4fab-9ce2-70f3f8b3359a" returned: 0 in 0.550s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:47:41 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-ce37e0ac-0a0f-4be6-9b8c-45fc25bd36e1 tempest-GroupSnapshotsTest-1581907882 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dd8b16d3-91bb-44ca-bb99-088db965c710.e0dd763f-0983-4fab-9ce2-70f3f8b3359a is being set with open permissions: ugo+rw: NotImplementedError Sep 08 06:47:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ce37e0ac-0a0f-4be6-9b8c-45fc25bd36e1 tempest-GroupSnapshotsTest-1581907882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dd8b16d3-91bb-44ca-bb99-088db965c710.e0dd763f-0983-4fab-9ce2-70f3f8b3359a {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:47:41 devstack sudo[95551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dd8b16d3-91bb-44ca-bb99-088db965c710.e0dd763f-0983-4fab-9ce2-70f3f8b3359a Sep 08 06:47:41 devstack sudo[95551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:47:41 devstack sudo[95551]: pam_unix(sudo:session): session closed for user root Sep 08 06:47:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ce37e0ac-0a0f-4be6-9b8c-45fc25bd36e1 tempest-GroupSnapshotsTest-1581907882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dd8b16d3-91bb-44ca-bb99-088db965c710.e0dd763f-0983-4fab-9ce2-70f3f8b3359a" returned: 0 in 0.514s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:47:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ce37e0ac-0a0f-4be6-9b8c-45fc25bd36e1 tempest-GroupSnapshotsTest-1581907882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dd8b16d3-91bb-44ca-bb99-088db965c710.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:47:41 devstack sudo[95554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dd8b16d3-91bb-44ca-bb99-088db965c710.info Sep 08 06:47:41 devstack sudo[95554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:47:41 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-888f6854-4938-489d-8b0d-894367b4dbd8 tempest-ServerRescueNegativeTestJSON-1881373000 None] Acquiring lock "cinder-942c8b1d-37ee-4563-8f00-dcd688eae50f-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:47:41 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-888f6854-4938-489d-8b0d-894367b4dbd8 tempest-ServerRescueNegativeTestJSON-1881373000 None] Lock "cinder-942c8b1d-37ee-4563-8f00-dcd688eae50f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:47:41 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-888f6854-4938-489d-8b0d-894367b4dbd8 tempest-ServerRescueNegativeTestJSON-1881373000 None] Acquiring lock "cinder-quobyte-942c8b1d-37ee-4563-8f00-dcd688eae50f" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:47:41 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-888f6854-4938-489d-8b0d-894367b4dbd8 tempest-ServerRescueNegativeTestJSON-1881373000 None] Lock "cinder-quobyte-942c8b1d-37ee-4563-8f00-dcd688eae50f" acquired by "delete_volume" :: waited 0.032s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:47:41 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9b8901-7174-455a-b270-54ca9281712f]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:47:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-888f6854-4938-489d-8b0d-894367b4dbd8 tempest-ServerRescueNegativeTestJSON-1881373000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-942c8b1d-37ee-4563-8f00-dcd688eae50f {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:47:42 devstack sudo[95556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-942c8b1d-37ee-4563-8f00-dcd688eae50f Sep 08 06:47:42 devstack sudo[95556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:47:42 devstack sudo[95554]: pam_unix(sudo:session): session closed for user root Sep 08 06:47:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ce37e0ac-0a0f-4be6-9b8c-45fc25bd36e1 tempest-GroupSnapshotsTest-1581907882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dd8b16d3-91bb-44ca-bb99-088db965c710.info" returned: 0 in 0.568s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:47:42 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-ce37e0ac-0a0f-4be6-9b8c-45fc25bd36e1 tempest-GroupSnapshotsTest-1581907882 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dd8b16d3-91bb-44ca-bb99-088db965c710.info is being set with open permissions: ugo+rw: NotImplementedError Sep 08 06:47:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ce37e0ac-0a0f-4be6-9b8c-45fc25bd36e1 tempest-GroupSnapshotsTest-1581907882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dd8b16d3-91bb-44ca-bb99-088db965c710.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:47:42 devstack sudo[95559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dd8b16d3-91bb-44ca-bb99-088db965c710.info Sep 08 06:47:42 devstack sudo[95559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:47:42 devstack sudo[95556]: pam_unix(sudo:session): session closed for user root Sep 08 06:47:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-888f6854-4938-489d-8b0d-894367b4dbd8 tempest-ServerRescueNegativeTestJSON-1881373000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-942c8b1d-37ee-4563-8f00-dcd688eae50f" returned: 0 in 0.498s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:47:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-888f6854-4938-489d-8b0d-894367b4dbd8 tempest-ServerRescueNegativeTestJSON-1881373000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-942c8b1d-37ee-4563-8f00-dcd688eae50f {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:47:42 devstack sudo[95565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-942c8b1d-37ee-4563-8f00-dcd688eae50f Sep 08 06:47:42 devstack sudo[95565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:47:42 devstack sudo[95559]: pam_unix(sudo:session): session closed for user root Sep 08 06:47:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ce37e0ac-0a0f-4be6-9b8c-45fc25bd36e1 tempest-GroupSnapshotsTest-1581907882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dd8b16d3-91bb-44ca-bb99-088db965c710.info" returned: 0 in 0.303s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:47:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-ce37e0ac-0a0f-4be6-9b8c-45fc25bd36e1 tempest-GroupSnapshotsTest-1581907882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.488s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:47:42 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-ce37e0ac-0a0f-4be6-9b8c-45fc25bd36e1 tempest-GroupSnapshotsTest-1581907882 None] group_snapshot 2ec8656d-2a86-481c-bff0-3d48077b79d2: created successfully Sep 08 06:47:42 devstack sudo[95565]: pam_unix(sudo:session): session closed for user root Sep 08 06:47:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-888f6854-4938-489d-8b0d-894367b4dbd8 tempest-ServerRescueNegativeTestJSON-1881373000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-942c8b1d-37ee-4563-8f00-dcd688eae50f" returned: 0 in 0.280s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:47:42 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-888f6854-4938-489d-8b0d-894367b4dbd8 tempest-ServerRescueNegativeTestJSON-1881373000 None] Lock "cinder-quobyte-942c8b1d-37ee-4563-8f00-dcd688eae50f" released by "delete_volume" :: held 0.853s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:47:42 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-888f6854-4938-489d-8b0d-894367b4dbd8 tempest-ServerRescueNegativeTestJSON-1881373000 None] Created reservations ['03bbfd29-c3c6-41a1-805c-ffb4bbcdb80e', '910337cd-d5f5-4314-aff6-0b7826132cd5', '4dca8543-bbad-4406-afff-137ef6d6f442', '4586291a-e831-4b2f-a45f-afc58b27247a'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:47:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-888f6854-4938-489d-8b0d-894367b4dbd8 tempest-ServerRescueNegativeTestJSON-1881373000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:47:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-888f6854-4938-489d-8b0d-894367b4dbd8 tempest-ServerRescueNegativeTestJSON-1881373000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:47:42 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-888f6854-4938-489d-8b0d-894367b4dbd8 tempest-ServerRescueNegativeTestJSON-1881373000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:47:42 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-888f6854-4938-489d-8b0d-894367b4dbd8 tempest-ServerRescueNegativeTestJSON-1881373000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:47:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-888f6854-4938-489d-8b0d-894367b4dbd8 tempest-ServerRescueNegativeTestJSON-1881373000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:47:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-888f6854-4938-489d-8b0d-894367b4dbd8 tempest-ServerRescueNegativeTestJSON-1881373000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:47:43 devstack sudo[95569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:47:43 devstack sudo[95569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:47:43 devstack sudo[95569]: pam_unix(sudo:session): session closed for user root Sep 08 06:47:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-888f6854-4938-489d-8b0d-894367b4dbd8 tempest-ServerRescueNegativeTestJSON-1881373000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.494s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:47:43 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-888f6854-4938-489d-8b0d-894367b4dbd8 tempest-ServerRescueNegativeTestJSON-1881373000 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:47:43 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-888f6854-4938-489d-8b0d-894367b4dbd8 tempest-ServerRescueNegativeTestJSON-1881373000 None] Deleted volume successfully. Sep 08 06:47:43 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-888f6854-4938-489d-8b0d-894367b4dbd8 tempest-ServerRescueNegativeTestJSON-1881373000 None] Lock "cinder-942c8b1d-37ee-4563-8f00-dcd688eae50f-delete_volume" released by "delete_volume" :: held 1.718s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:47:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-60585370-5228-4f1d-b8f2-a5c23ddbbec4 tempest-GroupSnapshotsTest-1581907882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:47:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-60585370-5228-4f1d-b8f2-a5c23ddbbec4 tempest-GroupSnapshotsTest-1581907882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:47:45 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-60585370-5228-4f1d-b8f2-a5c23ddbbec4 tempest-GroupSnapshotsTest-1581907882 None] Acquiring lock "cinder-quobyte-e0dd763f-0983-4fab-9ce2-70f3f8b3359a-e42db5d6-8866-4538-ac4c-696d6454a0e0" by "_create_volume_from_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:47:45 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-60585370-5228-4f1d-b8f2-a5c23ddbbec4 tempest-GroupSnapshotsTest-1581907882 None] Lock "cinder-quobyte-e0dd763f-0983-4fab-9ce2-70f3f8b3359a-e42db5d6-8866-4538-ac4c-696d6454a0e0" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:47:45 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-60585370-5228-4f1d-b8f2-a5c23ddbbec4 tempest-GroupSnapshotsTest-1581907882 None] Creating volume e42db5d6-8866-4538-ac4c-696d6454a0e0 from snapshot e0dd763f-0983-4fab-9ce2-70f3f8b3359a {{(pid=87507) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 08 06:47:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-60585370-5228-4f1d-b8f2-a5c23ddbbec4 tempest-GroupSnapshotsTest-1581907882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:47:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-60585370-5228-4f1d-b8f2-a5c23ddbbec4 tempest-GroupSnapshotsTest-1581907882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:47:45 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-60585370-5228-4f1d-b8f2-a5c23ddbbec4 tempest-GroupSnapshotsTest-1581907882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:47:45 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-60585370-5228-4f1d-b8f2-a5c23ddbbec4 tempest-GroupSnapshotsTest-1581907882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:47:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-60585370-5228-4f1d-b8f2-a5c23ddbbec4 tempest-GroupSnapshotsTest-1581907882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:47:45 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-60585370-5228-4f1d-b8f2-a5c23ddbbec4 tempest-GroupSnapshotsTest-1581907882 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:47:45 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-60585370-5228-4f1d-b8f2-a5c23ddbbec4 tempest-GroupSnapshotsTest-1581907882 None] Acquiring lock "cinder-quobyte-e42db5d6-8866-4538-ac4c-696d6454a0e0" by "_copy_volume_from_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:47:45 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-60585370-5228-4f1d-b8f2-a5c23ddbbec4 tempest-GroupSnapshotsTest-1581907882 None] Lock "cinder-quobyte-e42db5d6-8866-4538-ac4c-696d6454a0e0" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:47:45 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-60585370-5228-4f1d-b8f2-a5c23ddbbec4 tempest-GroupSnapshotsTest-1581907882 None] snapshot: e0dd763f-0983-4fab-9ce2-70f3f8b3359a, volume: e42db5d6-8866-4538-ac4c-696d6454a0e0, {{(pid=87507) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 08 06:47:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-60585370-5228-4f1d-b8f2-a5c23ddbbec4 tempest-GroupSnapshotsTest-1581907882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:47:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-60585370-5228-4f1d-b8f2-a5c23ddbbec4 tempest-GroupSnapshotsTest-1581907882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:47:45 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-60585370-5228-4f1d-b8f2-a5c23ddbbec4 tempest-GroupSnapshotsTest-1581907882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:47:45 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-60585370-5228-4f1d-b8f2-a5c23ddbbec4 tempest-GroupSnapshotsTest-1581907882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:47:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-60585370-5228-4f1d-b8f2-a5c23ddbbec4 tempest-GroupSnapshotsTest-1581907882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:47:45 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee58cc3d-73e2-4fc7-94da-bf91e8410c46]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:47:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-60585370-5228-4f1d-b8f2-a5c23ddbbec4 tempest-GroupSnapshotsTest-1581907882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dd8b16d3-91bb-44ca-bb99-088db965c710.e0dd763f-0983-4fab-9ce2-70f3f8b3359a {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:47:45 devstack sudo[95599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dd8b16d3-91bb-44ca-bb99-088db965c710.e0dd763f-0983-4fab-9ce2-70f3f8b3359a Sep 08 06:47:45 devstack sudo[95599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:47:46 devstack sudo[95599]: pam_unix(sudo:session): session closed for user root Sep 08 06:47:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-60585370-5228-4f1d-b8f2-a5c23ddbbec4 tempest-GroupSnapshotsTest-1581907882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dd8b16d3-91bb-44ca-bb99-088db965c710.e0dd763f-0983-4fab-9ce2-70f3f8b3359a" returned: 0 in 0.711s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:47:46 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-60585370-5228-4f1d-b8f2-a5c23ddbbec4 tempest-GroupSnapshotsTest-1581907882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd8b16d3-91bb-44ca-bb99-088db965c710(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 06:47:46 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbeb28a-89e1-48a7-a83b-05d0b5a7fb09]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:47:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-60585370-5228-4f1d-b8f2-a5c23ddbbec4 tempest-GroupSnapshotsTest-1581907882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dd8b16d3-91bb-44ca-bb99-088db965c710 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:47:46 devstack sudo[95605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dd8b16d3-91bb-44ca-bb99-088db965c710 Sep 08 06:47:46 devstack sudo[95605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:47:46 devstack sudo[95605]: pam_unix(sudo:session): session closed for user root Sep 08 06:47:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-60585370-5228-4f1d-b8f2-a5c23ddbbec4 tempest-GroupSnapshotsTest-1581907882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dd8b16d3-91bb-44ca-bb99-088db965c710" returned: 0 in 0.564s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:47:46 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-60585370-5228-4f1d-b8f2-a5c23ddbbec4 tempest-GroupSnapshotsTest-1581907882 None] will copy from snapshot at /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dd8b16d3-91bb-44ca-bb99-088db965c710 {{(pid=87507) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 08 06:47:46 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-60585370-5228-4f1d-b8f2-a5c23ddbbec4 tempest-GroupSnapshotsTest-1581907882 None] Creating direct copy from snapshot {{(pid=87507) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 08 06:47:46 devstack cinder-volume[87507]: DEBUG cinder.utils [None req-60585370-5228-4f1d-b8f2-a5c23ddbbec4 tempest-GroupSnapshotsTest-1581907882 None] Path /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e42db5d6-8866-4538-ac4c-696d6454a0e0 not found in is_blk_device check {{(pid=87507) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 08 06:47:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-60585370-5228-4f1d-b8f2-a5c23ddbbec4 tempest-GroupSnapshotsTest-1581907882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dd8b16d3-91bb-44ca-bb99-088db965c710 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e42db5d6-8866-4538-ac4c-696d6454a0e0 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:47:46 devstack sudo[95611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dd8b16d3-91bb-44ca-bb99-088db965c710 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e42db5d6-8866-4538-ac4c-696d6454a0e0 Sep 08 06:47:46 devstack sudo[95611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:47:50 devstack cinder-volume[87507]: INFO cinder.volume.manager [req-676241c8-de1d-4ce7-b9b1-9f372b111d10 req-58373195-fd47-4284-aeb9-ff055bd232b8 tempest-AttachVolumeTestJSON-921065048 None] Terminate volume connection completed successfully. Sep 08 06:47:50 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-676241c8-de1d-4ce7-b9b1-9f372b111d10 req-58373195-fd47-4284-aeb9-ff055bd232b8 tempest-AttachVolumeTestJSON-921065048 None] Deleting attachment 01cb60ce-0bd2-49bb-adf7-aa7e3a539425. {{(pid=87507) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 06:47:53 devstack sudo[95611]: pam_unix(sudo:session): session closed for user root Sep 08 06:47:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-60585370-5228-4f1d-b8f2-a5c23ddbbec4 tempest-GroupSnapshotsTest-1581907882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dd8b16d3-91bb-44ca-bb99-088db965c710 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e42db5d6-8866-4538-ac4c-696d6454a0e0" returned: 0 in 7.142s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:47:53 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-60585370-5228-4f1d-b8f2-a5c23ddbbec4 tempest-GroupSnapshotsTest-1581907882 None] Image conversion details: src /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dd8b16d3-91bb-44ca-bb99-088db965c710, size 1024.00 MB, duration 7.14 sec, destination /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e42db5d6-8866-4538-ac4c-696d6454a0e0 {{(pid=87507) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 06:47:53 devstack cinder-volume[87507]: INFO cinder.image.image_utils [None req-60585370-5228-4f1d-b8f2-a5c23ddbbec4 tempest-GroupSnapshotsTest-1581907882 None] Converted 1024.00 MB image at 143.32 MB/s Sep 08 06:47:53 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-60585370-5228-4f1d-b8f2-a5c23ddbbec4 tempest-GroupSnapshotsTest-1581907882 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e42db5d6-8866-4538-ac4c-696d6454a0e0 is being set with open permissions: ugo+rw: NotImplementedError Sep 08 06:47:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-60585370-5228-4f1d-b8f2-a5c23ddbbec4 tempest-GroupSnapshotsTest-1581907882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e42db5d6-8866-4538-ac4c-696d6454a0e0 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:47:53 devstack sudo[95659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e42db5d6-8866-4538-ac4c-696d6454a0e0 Sep 08 06:47:53 devstack sudo[95659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:47:54 devstack sudo[95659]: pam_unix(sudo:session): session closed for user root Sep 08 06:47:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-60585370-5228-4f1d-b8f2-a5c23ddbbec4 tempest-GroupSnapshotsTest-1581907882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e42db5d6-8866-4538-ac4c-696d6454a0e0" returned: 0 in 0.270s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:47:54 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-60585370-5228-4f1d-b8f2-a5c23ddbbec4 tempest-GroupSnapshotsTest-1581907882 None] Lock "cinder-quobyte-e42db5d6-8866-4538-ac4c-696d6454a0e0" released by "_copy_volume_from_snapshot" :: held 8.855s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:47:54 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-60585370-5228-4f1d-b8f2-a5c23ddbbec4 tempest-GroupSnapshotsTest-1581907882 None] Lock "cinder-quobyte-e0dd763f-0983-4fab-9ce2-70f3f8b3359a-e42db5d6-8866-4538-ac4c-696d6454a0e0" released by "_create_volume_from_snapshot" :: held 8.968s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:47:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-60585370-5228-4f1d-b8f2-a5c23ddbbec4 tempest-GroupSnapshotsTest-1581907882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.990s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:47:54 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-60585370-5228-4f1d-b8f2-a5c23ddbbec4 tempest-GroupSnapshotsTest-1581907882 None] Create group from source-snapshot-2ec8656d-2a86-481c-bff0-3d48077b79d2 completed successfully. Sep 08 06:47:54 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-137265fa-e79e-4508-90b7-817f14540059 tempest-GroupSnapshotsTest-1581907882 None] Acquiring lock "cinder-quobyte-e42db5d6-8866-4538-ac4c-696d6454a0e0" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:47:55 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-137265fa-e79e-4508-90b7-817f14540059 tempest-GroupSnapshotsTest-1581907882 None] Lock "cinder-quobyte-e42db5d6-8866-4538-ac4c-696d6454a0e0" acquired by "delete_volume" :: waited 0.019s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:47:55 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a9cd23-9717-4621-94de-dc431c9d72f0]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:47:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-137265fa-e79e-4508-90b7-817f14540059 tempest-GroupSnapshotsTest-1581907882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e42db5d6-8866-4538-ac4c-696d6454a0e0 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:47:55 devstack sudo[95662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e42db5d6-8866-4538-ac4c-696d6454a0e0 Sep 08 06:47:55 devstack sudo[95662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:47:55 devstack sudo[95662]: pam_unix(sudo:session): session closed for user root Sep 08 06:47:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-137265fa-e79e-4508-90b7-817f14540059 tempest-GroupSnapshotsTest-1581907882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e42db5d6-8866-4538-ac4c-696d6454a0e0" returned: 0 in 0.425s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:47:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-137265fa-e79e-4508-90b7-817f14540059 tempest-GroupSnapshotsTest-1581907882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e42db5d6-8866-4538-ac4c-696d6454a0e0 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:47:55 devstack sudo[95668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e42db5d6-8866-4538-ac4c-696d6454a0e0 Sep 08 06:47:55 devstack sudo[95668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:47:55 devstack sudo[95668]: pam_unix(sudo:session): session closed for user root Sep 08 06:47:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-137265fa-e79e-4508-90b7-817f14540059 tempest-GroupSnapshotsTest-1581907882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e42db5d6-8866-4538-ac4c-696d6454a0e0" returned: 0 in 0.262s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:47:55 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-137265fa-e79e-4508-90b7-817f14540059 tempest-GroupSnapshotsTest-1581907882 None] Lock "cinder-quobyte-e42db5d6-8866-4538-ac4c-696d6454a0e0" released by "delete_volume" :: held 0.743s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:47:55 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-137265fa-e79e-4508-90b7-817f14540059 tempest-GroupSnapshotsTest-1581907882 None] Created reservations ['8af59c08-554c-42b3-93d4-8429861183ae'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:47:55 devstack cinder-volume[87507]: WARNING cinder.quota [None req-137265fa-e79e-4508-90b7-817f14540059 tempest-GroupSnapshotsTest-1581907882 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1785969789 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1785969789, it is now deprecated. Please use the default quota class for default quota. Sep 08 06:47:55 devstack cinder-volume[87507]: WARNING cinder.quota [None req-137265fa-e79e-4508-90b7-817f14540059 tempest-GroupSnapshotsTest-1581907882 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1785969789 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1785969789, it is now deprecated. Please use the default quota class for default quota. Sep 08 06:47:55 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-137265fa-e79e-4508-90b7-817f14540059 tempest-GroupSnapshotsTest-1581907882 None] Created reservations ['637b1274-7a29-4e40-a11d-265272c32f6e', 'e70b6b99-c4bc-42cd-8608-6b152d4a9c1f', '3dd4e1f6-0496-4679-9442-a4eae4bad715', '3166603e-86b4-4a73-a624-17c5be5fbca7'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:47:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-137265fa-e79e-4508-90b7-817f14540059 tempest-GroupSnapshotsTest-1581907882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:47:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-137265fa-e79e-4508-90b7-817f14540059 tempest-GroupSnapshotsTest-1581907882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:47:56 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-137265fa-e79e-4508-90b7-817f14540059 tempest-GroupSnapshotsTest-1581907882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:47:56 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-137265fa-e79e-4508-90b7-817f14540059 tempest-GroupSnapshotsTest-1581907882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:47:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-137265fa-e79e-4508-90b7-817f14540059 tempest-GroupSnapshotsTest-1581907882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:47:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-137265fa-e79e-4508-90b7-817f14540059 tempest-GroupSnapshotsTest-1581907882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:47:56 devstack sudo[95672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:47:56 devstack sudo[95672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:47:56 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-56041a35-d9b5-413e-bb99-2e39c82f832d tempest-GroupSnapshotsTest-1581907882 None] group_snapshot 2ec8656d-2a86-481c-bff0-3d48077b79d2: deleting Sep 08 06:47:56 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-56041a35-d9b5-413e-bb99-2e39c82f832d tempest-GroupSnapshotsTest-1581907882 None] group_snapshot 2ec8656d-2a86-481c-bff0-3d48077b79d2: deleting {{(pid=87507) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 08 06:47:56 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-56041a35-d9b5-413e-bb99-2e39c82f832d tempest-GroupSnapshotsTest-1581907882 None] Acquiring lock "cinder-quobyte-dd8b16d3-91bb-44ca-bb99-088db965c710" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:47:56 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-56041a35-d9b5-413e-bb99-2e39c82f832d tempest-GroupSnapshotsTest-1581907882 None] Lock "cinder-quobyte-dd8b16d3-91bb-44ca-bb99-088db965c710" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:47:56 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-56041a35-d9b5-413e-bb99-2e39c82f832d tempest-GroupSnapshotsTest-1581907882 None] Acquiring lock "cinder-quobyte-e0dd763f-0983-4fab-9ce2-70f3f8b3359a" by "_delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:47:56 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-56041a35-d9b5-413e-bb99-2e39c82f832d tempest-GroupSnapshotsTest-1581907882 None] Lock "cinder-quobyte-e0dd763f-0983-4fab-9ce2-70f3f8b3359a" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:47:56 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-56041a35-d9b5-413e-bb99-2e39c82f832d tempest-GroupSnapshotsTest-1581907882 None] Deleting offline snapshot e0dd763f-0983-4fab-9ce2-70f3f8b3359a of volume dd8b16d3-91bb-44ca-bb99-088db965c710 {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 06:47:56 devstack sudo[95672]: pam_unix(sudo:session): session closed for user root Sep 08 06:47:56 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-56041a35-d9b5-413e-bb99-2e39c82f832d tempest-GroupSnapshotsTest-1581907882 None] snapshot_file for this snap is: volume-dd8b16d3-91bb-44ca-bb99-088db965c710.e0dd763f-0983-4fab-9ce2-70f3f8b3359a {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 06:47:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-137265fa-e79e-4508-90b7-817f14540059 tempest-GroupSnapshotsTest-1581907882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.435s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:47:56 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-137265fa-e79e-4508-90b7-817f14540059 tempest-GroupSnapshotsTest-1581907882 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:47:56 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-137265fa-e79e-4508-90b7-817f14540059 tempest-GroupSnapshotsTest-1581907882 None] Delete group completed successfully. Sep 08 06:47:56 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7408059b-e61f-4a1f-b724-756571bb01c4]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:47:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-56041a35-d9b5-413e-bb99-2e39c82f832d tempest-GroupSnapshotsTest-1581907882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dd8b16d3-91bb-44ca-bb99-088db965c710.e0dd763f-0983-4fab-9ce2-70f3f8b3359a {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:47:56 devstack sudo[95675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dd8b16d3-91bb-44ca-bb99-088db965c710.e0dd763f-0983-4fab-9ce2-70f3f8b3359a Sep 08 06:47:56 devstack sudo[95675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:47:56 devstack sudo[95675]: pam_unix(sudo:session): session closed for user root Sep 08 06:47:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-56041a35-d9b5-413e-bb99-2e39c82f832d tempest-GroupSnapshotsTest-1581907882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dd8b16d3-91bb-44ca-bb99-088db965c710.e0dd763f-0983-4fab-9ce2-70f3f8b3359a" returned: 0 in 0.507s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:47:57 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-56041a35-d9b5-413e-bb99-2e39c82f832d tempest-GroupSnapshotsTest-1581907882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd8b16d3-91bb-44ca-bb99-088db965c710(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 06:47:57 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff3f186-a87c-4347-bc2e-d9b33f858f70]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:47:57 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-56041a35-d9b5-413e-bb99-2e39c82f832d tempest-GroupSnapshotsTest-1581907882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dd8b16d3-91bb-44ca-bb99-088db965c710 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:47:57 devstack sudo[95681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dd8b16d3-91bb-44ca-bb99-088db965c710 Sep 08 06:47:57 devstack sudo[95681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:47:57 devstack sudo[95681]: pam_unix(sudo:session): session closed for user root Sep 08 06:47:57 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-56041a35-d9b5-413e-bb99-2e39c82f832d tempest-GroupSnapshotsTest-1581907882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dd8b16d3-91bb-44ca-bb99-088db965c710" returned: 0 in 0.659s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:47:57 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-56041a35-d9b5-413e-bb99-2e39c82f832d tempest-GroupSnapshotsTest-1581907882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dd8b16d3-91bb-44ca-bb99-088db965c710.e0dd763f-0983-4fab-9ce2-70f3f8b3359a {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:47:57 devstack sudo[95686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dd8b16d3-91bb-44ca-bb99-088db965c710.e0dd763f-0983-4fab-9ce2-70f3f8b3359a Sep 08 06:47:57 devstack sudo[95686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:47:58 devstack sudo[95686]: pam_unix(sudo:session): session closed for user root Sep 08 06:47:58 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-56041a35-d9b5-413e-bb99-2e39c82f832d tempest-GroupSnapshotsTest-1581907882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dd8b16d3-91bb-44ca-bb99-088db965c710.e0dd763f-0983-4fab-9ce2-70f3f8b3359a" returned: 0 in 0.415s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:47:58 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-56041a35-d9b5-413e-bb99-2e39c82f832d tempest-GroupSnapshotsTest-1581907882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dd8b16d3-91bb-44ca-bb99-088db965c710.e0dd763f-0983-4fab-9ce2-70f3f8b3359a {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:47:58 devstack sudo[95694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dd8b16d3-91bb-44ca-bb99-088db965c710.e0dd763f-0983-4fab-9ce2-70f3f8b3359a Sep 08 06:47:58 devstack sudo[95694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:47:58 devstack sudo[95694]: pam_unix(sudo:session): session closed for user root Sep 08 06:47:58 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-56041a35-d9b5-413e-bb99-2e39c82f832d tempest-GroupSnapshotsTest-1581907882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dd8b16d3-91bb-44ca-bb99-088db965c710.e0dd763f-0983-4fab-9ce2-70f3f8b3359a" returned: 0 in 0.262s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:47:58 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-56041a35-d9b5-413e-bb99-2e39c82f832d tempest-GroupSnapshotsTest-1581907882 None] Lock "cinder-quobyte-e0dd763f-0983-4fab-9ce2-70f3f8b3359a" released by "_delete_snapshot" :: held 2.004s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:47:58 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-56041a35-d9b5-413e-bb99-2e39c82f832d tempest-GroupSnapshotsTest-1581907882 None] Lock "cinder-quobyte-dd8b16d3-91bb-44ca-bb99-088db965c710" released by "delete_snapshot" :: held 2.035s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:47:58 devstack cinder-volume[87507]: WARNING cinder.quota [None req-56041a35-d9b5-413e-bb99-2e39c82f832d tempest-GroupSnapshotsTest-1581907882 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1785969789 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1785969789, it is now deprecated. Please use the default quota class for default quota. Sep 08 06:47:58 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-56041a35-d9b5-413e-bb99-2e39c82f832d tempest-GroupSnapshotsTest-1581907882 None] Created reservations ['6e299ff9-3660-405b-be4f-4d2adebf2432', 'd6ba8520-ef3a-4ccb-97a5-f640583b0219', 'c320c600-2112-42fc-85fd-eeac55468fa8', '1f289f30-5927-4a79-a9fe-f8bc3f305ec1'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:47:58 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-56041a35-d9b5-413e-bb99-2e39c82f832d tempest-GroupSnapshotsTest-1581907882 None] group_snapshot 2ec8656d-2a86-481c-bff0-3d48077b79d2: deleted successfully Sep 08 06:47:59 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-71a3d806-ed23-43f6-b3dd-9a4080f2e1b8 tempest-GroupSnapshotsTest-1581907882 None] Acquiring lock "cinder-quobyte-dd8b16d3-91bb-44ca-bb99-088db965c710" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:47:59 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-71a3d806-ed23-43f6-b3dd-9a4080f2e1b8 tempest-GroupSnapshotsTest-1581907882 None] Lock "cinder-quobyte-dd8b16d3-91bb-44ca-bb99-088db965c710" acquired by "delete_volume" :: waited 0.023s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:47:59 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1213f5-80eb-4c4d-b4db-d2b7ab271018]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:47:59 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-71a3d806-ed23-43f6-b3dd-9a4080f2e1b8 tempest-GroupSnapshotsTest-1581907882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dd8b16d3-91bb-44ca-bb99-088db965c710 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:47:59 devstack sudo[95698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dd8b16d3-91bb-44ca-bb99-088db965c710 Sep 08 06:47:59 devstack sudo[95698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:47:59 devstack sudo[95698]: pam_unix(sudo:session): session closed for user root Sep 08 06:47:59 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-71a3d806-ed23-43f6-b3dd-9a4080f2e1b8 tempest-GroupSnapshotsTest-1581907882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dd8b16d3-91bb-44ca-bb99-088db965c710" returned: 0 in 0.451s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:47:59 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-71a3d806-ed23-43f6-b3dd-9a4080f2e1b8 tempest-GroupSnapshotsTest-1581907882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dd8b16d3-91bb-44ca-bb99-088db965c710 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:47:59 devstack sudo[95703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dd8b16d3-91bb-44ca-bb99-088db965c710 Sep 08 06:47:59 devstack sudo[95703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:47:59 devstack sudo[95703]: pam_unix(sudo:session): session closed for user root Sep 08 06:47:59 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-71a3d806-ed23-43f6-b3dd-9a4080f2e1b8 tempest-GroupSnapshotsTest-1581907882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dd8b16d3-91bb-44ca-bb99-088db965c710" returned: 0 in 0.303s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:47:59 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-71a3d806-ed23-43f6-b3dd-9a4080f2e1b8 tempest-GroupSnapshotsTest-1581907882 None] Lock "cinder-quobyte-dd8b16d3-91bb-44ca-bb99-088db965c710" released by "delete_volume" :: held 0.840s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:48:00 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-71a3d806-ed23-43f6-b3dd-9a4080f2e1b8 tempest-GroupSnapshotsTest-1581907882 None] Created reservations ['a4c28206-278f-4487-b9df-cfefb959b163'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:48:00 devstack cinder-volume[87507]: WARNING cinder.db.api [None req-71a3d806-ed23-43f6-b3dd-9a4080f2e1b8 tempest-GroupSnapshotsTest-1581907882 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1785969789'] Sep 08 06:48:00 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-71a3d806-ed23-43f6-b3dd-9a4080f2e1b8 tempest-GroupSnapshotsTest-1581907882 None] Created reservations ['bcce526e-8717-42bb-b80f-e6ef3de4ab1b', 'f660a46a-941f-48ca-9636-0ffde2d9b38b', '2eb41e32-22f4-4dbf-895f-d5fa21446d5a', 'f4801e44-a54c-4170-a232-e6bde5525382'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:48:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-71a3d806-ed23-43f6-b3dd-9a4080f2e1b8 tempest-GroupSnapshotsTest-1581907882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:48:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-71a3d806-ed23-43f6-b3dd-9a4080f2e1b8 tempest-GroupSnapshotsTest-1581907882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:48:00 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-71a3d806-ed23-43f6-b3dd-9a4080f2e1b8 tempest-GroupSnapshotsTest-1581907882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:48:00 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-71a3d806-ed23-43f6-b3dd-9a4080f2e1b8 tempest-GroupSnapshotsTest-1581907882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:48:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-71a3d806-ed23-43f6-b3dd-9a4080f2e1b8 tempest-GroupSnapshotsTest-1581907882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:48:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-71a3d806-ed23-43f6-b3dd-9a4080f2e1b8 tempest-GroupSnapshotsTest-1581907882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:48:00 devstack sudo[95706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:48:00 devstack sudo[95706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:48:00 devstack sudo[95706]: pam_unix(sudo:session): session closed for user root Sep 08 06:48:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-71a3d806-ed23-43f6-b3dd-9a4080f2e1b8 tempest-GroupSnapshotsTest-1581907882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.378s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:48:00 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-71a3d806-ed23-43f6-b3dd-9a4080f2e1b8 tempest-GroupSnapshotsTest-1581907882 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:48:00 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-71a3d806-ed23-43f6-b3dd-9a4080f2e1b8 tempest-GroupSnapshotsTest-1581907882 None] Delete group completed successfully. Sep 08 06:48:01 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-59206df3-6b40-4e8c-af73-452108f88146 tempest-GroupSnapshotsTest-1581907882 None] Group tempest-GroupSnapshotsTest-Group-1625440342: creating Sep 08 06:48:01 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-59206df3-6b40-4e8c-af73-452108f88146 tempest-GroupSnapshotsTest-1581907882 None] Group tempest-GroupSnapshotsTest-Group-1625440342: created successfully Sep 08 06:48:01 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-59206df3-6b40-4e8c-af73-452108f88146 tempest-GroupSnapshotsTest-1581907882 None] Create group completed successfully. Sep 08 06:48:03 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1e67a95-3df3-41d4-ac02-d1f3e5293571 tempest-GroupSnapshotsTest-1581907882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:48:03 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-c1e67a95-3df3-41d4-ac02-d1f3e5293571 tempest-GroupSnapshotsTest-1581907882 None] Flow 'volume_create_manager' (1374cf7b-67aa-4059-bb1c-443a09301122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:48:03 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-c1e67a95-3df3-41d4-ac02-d1f3e5293571 tempest-GroupSnapshotsTest-1581907882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (359e63aa-d209-45f1-9c25-970331a2618e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:48:03 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-c1e67a95-3df3-41d4-ac02-d1f3e5293571 tempest-GroupSnapshotsTest-1581907882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (359e63aa-d209-45f1-9c25-970331a2618e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:48:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-193654916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=05d4e004-4f81-4949-b9c6-e91f23935a16,host='devstack@QuobyteHD#QuobyteHD',id=4252fa60-d14b-4548-a242-7eb67105a4c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b968bdc7dff4a92ba2e67485c6e29c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:48:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:48:03Z,use_quota=True,user_id='659c95d7250a4fadb3b8dacbb72d4b5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5112f578-442c-4483-9b61-14ca3f91b4e3),volume_type_id=5112f578-442c-4483-9b61-14ca3f91b4e3)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:48:03 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-c1e67a95-3df3-41d4-ac02-d1f3e5293571 tempest-GroupSnapshotsTest-1581907882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15499151-1007-4f9e-ab37-20bf17b7c6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:48:03 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-c1e67a95-3df3-41d4-ac02-d1f3e5293571 tempest-GroupSnapshotsTest-1581907882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15499151-1007-4f9e-ab37-20bf17b7c6b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:48:03 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-c1e67a95-3df3-41d4-ac02-d1f3e5293571 tempest-GroupSnapshotsTest-1581907882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd482517-c40c-40aa-bff2-c13c80a75eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:48:03 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-c1e67a95-3df3-41d4-ac02-d1f3e5293571 tempest-GroupSnapshotsTest-1581907882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd482517-c40c-40aa-bff2-c13c80a75eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4252fa60-d14b-4548-a242-7eb67105a4c8', 'volume_name': 'volume-4252fa60-d14b-4548-a242-7eb67105a4c8', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:48:03 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-c1e67a95-3df3-41d4-ac02-d1f3e5293571 tempest-GroupSnapshotsTest-1581907882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (523f1430-ed38-4ebd-beb0-6c70665a6a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:48:03 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-c1e67a95-3df3-41d4-ac02-d1f3e5293571 tempest-GroupSnapshotsTest-1581907882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (523f1430-ed38-4ebd-beb0-6c70665a6a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:48:03 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-c1e67a95-3df3-41d4-ac02-d1f3e5293571 tempest-GroupSnapshotsTest-1581907882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22868a1f-88d9-438e-bf16-8af72ec83448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:48:03 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-c1e67a95-3df3-41d4-ac02-d1f3e5293571 tempest-GroupSnapshotsTest-1581907882 None] Volume 4252fa60-d14b-4548-a242-7eb67105a4c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4252fa60-d14b-4548-a242-7eb67105a4c8', 'volume_size': 1} Sep 08 06:48:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-c1e67a95-3df3-41d4-ac02-d1f3e5293571 tempest-GroupSnapshotsTest-1581907882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:48:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-c1e67a95-3df3-41d4-ac02-d1f3e5293571 tempest-GroupSnapshotsTest-1581907882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:48:03 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-c1e67a95-3df3-41d4-ac02-d1f3e5293571 tempest-GroupSnapshotsTest-1581907882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=05d4e004-4f81-4949-b9c6-e91f23935a16,created_at=2026-09-08T04:48:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-193654916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=05d4e004-4f81-4949-b9c6-e91f23935a16,host='devstack@QuobyteHD#QuobyteHD',id=4252fa60-d14b-4548-a242-7eb67105a4c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b968bdc7dff4a92ba2e67485c6e29c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:48:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:48:03Z,use_quota=True,user_id='659c95d7250a4fadb3b8dacbb72d4b5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5112f578-442c-4483-9b61-14ca3f91b4e3),volume_type_id=5112f578-442c-4483-9b61-14ca3f91b4e3)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:48:03 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-c1e67a95-3df3-41d4-ac02-d1f3e5293571 tempest-GroupSnapshotsTest-1581907882 None] Creating volume 4252fa60-d14b-4548-a242-7eb67105a4c8 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:48:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-c1e67a95-3df3-41d4-ac02-d1f3e5293571 tempest-GroupSnapshotsTest-1581907882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:48:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-c1e67a95-3df3-41d4-ac02-d1f3e5293571 tempest-GroupSnapshotsTest-1581907882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:48:03 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-c1e67a95-3df3-41d4-ac02-d1f3e5293571 tempest-GroupSnapshotsTest-1581907882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:48:03 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-c1e67a95-3df3-41d4-ac02-d1f3e5293571 tempest-GroupSnapshotsTest-1581907882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:48:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-c1e67a95-3df3-41d4-ac02-d1f3e5293571 tempest-GroupSnapshotsTest-1581907882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:48:03 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-c1e67a95-3df3-41d4-ac02-d1f3e5293571 tempest-GroupSnapshotsTest-1581907882 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:48:03 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-c1e67a95-3df3-41d4-ac02-d1f3e5293571 tempest-GroupSnapshotsTest-1581907882 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:48:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-c1e67a95-3df3-41d4-ac02-d1f3e5293571 tempest-GroupSnapshotsTest-1581907882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4252fa60-d14b-4548-a242-7eb67105a4c8 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:48:03 devstack sudo[95803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4252fa60-d14b-4548-a242-7eb67105a4c8 1073741824 Sep 08 06:48:03 devstack sudo[95803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:48:04 devstack sudo[95803]: pam_unix(sudo:session): session closed for user root Sep 08 06:48:04 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-c1e67a95-3df3-41d4-ac02-d1f3e5293571 tempest-GroupSnapshotsTest-1581907882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4252fa60-d14b-4548-a242-7eb67105a4c8 1073741824" returned: 0 in 1.007s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:48:04 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-c1e67a95-3df3-41d4-ac02-d1f3e5293571 tempest-GroupSnapshotsTest-1581907882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4252fa60-d14b-4548-a242-7eb67105a4c8 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:48:04 devstack sudo[95829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4252fa60-d14b-4548-a242-7eb67105a4c8 Sep 08 06:48:04 devstack sudo[95829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:48:05 devstack sudo[95829]: pam_unix(sudo:session): session closed for user root Sep 08 06:48:05 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-c1e67a95-3df3-41d4-ac02-d1f3e5293571 tempest-GroupSnapshotsTest-1581907882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4252fa60-d14b-4548-a242-7eb67105a4c8" returned: 0 in 0.622s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:48:05 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-c1e67a95-3df3-41d4-ac02-d1f3e5293571 tempest-GroupSnapshotsTest-1581907882 None] <== create_volume: return (1785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:48:05 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-c1e67a95-3df3-41d4-ac02-d1f3e5293571 tempest-GroupSnapshotsTest-1581907882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.788s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:48:05 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-c1e67a95-3df3-41d4-ac02-d1f3e5293571 tempest-GroupSnapshotsTest-1581907882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22868a1f-88d9-438e-bf16-8af72ec83448) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4252fa60-d14b-4548-a242-7eb67105a4c8', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:48:05 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-c1e67a95-3df3-41d4-ac02-d1f3e5293571 tempest-GroupSnapshotsTest-1581907882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c3a1dd5-0923-4d88-9868-418af1e078ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:48:05 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-c1e67a95-3df3-41d4-ac02-d1f3e5293571 tempest-GroupSnapshotsTest-1581907882 None] Volume volume-4252fa60-d14b-4548-a242-7eb67105a4c8 (4252fa60-d14b-4548-a242-7eb67105a4c8): created successfully Sep 08 06:48:05 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-c1e67a95-3df3-41d4-ac02-d1f3e5293571 tempest-GroupSnapshotsTest-1581907882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c3a1dd5-0923-4d88-9868-418af1e078ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:48:05 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-c1e67a95-3df3-41d4-ac02-d1f3e5293571 tempest-GroupSnapshotsTest-1581907882 None] Flow 'volume_create_manager' (1374cf7b-67aa-4059-bb1c-443a09301122) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:48:05 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-c1e67a95-3df3-41d4-ac02-d1f3e5293571 tempest-GroupSnapshotsTest-1581907882 None] Created volume successfully. Sep 08 06:48:07 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-1858e37a-9c01-4b1c-af33-6a76511294bb tempest-GroupSnapshotsTest-1581907882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:48:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1858e37a-9c01-4b1c-af33-6a76511294bb tempest-GroupSnapshotsTest-1581907882 None] Flow 'volume_create_manager' (7060c3ff-346b-4fb5-93eb-ab0edf51fc83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:48:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1858e37a-9c01-4b1c-af33-6a76511294bb tempest-GroupSnapshotsTest-1581907882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64ff3014-445d-43de-8e63-5a1c4bd60556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:48:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1858e37a-9c01-4b1c-af33-6a76511294bb tempest-GroupSnapshotsTest-1581907882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64ff3014-445d-43de-8e63-5a1c4bd60556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:48:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2083816738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=05d4e004-4f81-4949-b9c6-e91f23935a16,host='devstack@QuobyteHD#QuobyteHD',id=312c6e8f-673e-41d0-b299-2a72fadf0d7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b968bdc7dff4a92ba2e67485c6e29c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:48:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:48:07Z,use_quota=True,user_id='659c95d7250a4fadb3b8dacbb72d4b5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5112f578-442c-4483-9b61-14ca3f91b4e3),volume_type_id=5112f578-442c-4483-9b61-14ca3f91b4e3)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:48:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1858e37a-9c01-4b1c-af33-6a76511294bb tempest-GroupSnapshotsTest-1581907882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9658bfeb-dc15-40c0-b67a-4954215acb01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:48:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1858e37a-9c01-4b1c-af33-6a76511294bb tempest-GroupSnapshotsTest-1581907882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9658bfeb-dc15-40c0-b67a-4954215acb01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:48:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1858e37a-9c01-4b1c-af33-6a76511294bb tempest-GroupSnapshotsTest-1581907882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37ba0911-db15-42eb-aedd-571a409ba9e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:48:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1858e37a-9c01-4b1c-af33-6a76511294bb tempest-GroupSnapshotsTest-1581907882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37ba0911-db15-42eb-aedd-571a409ba9e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '312c6e8f-673e-41d0-b299-2a72fadf0d7f', 'volume_name': 'volume-312c6e8f-673e-41d0-b299-2a72fadf0d7f', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:48:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1858e37a-9c01-4b1c-af33-6a76511294bb tempest-GroupSnapshotsTest-1581907882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb5c9fdd-31fa-4e0f-9728-200adbd6fd66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:48:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1858e37a-9c01-4b1c-af33-6a76511294bb tempest-GroupSnapshotsTest-1581907882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb5c9fdd-31fa-4e0f-9728-200adbd6fd66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:48:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1858e37a-9c01-4b1c-af33-6a76511294bb tempest-GroupSnapshotsTest-1581907882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0da136f6-b1c1-4e18-8935-bacd097b72f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:48:07 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-1858e37a-9c01-4b1c-af33-6a76511294bb tempest-GroupSnapshotsTest-1581907882 None] Volume 312c6e8f-673e-41d0-b299-2a72fadf0d7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-312c6e8f-673e-41d0-b299-2a72fadf0d7f', 'volume_size': 1} Sep 08 06:48:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-1858e37a-9c01-4b1c-af33-6a76511294bb tempest-GroupSnapshotsTest-1581907882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:48:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-1858e37a-9c01-4b1c-af33-6a76511294bb tempest-GroupSnapshotsTest-1581907882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:48:07 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-1858e37a-9c01-4b1c-af33-6a76511294bb tempest-GroupSnapshotsTest-1581907882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=05d4e004-4f81-4949-b9c6-e91f23935a16,created_at=2026-09-08T04:48:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2083816738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=05d4e004-4f81-4949-b9c6-e91f23935a16,host='devstack@QuobyteHD#QuobyteHD',id=312c6e8f-673e-41d0-b299-2a72fadf0d7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b968bdc7dff4a92ba2e67485c6e29c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:48:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:48:07Z,use_quota=True,user_id='659c95d7250a4fadb3b8dacbb72d4b5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5112f578-442c-4483-9b61-14ca3f91b4e3),volume_type_id=5112f578-442c-4483-9b61-14ca3f91b4e3)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:48:07 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-1858e37a-9c01-4b1c-af33-6a76511294bb tempest-GroupSnapshotsTest-1581907882 None] Creating volume 312c6e8f-673e-41d0-b299-2a72fadf0d7f {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:48:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-1858e37a-9c01-4b1c-af33-6a76511294bb tempest-GroupSnapshotsTest-1581907882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:48:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-1858e37a-9c01-4b1c-af33-6a76511294bb tempest-GroupSnapshotsTest-1581907882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:48:07 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-1858e37a-9c01-4b1c-af33-6a76511294bb tempest-GroupSnapshotsTest-1581907882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:48:07 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-1858e37a-9c01-4b1c-af33-6a76511294bb tempest-GroupSnapshotsTest-1581907882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:48:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-1858e37a-9c01-4b1c-af33-6a76511294bb tempest-GroupSnapshotsTest-1581907882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:48:07 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-1858e37a-9c01-4b1c-af33-6a76511294bb tempest-GroupSnapshotsTest-1581907882 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:48:07 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-1858e37a-9c01-4b1c-af33-6a76511294bb tempest-GroupSnapshotsTest-1581907882 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:48:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1858e37a-9c01-4b1c-af33-6a76511294bb tempest-GroupSnapshotsTest-1581907882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-312c6e8f-673e-41d0-b299-2a72fadf0d7f 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:48:07 devstack sudo[95834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-312c6e8f-673e-41d0-b299-2a72fadf0d7f 1073741824 Sep 08 06:48:07 devstack sudo[95834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:48:07 devstack sudo[95834]: pam_unix(sudo:session): session closed for user root Sep 08 06:48:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1858e37a-9c01-4b1c-af33-6a76511294bb tempest-GroupSnapshotsTest-1581907882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-312c6e8f-673e-41d0-b299-2a72fadf0d7f 1073741824" returned: 0 in 0.529s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:48:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1858e37a-9c01-4b1c-af33-6a76511294bb tempest-GroupSnapshotsTest-1581907882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-312c6e8f-673e-41d0-b299-2a72fadf0d7f {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:48:07 devstack sudo[95841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-312c6e8f-673e-41d0-b299-2a72fadf0d7f Sep 08 06:48:07 devstack sudo[95841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:48:08 devstack sudo[95841]: pam_unix(sudo:session): session closed for user root Sep 08 06:48:08 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1858e37a-9c01-4b1c-af33-6a76511294bb tempest-GroupSnapshotsTest-1581907882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-312c6e8f-673e-41d0-b299-2a72fadf0d7f" returned: 0 in 0.359s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:48:08 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-1858e37a-9c01-4b1c-af33-6a76511294bb tempest-GroupSnapshotsTest-1581907882 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:48:08 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-1858e37a-9c01-4b1c-af33-6a76511294bb tempest-GroupSnapshotsTest-1581907882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:48:08 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1858e37a-9c01-4b1c-af33-6a76511294bb tempest-GroupSnapshotsTest-1581907882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0da136f6-b1c1-4e18-8935-bacd097b72f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-312c6e8f-673e-41d0-b299-2a72fadf0d7f', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:48:08 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1858e37a-9c01-4b1c-af33-6a76511294bb tempest-GroupSnapshotsTest-1581907882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d00ff35-af00-49c1-99f8-7938413c986f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:48:08 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-1858e37a-9c01-4b1c-af33-6a76511294bb tempest-GroupSnapshotsTest-1581907882 None] Volume volume-312c6e8f-673e-41d0-b299-2a72fadf0d7f (312c6e8f-673e-41d0-b299-2a72fadf0d7f): created successfully Sep 08 06:48:08 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1858e37a-9c01-4b1c-af33-6a76511294bb tempest-GroupSnapshotsTest-1581907882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d00ff35-af00-49c1-99f8-7938413c986f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:48:08 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1858e37a-9c01-4b1c-af33-6a76511294bb tempest-GroupSnapshotsTest-1581907882 None] Flow 'volume_create_manager' (7060c3ff-346b-4fb5-93eb-ab0edf51fc83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:48:08 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-1858e37a-9c01-4b1c-af33-6a76511294bb tempest-GroupSnapshotsTest-1581907882 None] Created volume successfully. Sep 08 06:48:08 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-5c565fe3-d40c-4cfa-b26e-b849664a461c tempest-GroupSnapshotsTest-1581907882 None] Update group completed successfully. Sep 08 06:48:09 devstack cinder-volume[87507]: DEBUG dbcounter [-] [87507] Writing DB stats cinder:SELECT=83,cinder:INSERT=20,cinder:UPDATE=96,cinder:DELETE=1 {{(pid=87507) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 06:48:09 devstack cinder-volume[87507]: DEBUG dbcounter [-] [87507] Writing DB stats cinder:SELECT=70,cinder:INSERT=21,cinder:UPDATE=78,cinder:DELETE=8 {{(pid=87507) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 06:48:10 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-9a509fc6-0187-4e54-b9f3-a91abd0abb36 tempest-GroupSnapshotsTest-1581907882 None] Update group completed successfully. Sep 08 06:48:11 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-95054310-a3d8-4442-a7b7-cce8beebf6be tempest-GroupSnapshotsTest-1581907882 None] Update group completed successfully. Sep 08 06:48:12 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-d35fecf0-5946-49b6-9844-e6b325ab791c tempest-GroupSnapshotsTest-1581907882 None] Update group completed successfully. Sep 08 06:48:15 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-107e84ff-83aa-4bd9-9896-af1f7a9515ae tempest-GroupSnapshotsTest-1581907882 None] GroupSnapshot 8278036b-112e-4462-95b6-ad63e4d7b544: creating. Sep 08 06:48:15 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-107e84ff-83aa-4bd9-9896-af1f7a9515ae tempest-GroupSnapshotsTest-1581907882 None] Group snapshot 8278036b-112e-4462-95b6-ad63e4d7b544: creating. {{(pid=87507) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 08 06:48:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-107e84ff-83aa-4bd9-9896-af1f7a9515ae tempest-GroupSnapshotsTest-1581907882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:48:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-107e84ff-83aa-4bd9-9896-af1f7a9515ae tempest-GroupSnapshotsTest-1581907882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:48:15 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-107e84ff-83aa-4bd9-9896-af1f7a9515ae tempest-GroupSnapshotsTest-1581907882 None] Creating offline snapshot 28c44d69-f002-4176-ad17-d4e598856b81 of volume 312c6e8f-673e-41d0-b299-2a72fadf0d7f {{(pid=87507) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 06:48:15 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3ce277-fd02-413e-b5d7-6a6e043b9942]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:48:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-107e84ff-83aa-4bd9-9896-af1f7a9515ae tempest-GroupSnapshotsTest-1581907882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-312c6e8f-673e-41d0-b299-2a72fadf0d7f {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:48:15 devstack sudo[95945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-312c6e8f-673e-41d0-b299-2a72fadf0d7f Sep 08 06:48:15 devstack sudo[95945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:48:15 devstack sudo[95945]: pam_unix(sudo:session): session closed for user root Sep 08 06:48:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-107e84ff-83aa-4bd9-9896-af1f7a9515ae tempest-GroupSnapshotsTest-1581907882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-312c6e8f-673e-41d0-b299-2a72fadf0d7f" returned: 0 in 0.729s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:48:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-107e84ff-83aa-4bd9-9896-af1f7a9515ae tempest-GroupSnapshotsTest-1581907882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-312c6e8f-673e-41d0-b299-2a72fadf0d7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-312c6e8f-673e-41d0-b299-2a72fadf0d7f.28c44d69-f002-4176-ad17-d4e598856b81 1G {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:48:16 devstack sudo[95953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-312c6e8f-673e-41d0-b299-2a72fadf0d7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-312c6e8f-673e-41d0-b299-2a72fadf0d7f.28c44d69-f002-4176-ad17-d4e598856b81 1G Sep 08 06:48:16 devstack sudo[95953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:48:17 devstack sudo[95953]: pam_unix(sudo:session): session closed for user root Sep 08 06:48:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-107e84ff-83aa-4bd9-9896-af1f7a9515ae tempest-GroupSnapshotsTest-1581907882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-312c6e8f-673e-41d0-b299-2a72fadf0d7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-312c6e8f-673e-41d0-b299-2a72fadf0d7f.28c44d69-f002-4176-ad17-d4e598856b81 1G" returned: 0 in 1.454s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:48:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-107e84ff-83aa-4bd9-9896-af1f7a9515ae tempest-GroupSnapshotsTest-1581907882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-312c6e8f-673e-41d0-b299-2a72fadf0d7f -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-312c6e8f-673e-41d0-b299-2a72fadf0d7f.28c44d69-f002-4176-ad17-d4e598856b81 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:48:17 devstack sudo[95997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-312c6e8f-673e-41d0-b299-2a72fadf0d7f -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-312c6e8f-673e-41d0-b299-2a72fadf0d7f.28c44d69-f002-4176-ad17-d4e598856b81 Sep 08 06:48:17 devstack sudo[95997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:48:18 devstack sudo[95997]: pam_unix(sudo:session): session closed for user root Sep 08 06:48:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-107e84ff-83aa-4bd9-9896-af1f7a9515ae tempest-GroupSnapshotsTest-1581907882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-312c6e8f-673e-41d0-b299-2a72fadf0d7f -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-312c6e8f-673e-41d0-b299-2a72fadf0d7f.28c44d69-f002-4176-ad17-d4e598856b81" returned: 0 in 0.684s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:48:18 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-107e84ff-83aa-4bd9-9896-af1f7a9515ae tempest-GroupSnapshotsTest-1581907882 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-312c6e8f-673e-41d0-b299-2a72fadf0d7f.28c44d69-f002-4176-ad17-d4e598856b81 is being set with open permissions: ugo+rw: NotImplementedError Sep 08 06:48:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-107e84ff-83aa-4bd9-9896-af1f7a9515ae tempest-GroupSnapshotsTest-1581907882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-312c6e8f-673e-41d0-b299-2a72fadf0d7f.28c44d69-f002-4176-ad17-d4e598856b81 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:48:18 devstack sudo[96004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-312c6e8f-673e-41d0-b299-2a72fadf0d7f.28c44d69-f002-4176-ad17-d4e598856b81 Sep 08 06:48:18 devstack sudo[96004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:48:18 devstack sudo[96004]: pam_unix(sudo:session): session closed for user root Sep 08 06:48:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-107e84ff-83aa-4bd9-9896-af1f7a9515ae tempest-GroupSnapshotsTest-1581907882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-312c6e8f-673e-41d0-b299-2a72fadf0d7f.28c44d69-f002-4176-ad17-d4e598856b81" returned: 0 in 0.326s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:48:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-107e84ff-83aa-4bd9-9896-af1f7a9515ae tempest-GroupSnapshotsTest-1581907882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-312c6e8f-673e-41d0-b299-2a72fadf0d7f.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:48:18 devstack sudo[96008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-312c6e8f-673e-41d0-b299-2a72fadf0d7f.info Sep 08 06:48:18 devstack sudo[96008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:48:18 devstack sudo[96008]: pam_unix(sudo:session): session closed for user root Sep 08 06:48:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-107e84ff-83aa-4bd9-9896-af1f7a9515ae tempest-GroupSnapshotsTest-1581907882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-312c6e8f-673e-41d0-b299-2a72fadf0d7f.info" returned: 0 in 0.459s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:48:18 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-107e84ff-83aa-4bd9-9896-af1f7a9515ae tempest-GroupSnapshotsTest-1581907882 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-312c6e8f-673e-41d0-b299-2a72fadf0d7f.info is being set with open permissions: ugo+rw: NotImplementedError Sep 08 06:48:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-107e84ff-83aa-4bd9-9896-af1f7a9515ae tempest-GroupSnapshotsTest-1581907882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-312c6e8f-673e-41d0-b299-2a72fadf0d7f.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:48:18 devstack sudo[96011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-312c6e8f-673e-41d0-b299-2a72fadf0d7f.info Sep 08 06:48:18 devstack sudo[96011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:48:19 devstack sudo[96011]: pam_unix(sudo:session): session closed for user root Sep 08 06:48:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-107e84ff-83aa-4bd9-9896-af1f7a9515ae tempest-GroupSnapshotsTest-1581907882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-312c6e8f-673e-41d0-b299-2a72fadf0d7f.info" returned: 0 in 0.545s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:48:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-107e84ff-83aa-4bd9-9896-af1f7a9515ae tempest-GroupSnapshotsTest-1581907882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.374s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:48:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-107e84ff-83aa-4bd9-9896-af1f7a9515ae tempest-GroupSnapshotsTest-1581907882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:48:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-107e84ff-83aa-4bd9-9896-af1f7a9515ae tempest-GroupSnapshotsTest-1581907882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:48:19 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-107e84ff-83aa-4bd9-9896-af1f7a9515ae tempest-GroupSnapshotsTest-1581907882 None] Creating offline snapshot 4a39c897-2a32-4252-ab22-66106b866618 of volume 4252fa60-d14b-4548-a242-7eb67105a4c8 {{(pid=87507) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 06:48:19 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6831e7f-7303-44a6-b718-9cc123024588]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:48:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-107e84ff-83aa-4bd9-9896-af1f7a9515ae tempest-GroupSnapshotsTest-1581907882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4252fa60-d14b-4548-a242-7eb67105a4c8 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:48:19 devstack sudo[96014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4252fa60-d14b-4548-a242-7eb67105a4c8 Sep 08 06:48:19 devstack sudo[96014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:48:20 devstack cinder-volume[87507]: DEBUG oslo_service.periodic_task [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87507) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 06:48:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:48:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:48:20 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:48:20 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:48:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:48:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:48:20 devstack sudo[96019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:48:20 devstack sudo[96019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:48:20 devstack sudo[96014]: pam_unix(sudo:session): session closed for user root Sep 08 06:48:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-107e84ff-83aa-4bd9-9896-af1f7a9515ae tempest-GroupSnapshotsTest-1581907882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4252fa60-d14b-4548-a242-7eb67105a4c8" returned: 0 in 0.586s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:48:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-107e84ff-83aa-4bd9-9896-af1f7a9515ae tempest-GroupSnapshotsTest-1581907882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4252fa60-d14b-4548-a242-7eb67105a4c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4252fa60-d14b-4548-a242-7eb67105a4c8.4a39c897-2a32-4252-ab22-66106b866618 1G {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:48:20 devstack sudo[96022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4252fa60-d14b-4548-a242-7eb67105a4c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4252fa60-d14b-4548-a242-7eb67105a4c8.4a39c897-2a32-4252-ab22-66106b866618 1G Sep 08 06:48:20 devstack sudo[96022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:48:20 devstack sudo[96019]: pam_unix(sudo:session): session closed for user root Sep 08 06:48:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.390s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:48:20 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:48:20 devstack cinder-volume[87507]: DEBUG oslo_service.periodic_task [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Running periodic task VolumeManager._thread_info {{(pid=87507) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 06:48:20 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] thread count: 29 {{(pid=87507) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 06:48:20 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] thread info: [<_MainThread(MainThread, started 127913129345152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87507) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 06:48:20 devstack sudo[96022]: pam_unix(sudo:session): session closed for user root Sep 08 06:48:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-107e84ff-83aa-4bd9-9896-af1f7a9515ae tempest-GroupSnapshotsTest-1581907882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4252fa60-d14b-4548-a242-7eb67105a4c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4252fa60-d14b-4548-a242-7eb67105a4c8.4a39c897-2a32-4252-ab22-66106b866618 1G" returned: 0 in 0.638s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:48:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-107e84ff-83aa-4bd9-9896-af1f7a9515ae tempest-GroupSnapshotsTest-1581907882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4252fa60-d14b-4548-a242-7eb67105a4c8 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4252fa60-d14b-4548-a242-7eb67105a4c8.4a39c897-2a32-4252-ab22-66106b866618 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:48:20 devstack sudo[96029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4252fa60-d14b-4548-a242-7eb67105a4c8 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4252fa60-d14b-4548-a242-7eb67105a4c8.4a39c897-2a32-4252-ab22-66106b866618 Sep 08 06:48:20 devstack sudo[96029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:48:21 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-13864932-f26d-45a4-82c3-5f4f566bd236 tempest-TestMinimumBasicScenario-251746191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:48:21 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-13864932-f26d-45a4-82c3-5f4f566bd236 tempest-TestMinimumBasicScenario-251746191 None] Flow 'volume_create_manager' (b9a256e0-d3f0-421c-83e4-0ad18e92ea85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:48:21 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-13864932-f26d-45a4-82c3-5f4f566bd236 tempest-TestMinimumBasicScenario-251746191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (614aaa15-cf95-45bb-8eb5-87ac5f38695f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:48:21 devstack sudo[96029]: pam_unix(sudo:session): session closed for user root Sep 08 06:48:21 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-107e84ff-83aa-4bd9-9896-af1f7a9515ae tempest-GroupSnapshotsTest-1581907882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4252fa60-d14b-4548-a242-7eb67105a4c8 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4252fa60-d14b-4548-a242-7eb67105a4c8.4a39c897-2a32-4252-ab22-66106b866618" returned: 0 in 0.490s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:48:21 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-107e84ff-83aa-4bd9-9896-af1f7a9515ae tempest-GroupSnapshotsTest-1581907882 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4252fa60-d14b-4548-a242-7eb67105a4c8.4a39c897-2a32-4252-ab22-66106b866618 is being set with open permissions: ugo+rw: NotImplementedError Sep 08 06:48:21 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-107e84ff-83aa-4bd9-9896-af1f7a9515ae tempest-GroupSnapshotsTest-1581907882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4252fa60-d14b-4548-a242-7eb67105a4c8.4a39c897-2a32-4252-ab22-66106b866618 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:48:21 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-13864932-f26d-45a4-82c3-5f4f566bd236 tempest-TestMinimumBasicScenario-251746191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (614aaa15-cf95-45bb-8eb5-87ac5f38695f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:48:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1509335325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32dfdd20-d80c-4b10-ab03-dc6ad578d7b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0ac5c92ce0e48a1829c25db086d9928',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:48:21Z,use_quota=True,user_id='83d3888fefa24f2f83678a44a35eaf37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:48:21 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-13864932-f26d-45a4-82c3-5f4f566bd236 tempest-TestMinimumBasicScenario-251746191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f38f42c-14ae-40ab-b484-ec5ca1d734f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:48:21 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-13864932-f26d-45a4-82c3-5f4f566bd236 tempest-TestMinimumBasicScenario-251746191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f38f42c-14ae-40ab-b484-ec5ca1d734f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:48:21 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-13864932-f26d-45a4-82c3-5f4f566bd236 tempest-TestMinimumBasicScenario-251746191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa7ee3ae-471e-495f-8d02-95ef95784d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:48:21 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-13864932-f26d-45a4-82c3-5f4f566bd236 tempest-TestMinimumBasicScenario-251746191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa7ee3ae-471e-495f-8d02-95ef95784d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32dfdd20-d80c-4b10-ab03-dc6ad578d7b1', 'volume_name': 'volume-32dfdd20-d80c-4b10-ab03-dc6ad578d7b1', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:48:21 devstack sudo[96034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4252fa60-d14b-4548-a242-7eb67105a4c8.4a39c897-2a32-4252-ab22-66106b866618 Sep 08 06:48:21 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-13864932-f26d-45a4-82c3-5f4f566bd236 tempest-TestMinimumBasicScenario-251746191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0778816-8663-460d-bdab-c9b86e48d28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:48:21 devstack sudo[96034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:48:21 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-13864932-f26d-45a4-82c3-5f4f566bd236 tempest-TestMinimumBasicScenario-251746191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0778816-8663-460d-bdab-c9b86e48d28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:48:21 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-13864932-f26d-45a4-82c3-5f4f566bd236 tempest-TestMinimumBasicScenario-251746191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb868a36-e511-4fea-be63-6f3a61d64e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:48:21 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-13864932-f26d-45a4-82c3-5f4f566bd236 tempest-TestMinimumBasicScenario-251746191 None] Volume 32dfdd20-d80c-4b10-ab03-dc6ad578d7b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32dfdd20-d80c-4b10-ab03-dc6ad578d7b1', 'volume_size': 1} Sep 08 06:48:21 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-13864932-f26d-45a4-82c3-5f4f566bd236 tempest-TestMinimumBasicScenario-251746191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:48:21 devstack sudo[96034]: pam_unix(sudo:session): session closed for user root Sep 08 06:48:21 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-107e84ff-83aa-4bd9-9896-af1f7a9515ae tempest-GroupSnapshotsTest-1581907882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4252fa60-d14b-4548-a242-7eb67105a4c8.4a39c897-2a32-4252-ab22-66106b866618" returned: 0 in 0.392s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:48:21 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-107e84ff-83aa-4bd9-9896-af1f7a9515ae tempest-GroupSnapshotsTest-1581907882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4252fa60-d14b-4548-a242-7eb67105a4c8.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:48:21 devstack sudo[96037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4252fa60-d14b-4548-a242-7eb67105a4c8.info Sep 08 06:48:21 devstack sudo[96037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:48:22 devstack sudo[96037]: pam_unix(sudo:session): session closed for user root Sep 08 06:48:22 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-107e84ff-83aa-4bd9-9896-af1f7a9515ae tempest-GroupSnapshotsTest-1581907882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4252fa60-d14b-4548-a242-7eb67105a4c8.info" returned: 0 in 0.436s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:48:22 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-107e84ff-83aa-4bd9-9896-af1f7a9515ae tempest-GroupSnapshotsTest-1581907882 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4252fa60-d14b-4548-a242-7eb67105a4c8.info is being set with open permissions: ugo+rw: NotImplementedError Sep 08 06:48:22 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-107e84ff-83aa-4bd9-9896-af1f7a9515ae tempest-GroupSnapshotsTest-1581907882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4252fa60-d14b-4548-a242-7eb67105a4c8.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:48:22 devstack sudo[96040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4252fa60-d14b-4548-a242-7eb67105a4c8.info Sep 08 06:48:22 devstack sudo[96040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:48:22 devstack sudo[96040]: pam_unix(sudo:session): session closed for user root Sep 08 06:48:22 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-107e84ff-83aa-4bd9-9896-af1f7a9515ae tempest-GroupSnapshotsTest-1581907882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4252fa60-d14b-4548-a242-7eb67105a4c8.info" returned: 0 in 0.343s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:48:22 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-107e84ff-83aa-4bd9-9896-af1f7a9515ae tempest-GroupSnapshotsTest-1581907882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.027s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:48:22 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-13864932-f26d-45a4-82c3-5f4f566bd236 tempest-TestMinimumBasicScenario-251746191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.167s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:48:22 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-13864932-f26d-45a4-82c3-5f4f566bd236 tempest-TestMinimumBasicScenario-251746191 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:48:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1509335325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32dfdd20-d80c-4b10-ab03-dc6ad578d7b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0ac5c92ce0e48a1829c25db086d9928',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:48:21Z,use_quota=True,user_id='83d3888fefa24f2f83678a44a35eaf37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:48:22 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-13864932-f26d-45a4-82c3-5f4f566bd236 tempest-TestMinimumBasicScenario-251746191 None] Creating volume 32dfdd20-d80c-4b10-ab03-dc6ad578d7b1 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:48:22 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-13864932-f26d-45a4-82c3-5f4f566bd236 tempest-TestMinimumBasicScenario-251746191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:48:22 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-13864932-f26d-45a4-82c3-5f4f566bd236 tempest-TestMinimumBasicScenario-251746191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:48:22 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-13864932-f26d-45a4-82c3-5f4f566bd236 tempest-TestMinimumBasicScenario-251746191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:48:22 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-13864932-f26d-45a4-82c3-5f4f566bd236 tempest-TestMinimumBasicScenario-251746191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:48:22 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-13864932-f26d-45a4-82c3-5f4f566bd236 tempest-TestMinimumBasicScenario-251746191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:48:22 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-13864932-f26d-45a4-82c3-5f4f566bd236 tempest-TestMinimumBasicScenario-251746191 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:48:22 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-13864932-f26d-45a4-82c3-5f4f566bd236 tempest-TestMinimumBasicScenario-251746191 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:48:22 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-13864932-f26d-45a4-82c3-5f4f566bd236 tempest-TestMinimumBasicScenario-251746191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-32dfdd20-d80c-4b10-ab03-dc6ad578d7b1 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:48:22 devstack sudo[96044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-32dfdd20-d80c-4b10-ab03-dc6ad578d7b1 1073741824 Sep 08 06:48:22 devstack sudo[96044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:48:22 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-107e84ff-83aa-4bd9-9896-af1f7a9515ae tempest-GroupSnapshotsTest-1581907882 None] group_snapshot 8278036b-112e-4462-95b6-ad63e4d7b544: created successfully Sep 08 06:48:23 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-f7136333-5442-43d2-999d-9a8d85879b23 tempest-GroupSnapshotsTest-1581907882 None] group_snapshot 8278036b-112e-4462-95b6-ad63e4d7b544: deleting Sep 08 06:48:23 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-f7136333-5442-43d2-999d-9a8d85879b23 tempest-GroupSnapshotsTest-1581907882 None] group_snapshot 8278036b-112e-4462-95b6-ad63e4d7b544: deleting {{(pid=87507) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 08 06:48:23 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-f7136333-5442-43d2-999d-9a8d85879b23 tempest-GroupSnapshotsTest-1581907882 None] Acquiring lock "cinder-quobyte-312c6e8f-673e-41d0-b299-2a72fadf0d7f" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:48:23 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-f7136333-5442-43d2-999d-9a8d85879b23 tempest-GroupSnapshotsTest-1581907882 None] Lock "cinder-quobyte-312c6e8f-673e-41d0-b299-2a72fadf0d7f" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:48:23 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-f7136333-5442-43d2-999d-9a8d85879b23 tempest-GroupSnapshotsTest-1581907882 None] Acquiring lock "cinder-quobyte-28c44d69-f002-4176-ad17-d4e598856b81" by "_delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:48:23 devstack sudo[96044]: pam_unix(sudo:session): session closed for user root Sep 08 06:48:23 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-f7136333-5442-43d2-999d-9a8d85879b23 tempest-GroupSnapshotsTest-1581907882 None] Lock "cinder-quobyte-28c44d69-f002-4176-ad17-d4e598856b81" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:48:23 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-f7136333-5442-43d2-999d-9a8d85879b23 tempest-GroupSnapshotsTest-1581907882 None] Deleting offline snapshot 28c44d69-f002-4176-ad17-d4e598856b81 of volume 312c6e8f-673e-41d0-b299-2a72fadf0d7f {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 06:48:23 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-f7136333-5442-43d2-999d-9a8d85879b23 tempest-GroupSnapshotsTest-1581907882 None] snapshot_file for this snap is: volume-312c6e8f-673e-41d0-b299-2a72fadf0d7f.28c44d69-f002-4176-ad17-d4e598856b81 {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 06:48:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-13864932-f26d-45a4-82c3-5f4f566bd236 tempest-TestMinimumBasicScenario-251746191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-32dfdd20-d80c-4b10-ab03-dc6ad578d7b1 1073741824" returned: 0 in 0.789s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:48:23 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d58058-2615-4abe-9ac6-d211e09458a2]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:48:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f7136333-5442-43d2-999d-9a8d85879b23 tempest-GroupSnapshotsTest-1581907882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-312c6e8f-673e-41d0-b299-2a72fadf0d7f.28c44d69-f002-4176-ad17-d4e598856b81 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:48:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-13864932-f26d-45a4-82c3-5f4f566bd236 tempest-TestMinimumBasicScenario-251746191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-32dfdd20-d80c-4b10-ab03-dc6ad578d7b1 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:48:23 devstack sudo[96051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-32dfdd20-d80c-4b10-ab03-dc6ad578d7b1 Sep 08 06:48:23 devstack sudo[96051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:48:23 devstack sudo[96050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-312c6e8f-673e-41d0-b299-2a72fadf0d7f.28c44d69-f002-4176-ad17-d4e598856b81 Sep 08 06:48:23 devstack sudo[96050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:48:23 devstack sudo[96051]: pam_unix(sudo:session): session closed for user root Sep 08 06:48:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-13864932-f26d-45a4-82c3-5f4f566bd236 tempest-TestMinimumBasicScenario-251746191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-32dfdd20-d80c-4b10-ab03-dc6ad578d7b1" returned: 0 in 0.486s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:48:23 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-13864932-f26d-45a4-82c3-5f4f566bd236 tempest-TestMinimumBasicScenario-251746191 None] <== create_volume: return (1397ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:48:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-13864932-f26d-45a4-82c3-5f4f566bd236 tempest-TestMinimumBasicScenario-251746191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.403s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:48:23 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-13864932-f26d-45a4-82c3-5f4f566bd236 tempest-TestMinimumBasicScenario-251746191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb868a36-e511-4fea-be63-6f3a61d64e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32dfdd20-d80c-4b10-ab03-dc6ad578d7b1', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:48:23 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-13864932-f26d-45a4-82c3-5f4f566bd236 tempest-TestMinimumBasicScenario-251746191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e430b52d-33fd-4624-b949-e2a6f9b321de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:48:23 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-13864932-f26d-45a4-82c3-5f4f566bd236 tempest-TestMinimumBasicScenario-251746191 None] Volume volume-32dfdd20-d80c-4b10-ab03-dc6ad578d7b1 (32dfdd20-d80c-4b10-ab03-dc6ad578d7b1): created successfully Sep 08 06:48:23 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-13864932-f26d-45a4-82c3-5f4f566bd236 tempest-TestMinimumBasicScenario-251746191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e430b52d-33fd-4624-b949-e2a6f9b321de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:48:23 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-13864932-f26d-45a4-82c3-5f4f566bd236 tempest-TestMinimumBasicScenario-251746191 None] Flow 'volume_create_manager' (b9a256e0-d3f0-421c-83e4-0ad18e92ea85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:48:24 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-13864932-f26d-45a4-82c3-5f4f566bd236 tempest-TestMinimumBasicScenario-251746191 None] Created volume successfully. Sep 08 06:48:24 devstack sudo[96050]: pam_unix(sudo:session): session closed for user root Sep 08 06:48:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f7136333-5442-43d2-999d-9a8d85879b23 tempest-GroupSnapshotsTest-1581907882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-312c6e8f-673e-41d0-b299-2a72fadf0d7f.28c44d69-f002-4176-ad17-d4e598856b81" returned: 0 in 0.784s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:48:24 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-f7136333-5442-43d2-999d-9a8d85879b23 tempest-GroupSnapshotsTest-1581907882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-312c6e8f-673e-41d0-b299-2a72fadf0d7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 06:48:24 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c180986-6abb-4d0f-b6d9-d596ebf63048]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:48:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f7136333-5442-43d2-999d-9a8d85879b23 tempest-GroupSnapshotsTest-1581907882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-312c6e8f-673e-41d0-b299-2a72fadf0d7f {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:48:24 devstack sudo[96059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-312c6e8f-673e-41d0-b299-2a72fadf0d7f Sep 08 06:48:24 devstack sudo[96059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:48:24 devstack sudo[96059]: pam_unix(sudo:session): session closed for user root Sep 08 06:48:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f7136333-5442-43d2-999d-9a8d85879b23 tempest-GroupSnapshotsTest-1581907882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-312c6e8f-673e-41d0-b299-2a72fadf0d7f" returned: 0 in 0.708s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:48:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f7136333-5442-43d2-999d-9a8d85879b23 tempest-GroupSnapshotsTest-1581907882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-312c6e8f-673e-41d0-b299-2a72fadf0d7f.28c44d69-f002-4176-ad17-d4e598856b81 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:48:24 devstack sudo[96068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-312c6e8f-673e-41d0-b299-2a72fadf0d7f.28c44d69-f002-4176-ad17-d4e598856b81 Sep 08 06:48:24 devstack sudo[96068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:48:25 devstack sudo[96068]: pam_unix(sudo:session): session closed for user root Sep 08 06:48:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f7136333-5442-43d2-999d-9a8d85879b23 tempest-GroupSnapshotsTest-1581907882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-312c6e8f-673e-41d0-b299-2a72fadf0d7f.28c44d69-f002-4176-ad17-d4e598856b81" returned: 0 in 0.649s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:48:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f7136333-5442-43d2-999d-9a8d85879b23 tempest-GroupSnapshotsTest-1581907882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-312c6e8f-673e-41d0-b299-2a72fadf0d7f.28c44d69-f002-4176-ad17-d4e598856b81 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:48:25 devstack sudo[96076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-312c6e8f-673e-41d0-b299-2a72fadf0d7f.28c44d69-f002-4176-ad17-d4e598856b81 Sep 08 06:48:25 devstack sudo[96076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:48:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-ca9e7b60-c397-493f-a19d-417104bd7ffe req-aa835133-0416-4bdc-8fe0-bc17a8d40b60 tempest-TestMinimumBasicScenario-251746191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:48:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-ca9e7b60-c397-493f-a19d-417104bd7ffe req-aa835133-0416-4bdc-8fe0-bc17a8d40b60 tempest-TestMinimumBasicScenario-251746191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:48:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-ca9e7b60-c397-493f-a19d-417104bd7ffe req-aa835133-0416-4bdc-8fe0-bc17a8d40b60 tempest-TestMinimumBasicScenario-251746191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:48:26 devstack sudo[96076]: pam_unix(sudo:session): session closed for user root Sep 08 06:48:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f7136333-5442-43d2-999d-9a8d85879b23 tempest-GroupSnapshotsTest-1581907882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-312c6e8f-673e-41d0-b299-2a72fadf0d7f.28c44d69-f002-4176-ad17-d4e598856b81" returned: 0 in 0.476s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:48:26 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-f7136333-5442-43d2-999d-9a8d85879b23 tempest-GroupSnapshotsTest-1581907882 None] Lock "cinder-quobyte-28c44d69-f002-4176-ad17-d4e598856b81" released by "_delete_snapshot" :: held 2.814s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:48:26 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-ca9e7b60-c397-493f-a19d-417104bd7ffe req-aa835133-0416-4bdc-8fe0-bc17a8d40b60 tempest-TestMinimumBasicScenario-251746191 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d', 'name': 'volume-32dfdd20-d80c-4b10-ab03-dc6ad578d7b1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f111a531-41ae-47f6-801d-7a678f2ef3c5', 'enforce_multipath': True} {{(pid=87507) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 06:48:26 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-f7136333-5442-43d2-999d-9a8d85879b23 tempest-GroupSnapshotsTest-1581907882 None] Lock "cinder-quobyte-312c6e8f-673e-41d0-b299-2a72fadf0d7f" released by "delete_snapshot" :: held 2.861s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:48:26 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-f7136333-5442-43d2-999d-9a8d85879b23 tempest-GroupSnapshotsTest-1581907882 None] Acquiring lock "cinder-quobyte-4252fa60-d14b-4548-a242-7eb67105a4c8" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:48:26 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-f7136333-5442-43d2-999d-9a8d85879b23 tempest-GroupSnapshotsTest-1581907882 None] Lock "cinder-quobyte-4252fa60-d14b-4548-a242-7eb67105a4c8" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:48:26 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-f7136333-5442-43d2-999d-9a8d85879b23 tempest-GroupSnapshotsTest-1581907882 None] Acquiring lock "cinder-quobyte-4a39c897-2a32-4252-ab22-66106b866618" by "_delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:48:26 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-f7136333-5442-43d2-999d-9a8d85879b23 tempest-GroupSnapshotsTest-1581907882 None] Lock "cinder-quobyte-4a39c897-2a32-4252-ab22-66106b866618" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:48:26 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-f7136333-5442-43d2-999d-9a8d85879b23 tempest-GroupSnapshotsTest-1581907882 None] Deleting offline snapshot 4a39c897-2a32-4252-ab22-66106b866618 of volume 4252fa60-d14b-4548-a242-7eb67105a4c8 {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 06:48:26 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-f7136333-5442-43d2-999d-9a8d85879b23 tempest-GroupSnapshotsTest-1581907882 None] snapshot_file for this snap is: volume-4252fa60-d14b-4548-a242-7eb67105a4c8.4a39c897-2a32-4252-ab22-66106b866618 {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 06:48:26 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b448c1-725b-440c-8aba-c428da50333d]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:48:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f7136333-5442-43d2-999d-9a8d85879b23 tempest-GroupSnapshotsTest-1581907882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4252fa60-d14b-4548-a242-7eb67105a4c8.4a39c897-2a32-4252-ab22-66106b866618 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:48:26 devstack cinder-volume[87507]: INFO cinder.volume.manager [req-ca9e7b60-c397-493f-a19d-417104bd7ffe req-aa835133-0416-4bdc-8fe0-bc17a8d40b60 tempest-TestMinimumBasicScenario-251746191 None] attachment_update completed successfully. Sep 08 06:48:26 devstack sudo[96089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4252fa60-d14b-4548-a242-7eb67105a4c8.4a39c897-2a32-4252-ab22-66106b866618 Sep 08 06:48:26 devstack sudo[96089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:48:27 devstack sudo[96089]: pam_unix(sudo:session): session closed for user root Sep 08 06:48:27 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f7136333-5442-43d2-999d-9a8d85879b23 tempest-GroupSnapshotsTest-1581907882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4252fa60-d14b-4548-a242-7eb67105a4c8.4a39c897-2a32-4252-ab22-66106b866618" returned: 0 in 0.785s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:48:27 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-f7136333-5442-43d2-999d-9a8d85879b23 tempest-GroupSnapshotsTest-1581907882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4252fa60-d14b-4548-a242-7eb67105a4c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 06:48:27 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf9d2f3b-d554-411c-8a0d-5b75d1a49c60]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:48:27 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f7136333-5442-43d2-999d-9a8d85879b23 tempest-GroupSnapshotsTest-1581907882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4252fa60-d14b-4548-a242-7eb67105a4c8 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:48:27 devstack sudo[96493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4252fa60-d14b-4548-a242-7eb67105a4c8 Sep 08 06:48:27 devstack sudo[96493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:48:27 devstack sudo[96493]: pam_unix(sudo:session): session closed for user root Sep 08 06:48:27 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f7136333-5442-43d2-999d-9a8d85879b23 tempest-GroupSnapshotsTest-1581907882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4252fa60-d14b-4548-a242-7eb67105a4c8" returned: 0 in 0.551s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:48:27 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f7136333-5442-43d2-999d-9a8d85879b23 tempest-GroupSnapshotsTest-1581907882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4252fa60-d14b-4548-a242-7eb67105a4c8.4a39c897-2a32-4252-ab22-66106b866618 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:48:27 devstack sudo[96500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4252fa60-d14b-4548-a242-7eb67105a4c8.4a39c897-2a32-4252-ab22-66106b866618 Sep 08 06:48:27 devstack sudo[96500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:48:28 devstack sudo[96500]: pam_unix(sudo:session): session closed for user root Sep 08 06:48:28 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f7136333-5442-43d2-999d-9a8d85879b23 tempest-GroupSnapshotsTest-1581907882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4252fa60-d14b-4548-a242-7eb67105a4c8.4a39c897-2a32-4252-ab22-66106b866618" returned: 0 in 0.544s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:48:28 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f7136333-5442-43d2-999d-9a8d85879b23 tempest-GroupSnapshotsTest-1581907882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4252fa60-d14b-4548-a242-7eb67105a4c8.4a39c897-2a32-4252-ab22-66106b866618 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:48:28 devstack sudo[96507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4252fa60-d14b-4548-a242-7eb67105a4c8.4a39c897-2a32-4252-ab22-66106b866618 Sep 08 06:48:28 devstack sudo[96507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:48:28 devstack sudo[96507]: pam_unix(sudo:session): session closed for user root Sep 08 06:48:28 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f7136333-5442-43d2-999d-9a8d85879b23 tempest-GroupSnapshotsTest-1581907882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4252fa60-d14b-4548-a242-7eb67105a4c8.4a39c897-2a32-4252-ab22-66106b866618" returned: 0 in 0.460s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:48:28 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-f7136333-5442-43d2-999d-9a8d85879b23 tempest-GroupSnapshotsTest-1581907882 None] Lock "cinder-quobyte-4a39c897-2a32-4252-ab22-66106b866618" released by "_delete_snapshot" :: held 2.553s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:48:28 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-f7136333-5442-43d2-999d-9a8d85879b23 tempest-GroupSnapshotsTest-1581907882 None] Lock "cinder-quobyte-4252fa60-d14b-4548-a242-7eb67105a4c8" released by "delete_snapshot" :: held 2.618s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:48:28 devstack cinder-volume[87507]: WARNING cinder.quota [None req-f7136333-5442-43d2-999d-9a8d85879b23 tempest-GroupSnapshotsTest-1581907882 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1334170813 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1334170813, it is now deprecated. Please use the default quota class for default quota. Sep 08 06:48:28 devstack cinder-volume[87507]: WARNING cinder.quota [None req-f7136333-5442-43d2-999d-9a8d85879b23 tempest-GroupSnapshotsTest-1581907882 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1334170813 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1334170813, it is now deprecated. Please use the default quota class for default quota. Sep 08 06:48:28 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-f7136333-5442-43d2-999d-9a8d85879b23 tempest-GroupSnapshotsTest-1581907882 None] Created reservations ['ad636a13-712a-4bb3-b830-9af91a01d0d3', 'da2c7a09-1ff0-4dab-9b43-ba9170a3d694', 'e8572240-308b-4e1e-838a-be9cb77fcaa6', '85d96c39-2ff2-41c1-ac9d-576d69109068'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:48:29 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-f7136333-5442-43d2-999d-9a8d85879b23 tempest-GroupSnapshotsTest-1581907882 None] Created reservations ['7894bd5b-ebad-4ad1-844b-ab59c78f7a94', 'ecf5e0ac-32e3-4784-b959-fb266ef07047', 'eaa5d869-ead4-4f13-8fa9-8afb68d3851a', 'e5f6013a-8564-479a-9998-73f0991b5975'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:48:29 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-f7136333-5442-43d2-999d-9a8d85879b23 tempest-GroupSnapshotsTest-1581907882 None] group_snapshot 8278036b-112e-4462-95b6-ad63e4d7b544: deleted successfully Sep 08 06:48:30 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-1acbff89-e89c-4d18-a236-3a5b5af0e84a tempest-GroupSnapshotsTest-1581907882 None] Acquiring lock "cinder-quobyte-312c6e8f-673e-41d0-b299-2a72fadf0d7f" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:48:30 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-1acbff89-e89c-4d18-a236-3a5b5af0e84a tempest-GroupSnapshotsTest-1581907882 None] Lock "cinder-quobyte-312c6e8f-673e-41d0-b299-2a72fadf0d7f" acquired by "delete_volume" :: waited 0.028s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:48:30 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d21fc2-d903-4a73-8418-95ee1764a2b4]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:48:30 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1acbff89-e89c-4d18-a236-3a5b5af0e84a tempest-GroupSnapshotsTest-1581907882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-312c6e8f-673e-41d0-b299-2a72fadf0d7f {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:48:31 devstack sudo[96538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-312c6e8f-673e-41d0-b299-2a72fadf0d7f Sep 08 06:48:31 devstack sudo[96538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:48:31 devstack sudo[96538]: pam_unix(sudo:session): session closed for user root Sep 08 06:48:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1acbff89-e89c-4d18-a236-3a5b5af0e84a tempest-GroupSnapshotsTest-1581907882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-312c6e8f-673e-41d0-b299-2a72fadf0d7f" returned: 0 in 0.499s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:48:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1acbff89-e89c-4d18-a236-3a5b5af0e84a tempest-GroupSnapshotsTest-1581907882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-312c6e8f-673e-41d0-b299-2a72fadf0d7f {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:48:31 devstack sudo[96543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-312c6e8f-673e-41d0-b299-2a72fadf0d7f Sep 08 06:48:31 devstack sudo[96543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:48:31 devstack sudo[96543]: pam_unix(sudo:session): session closed for user root Sep 08 06:48:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1acbff89-e89c-4d18-a236-3a5b5af0e84a tempest-GroupSnapshotsTest-1581907882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-312c6e8f-673e-41d0-b299-2a72fadf0d7f" returned: 0 in 0.359s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:48:31 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-1acbff89-e89c-4d18-a236-3a5b5af0e84a tempest-GroupSnapshotsTest-1581907882 None] Lock "cinder-quobyte-312c6e8f-673e-41d0-b299-2a72fadf0d7f" released by "delete_volume" :: held 0.939s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:48:31 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-1acbff89-e89c-4d18-a236-3a5b5af0e84a tempest-GroupSnapshotsTest-1581907882 None] Acquiring lock "cinder-quobyte-4252fa60-d14b-4548-a242-7eb67105a4c8" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:48:31 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-1acbff89-e89c-4d18-a236-3a5b5af0e84a tempest-GroupSnapshotsTest-1581907882 None] Lock "cinder-quobyte-4252fa60-d14b-4548-a242-7eb67105a4c8" acquired by "delete_volume" :: waited 0.037s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:48:31 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e209fa-ad67-4124-9686-b1a61556ee5f]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:48:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1acbff89-e89c-4d18-a236-3a5b5af0e84a tempest-GroupSnapshotsTest-1581907882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4252fa60-d14b-4548-a242-7eb67105a4c8 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:48:32 devstack sudo[96557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4252fa60-d14b-4548-a242-7eb67105a4c8 Sep 08 06:48:32 devstack sudo[96557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:48:32 devstack sudo[96557]: pam_unix(sudo:session): session closed for user root Sep 08 06:48:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1acbff89-e89c-4d18-a236-3a5b5af0e84a tempest-GroupSnapshotsTest-1581907882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4252fa60-d14b-4548-a242-7eb67105a4c8" returned: 0 in 0.519s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:48:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1acbff89-e89c-4d18-a236-3a5b5af0e84a tempest-GroupSnapshotsTest-1581907882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4252fa60-d14b-4548-a242-7eb67105a4c8 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:48:32 devstack sudo[96569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4252fa60-d14b-4548-a242-7eb67105a4c8 Sep 08 06:48:32 devstack sudo[96569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:48:32 devstack sudo[96569]: pam_unix(sudo:session): session closed for user root Sep 08 06:48:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1acbff89-e89c-4d18-a236-3a5b5af0e84a tempest-GroupSnapshotsTest-1581907882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4252fa60-d14b-4548-a242-7eb67105a4c8" returned: 0 in 0.270s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:48:32 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-1acbff89-e89c-4d18-a236-3a5b5af0e84a tempest-GroupSnapshotsTest-1581907882 None] Lock "cinder-quobyte-4252fa60-d14b-4548-a242-7eb67105a4c8" released by "delete_volume" :: held 0.887s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:48:32 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-1acbff89-e89c-4d18-a236-3a5b5af0e84a tempest-GroupSnapshotsTest-1581907882 None] Created reservations ['ae50d8e3-055f-4ac5-9440-51b5f0273668'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:48:32 devstack cinder-volume[87507]: WARNING cinder.quota [None req-1acbff89-e89c-4d18-a236-3a5b5af0e84a tempest-GroupSnapshotsTest-1581907882 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1334170813 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1334170813, it is now deprecated. Please use the default quota class for default quota. Sep 08 06:48:32 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-1acbff89-e89c-4d18-a236-3a5b5af0e84a tempest-GroupSnapshotsTest-1581907882 None] Created reservations ['6a0e1bad-0949-4e99-bde0-809a6adb7fa1', 'ef3a1e85-77ae-4e21-b27f-ca398ab7f94d', '44051103-e624-4eb6-b7f8-639fc774fa9b', '2d0d5a34-a7be-4442-bfb0-b55a7ce43cc6'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:48:33 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-1acbff89-e89c-4d18-a236-3a5b5af0e84a tempest-GroupSnapshotsTest-1581907882 None] Created reservations ['ed80c69c-431b-4d8f-8e2d-522ff036a521', '7cee255a-4e80-4e22-bfb1-dbddca5b7d02', '35c3f0e9-8636-4524-9104-775b692f512e', '5183583f-46c7-4476-af61-b08a019e4546'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:48:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-1acbff89-e89c-4d18-a236-3a5b5af0e84a tempest-GroupSnapshotsTest-1581907882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:48:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-1acbff89-e89c-4d18-a236-3a5b5af0e84a tempest-GroupSnapshotsTest-1581907882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:48:33 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-1acbff89-e89c-4d18-a236-3a5b5af0e84a tempest-GroupSnapshotsTest-1581907882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:48:33 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-1acbff89-e89c-4d18-a236-3a5b5af0e84a tempest-GroupSnapshotsTest-1581907882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:48:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-1acbff89-e89c-4d18-a236-3a5b5af0e84a tempest-GroupSnapshotsTest-1581907882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:48:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1acbff89-e89c-4d18-a236-3a5b5af0e84a tempest-GroupSnapshotsTest-1581907882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:48:33 devstack sudo[96573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:48:33 devstack sudo[96573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:48:33 devstack sudo[96573]: pam_unix(sudo:session): session closed for user root Sep 08 06:48:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1acbff89-e89c-4d18-a236-3a5b5af0e84a tempest-GroupSnapshotsTest-1581907882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.350s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:48:33 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-1acbff89-e89c-4d18-a236-3a5b5af0e84a tempest-GroupSnapshotsTest-1581907882 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:48:33 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-1acbff89-e89c-4d18-a236-3a5b5af0e84a tempest-GroupSnapshotsTest-1581907882 None] Delete group completed successfully. Sep 08 06:48:33 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-2aa7c816-4b3c-4ab0-bd5b-0e71ad828100 tempest-GroupSnapshotsTest-1581907882 None] Group tempest-GroupSnapshotsTest-Group-433303529: creating Sep 08 06:48:33 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-2aa7c816-4b3c-4ab0-bd5b-0e71ad828100 tempest-GroupSnapshotsTest-1581907882 None] Group tempest-GroupSnapshotsTest-Group-433303529: created successfully Sep 08 06:48:33 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-2aa7c816-4b3c-4ab0-bd5b-0e71ad828100 tempest-GroupSnapshotsTest-1581907882 None] Create group completed successfully. Sep 08 06:48:35 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7da55ce-7606-4202-a0c6-c3856217aaf5 tempest-GroupSnapshotsTest-1581907882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:48:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-d7da55ce-7606-4202-a0c6-c3856217aaf5 tempest-GroupSnapshotsTest-1581907882 None] Flow 'volume_create_manager' (88372d2e-b584-43dd-8f36-19a83231a297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:48:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-d7da55ce-7606-4202-a0c6-c3856217aaf5 tempest-GroupSnapshotsTest-1581907882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd96e026-2a92-4cd0-95d9-9d77f95aa300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:48:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-d7da55ce-7606-4202-a0c6-c3856217aaf5 tempest-GroupSnapshotsTest-1581907882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd96e026-2a92-4cd0-95d9-9d77f95aa300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:48:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-360022468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b8144858-1dde-4552-bc7d-9020b394de9c,host='devstack@QuobyteHD#QuobyteHD',id=b9c06b07-6220-4f08-8b94-9685bf4f69a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b968bdc7dff4a92ba2e67485c6e29c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:48:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:48:35Z,use_quota=True,user_id='659c95d7250a4fadb3b8dacbb72d4b5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0345fe5c-48de-4344-a070-3a2671806c1e),volume_type_id=0345fe5c-48de-4344-a070-3a2671806c1e)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:48:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-d7da55ce-7606-4202-a0c6-c3856217aaf5 tempest-GroupSnapshotsTest-1581907882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1392df3a-5d1a-4f4f-b555-717b4f2e007f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:48:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-d7da55ce-7606-4202-a0c6-c3856217aaf5 tempest-GroupSnapshotsTest-1581907882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1392df3a-5d1a-4f4f-b555-717b4f2e007f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:48:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-d7da55ce-7606-4202-a0c6-c3856217aaf5 tempest-GroupSnapshotsTest-1581907882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e66d11a-dd90-43b5-95c3-5e3693d5486e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:48:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-d7da55ce-7606-4202-a0c6-c3856217aaf5 tempest-GroupSnapshotsTest-1581907882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e66d11a-dd90-43b5-95c3-5e3693d5486e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9c06b07-6220-4f08-8b94-9685bf4f69a7', 'volume_name': 'volume-b9c06b07-6220-4f08-8b94-9685bf4f69a7', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:48:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-d7da55ce-7606-4202-a0c6-c3856217aaf5 tempest-GroupSnapshotsTest-1581907882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (621ee987-bdb9-4597-8a66-cc9787d2fe39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:48:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-d7da55ce-7606-4202-a0c6-c3856217aaf5 tempest-GroupSnapshotsTest-1581907882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (621ee987-bdb9-4597-8a66-cc9787d2fe39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:48:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-d7da55ce-7606-4202-a0c6-c3856217aaf5 tempest-GroupSnapshotsTest-1581907882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d5c397c-99e6-485b-845e-8601f6ebb227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:48:35 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-d7da55ce-7606-4202-a0c6-c3856217aaf5 tempest-GroupSnapshotsTest-1581907882 None] Volume b9c06b07-6220-4f08-8b94-9685bf4f69a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9c06b07-6220-4f08-8b94-9685bf4f69a7', 'volume_size': 1} Sep 08 06:48:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-d7da55ce-7606-4202-a0c6-c3856217aaf5 tempest-GroupSnapshotsTest-1581907882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:48:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-d7da55ce-7606-4202-a0c6-c3856217aaf5 tempest-GroupSnapshotsTest-1581907882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:48:35 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-d7da55ce-7606-4202-a0c6-c3856217aaf5 tempest-GroupSnapshotsTest-1581907882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b8144858-1dde-4552-bc7d-9020b394de9c,created_at=2026-09-08T04:48:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-360022468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b8144858-1dde-4552-bc7d-9020b394de9c,host='devstack@QuobyteHD#QuobyteHD',id=b9c06b07-6220-4f08-8b94-9685bf4f69a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b968bdc7dff4a92ba2e67485c6e29c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:48:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:48:35Z,use_quota=True,user_id='659c95d7250a4fadb3b8dacbb72d4b5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0345fe5c-48de-4344-a070-3a2671806c1e),volume_type_id=0345fe5c-48de-4344-a070-3a2671806c1e)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:48:35 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-d7da55ce-7606-4202-a0c6-c3856217aaf5 tempest-GroupSnapshotsTest-1581907882 None] Creating volume b9c06b07-6220-4f08-8b94-9685bf4f69a7 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:48:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-d7da55ce-7606-4202-a0c6-c3856217aaf5 tempest-GroupSnapshotsTest-1581907882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:48:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-d7da55ce-7606-4202-a0c6-c3856217aaf5 tempest-GroupSnapshotsTest-1581907882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:48:35 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-d7da55ce-7606-4202-a0c6-c3856217aaf5 tempest-GroupSnapshotsTest-1581907882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:48:35 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-d7da55ce-7606-4202-a0c6-c3856217aaf5 tempest-GroupSnapshotsTest-1581907882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:48:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-d7da55ce-7606-4202-a0c6-c3856217aaf5 tempest-GroupSnapshotsTest-1581907882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:48:35 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-d7da55ce-7606-4202-a0c6-c3856217aaf5 tempest-GroupSnapshotsTest-1581907882 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:48:35 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-d7da55ce-7606-4202-a0c6-c3856217aaf5 tempest-GroupSnapshotsTest-1581907882 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:48:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-d7da55ce-7606-4202-a0c6-c3856217aaf5 tempest-GroupSnapshotsTest-1581907882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b9c06b07-6220-4f08-8b94-9685bf4f69a7 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:48:35 devstack sudo[96583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b9c06b07-6220-4f08-8b94-9685bf4f69a7 1073741824 Sep 08 06:48:35 devstack sudo[96583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:48:36 devstack sudo[96583]: pam_unix(sudo:session): session closed for user root Sep 08 06:48:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-d7da55ce-7606-4202-a0c6-c3856217aaf5 tempest-GroupSnapshotsTest-1581907882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b9c06b07-6220-4f08-8b94-9685bf4f69a7 1073741824" returned: 0 in 0.627s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:48:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-d7da55ce-7606-4202-a0c6-c3856217aaf5 tempest-GroupSnapshotsTest-1581907882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b9c06b07-6220-4f08-8b94-9685bf4f69a7 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:48:36 devstack sudo[96603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b9c06b07-6220-4f08-8b94-9685bf4f69a7 Sep 08 06:48:36 devstack sudo[96603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:48:36 devstack sudo[96603]: pam_unix(sudo:session): session closed for user root Sep 08 06:48:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-d7da55ce-7606-4202-a0c6-c3856217aaf5 tempest-GroupSnapshotsTest-1581907882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b9c06b07-6220-4f08-8b94-9685bf4f69a7" returned: 0 in 0.570s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:48:36 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-d7da55ce-7606-4202-a0c6-c3856217aaf5 tempest-GroupSnapshotsTest-1581907882 None] <== create_volume: return (1341ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:48:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-d7da55ce-7606-4202-a0c6-c3856217aaf5 tempest-GroupSnapshotsTest-1581907882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.344s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:48:36 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-d7da55ce-7606-4202-a0c6-c3856217aaf5 tempest-GroupSnapshotsTest-1581907882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d5c397c-99e6-485b-845e-8601f6ebb227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9c06b07-6220-4f08-8b94-9685bf4f69a7', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:48:36 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-d7da55ce-7606-4202-a0c6-c3856217aaf5 tempest-GroupSnapshotsTest-1581907882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c009b0e-ae4d-44b5-b93a-9fc068e15bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:48:37 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-d7da55ce-7606-4202-a0c6-c3856217aaf5 tempest-GroupSnapshotsTest-1581907882 None] Volume volume-b9c06b07-6220-4f08-8b94-9685bf4f69a7 (b9c06b07-6220-4f08-8b94-9685bf4f69a7): created successfully Sep 08 06:48:37 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-d7da55ce-7606-4202-a0c6-c3856217aaf5 tempest-GroupSnapshotsTest-1581907882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c009b0e-ae4d-44b5-b93a-9fc068e15bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:48:37 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-d7da55ce-7606-4202-a0c6-c3856217aaf5 tempest-GroupSnapshotsTest-1581907882 None] Flow 'volume_create_manager' (88372d2e-b584-43dd-8f36-19a83231a297) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:48:37 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-d7da55ce-7606-4202-a0c6-c3856217aaf5 tempest-GroupSnapshotsTest-1581907882 None] Created volume successfully. Sep 08 06:48:38 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-a612a050-cb31-4802-b423-b8e1054ab887 tempest-GroupSnapshotsTest-1581907882 None] GroupSnapshot 1b017efe-8fb1-40bb-ac45-c941bc8493dc: creating. Sep 08 06:48:38 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a612a050-cb31-4802-b423-b8e1054ab887 tempest-GroupSnapshotsTest-1581907882 None] Group snapshot 1b017efe-8fb1-40bb-ac45-c941bc8493dc: creating. {{(pid=87507) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 08 06:48:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a612a050-cb31-4802-b423-b8e1054ab887 tempest-GroupSnapshotsTest-1581907882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:48:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a612a050-cb31-4802-b423-b8e1054ab887 tempest-GroupSnapshotsTest-1581907882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:48:38 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-a612a050-cb31-4802-b423-b8e1054ab887 tempest-GroupSnapshotsTest-1581907882 None] Creating offline snapshot 8fbea816-8e7b-48a4-a8eb-b720f79084c7 of volume b9c06b07-6220-4f08-8b94-9685bf4f69a7 {{(pid=87507) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 06:48:38 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0db94b0-1422-420a-9a76-3e3c192e3ead]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:48:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a612a050-cb31-4802-b423-b8e1054ab887 tempest-GroupSnapshotsTest-1581907882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b9c06b07-6220-4f08-8b94-9685bf4f69a7 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:48:38 devstack sudo[96666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b9c06b07-6220-4f08-8b94-9685bf4f69a7 Sep 08 06:48:38 devstack sudo[96666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:48:39 devstack sudo[96666]: pam_unix(sudo:session): session closed for user root Sep 08 06:48:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a612a050-cb31-4802-b423-b8e1054ab887 tempest-GroupSnapshotsTest-1581907882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b9c06b07-6220-4f08-8b94-9685bf4f69a7" returned: 0 in 0.667s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:48:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a612a050-cb31-4802-b423-b8e1054ab887 tempest-GroupSnapshotsTest-1581907882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b9c06b07-6220-4f08-8b94-9685bf4f69a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b9c06b07-6220-4f08-8b94-9685bf4f69a7.8fbea816-8e7b-48a4-a8eb-b720f79084c7 1G {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:48:39 devstack sudo[96672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b9c06b07-6220-4f08-8b94-9685bf4f69a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b9c06b07-6220-4f08-8b94-9685bf4f69a7.8fbea816-8e7b-48a4-a8eb-b720f79084c7 1G Sep 08 06:48:39 devstack sudo[96672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:48:40 devstack sudo[96672]: pam_unix(sudo:session): session closed for user root Sep 08 06:48:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a612a050-cb31-4802-b423-b8e1054ab887 tempest-GroupSnapshotsTest-1581907882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b9c06b07-6220-4f08-8b94-9685bf4f69a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b9c06b07-6220-4f08-8b94-9685bf4f69a7.8fbea816-8e7b-48a4-a8eb-b720f79084c7 1G" returned: 0 in 0.715s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:48:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a612a050-cb31-4802-b423-b8e1054ab887 tempest-GroupSnapshotsTest-1581907882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9c06b07-6220-4f08-8b94-9685bf4f69a7 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b9c06b07-6220-4f08-8b94-9685bf4f69a7.8fbea816-8e7b-48a4-a8eb-b720f79084c7 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:48:40 devstack sudo[96678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9c06b07-6220-4f08-8b94-9685bf4f69a7 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b9c06b07-6220-4f08-8b94-9685bf4f69a7.8fbea816-8e7b-48a4-a8eb-b720f79084c7 Sep 08 06:48:40 devstack sudo[96678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:48:40 devstack sudo[96678]: pam_unix(sudo:session): session closed for user root Sep 08 06:48:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a612a050-cb31-4802-b423-b8e1054ab887 tempest-GroupSnapshotsTest-1581907882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9c06b07-6220-4f08-8b94-9685bf4f69a7 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b9c06b07-6220-4f08-8b94-9685bf4f69a7.8fbea816-8e7b-48a4-a8eb-b720f79084c7" returned: 0 in 0.591s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:48:40 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-a612a050-cb31-4802-b423-b8e1054ab887 tempest-GroupSnapshotsTest-1581907882 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b9c06b07-6220-4f08-8b94-9685bf4f69a7.8fbea816-8e7b-48a4-a8eb-b720f79084c7 is being set with open permissions: ugo+rw: NotImplementedError Sep 08 06:48:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a612a050-cb31-4802-b423-b8e1054ab887 tempest-GroupSnapshotsTest-1581907882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b9c06b07-6220-4f08-8b94-9685bf4f69a7.8fbea816-8e7b-48a4-a8eb-b720f79084c7 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:48:40 devstack sudo[96684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b9c06b07-6220-4f08-8b94-9685bf4f69a7.8fbea816-8e7b-48a4-a8eb-b720f79084c7 Sep 08 06:48:40 devstack sudo[96684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:48:41 devstack sudo[96684]: pam_unix(sudo:session): session closed for user root Sep 08 06:48:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a612a050-cb31-4802-b423-b8e1054ab887 tempest-GroupSnapshotsTest-1581907882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b9c06b07-6220-4f08-8b94-9685bf4f69a7.8fbea816-8e7b-48a4-a8eb-b720f79084c7" returned: 0 in 0.429s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:48:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a612a050-cb31-4802-b423-b8e1054ab887 tempest-GroupSnapshotsTest-1581907882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b9c06b07-6220-4f08-8b94-9685bf4f69a7.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:48:41 devstack sudo[96690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b9c06b07-6220-4f08-8b94-9685bf4f69a7.info Sep 08 06:48:41 devstack sudo[96690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:48:41 devstack sudo[96690]: pam_unix(sudo:session): session closed for user root Sep 08 06:48:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a612a050-cb31-4802-b423-b8e1054ab887 tempest-GroupSnapshotsTest-1581907882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b9c06b07-6220-4f08-8b94-9685bf4f69a7.info" returned: 0 in 0.341s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:48:41 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-a612a050-cb31-4802-b423-b8e1054ab887 tempest-GroupSnapshotsTest-1581907882 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b9c06b07-6220-4f08-8b94-9685bf4f69a7.info is being set with open permissions: ugo+rw: NotImplementedError Sep 08 06:48:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a612a050-cb31-4802-b423-b8e1054ab887 tempest-GroupSnapshotsTest-1581907882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b9c06b07-6220-4f08-8b94-9685bf4f69a7.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:48:41 devstack sudo[96701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b9c06b07-6220-4f08-8b94-9685bf4f69a7.info Sep 08 06:48:41 devstack sudo[96701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:48:42 devstack sudo[96701]: pam_unix(sudo:session): session closed for user root Sep 08 06:48:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a612a050-cb31-4802-b423-b8e1054ab887 tempest-GroupSnapshotsTest-1581907882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b9c06b07-6220-4f08-8b94-9685bf4f69a7.info" returned: 0 in 0.559s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:48:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a612a050-cb31-4802-b423-b8e1054ab887 tempest-GroupSnapshotsTest-1581907882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.505s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:48:42 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-a612a050-cb31-4802-b423-b8e1054ab887 tempest-GroupSnapshotsTest-1581907882 None] group_snapshot 1b017efe-8fb1-40bb-ac45-c941bc8493dc: created successfully Sep 08 06:48:43 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-6bba7278-a9c9-4fa8-95db-1ea4514e84dd tempest-GroupSnapshotsTest-1581907882 None] group_snapshot 1b017efe-8fb1-40bb-ac45-c941bc8493dc: deleting Sep 08 06:48:43 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6bba7278-a9c9-4fa8-95db-1ea4514e84dd tempest-GroupSnapshotsTest-1581907882 None] group_snapshot 1b017efe-8fb1-40bb-ac45-c941bc8493dc: deleting {{(pid=87507) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 08 06:48:43 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-6bba7278-a9c9-4fa8-95db-1ea4514e84dd tempest-GroupSnapshotsTest-1581907882 None] Acquiring lock "cinder-quobyte-b9c06b07-6220-4f08-8b94-9685bf4f69a7" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:48:43 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-6bba7278-a9c9-4fa8-95db-1ea4514e84dd tempest-GroupSnapshotsTest-1581907882 None] Lock "cinder-quobyte-b9c06b07-6220-4f08-8b94-9685bf4f69a7" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:48:43 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-6bba7278-a9c9-4fa8-95db-1ea4514e84dd tempest-GroupSnapshotsTest-1581907882 None] Acquiring lock "cinder-quobyte-8fbea816-8e7b-48a4-a8eb-b720f79084c7" by "_delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:48:43 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-6bba7278-a9c9-4fa8-95db-1ea4514e84dd tempest-GroupSnapshotsTest-1581907882 None] Lock "cinder-quobyte-8fbea816-8e7b-48a4-a8eb-b720f79084c7" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:48:43 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-6bba7278-a9c9-4fa8-95db-1ea4514e84dd tempest-GroupSnapshotsTest-1581907882 None] Deleting offline snapshot 8fbea816-8e7b-48a4-a8eb-b720f79084c7 of volume b9c06b07-6220-4f08-8b94-9685bf4f69a7 {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 06:48:43 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-6bba7278-a9c9-4fa8-95db-1ea4514e84dd tempest-GroupSnapshotsTest-1581907882 None] snapshot_file for this snap is: volume-b9c06b07-6220-4f08-8b94-9685bf4f69a7.8fbea816-8e7b-48a4-a8eb-b720f79084c7 {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 06:48:43 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c253cfd9-7fa2-438e-a442-9f5f9eaea01f]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:48:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6bba7278-a9c9-4fa8-95db-1ea4514e84dd tempest-GroupSnapshotsTest-1581907882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b9c06b07-6220-4f08-8b94-9685bf4f69a7.8fbea816-8e7b-48a4-a8eb-b720f79084c7 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:48:43 devstack sudo[96710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b9c06b07-6220-4f08-8b94-9685bf4f69a7.8fbea816-8e7b-48a4-a8eb-b720f79084c7 Sep 08 06:48:43 devstack sudo[96710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:48:44 devstack sudo[96710]: pam_unix(sudo:session): session closed for user root Sep 08 06:48:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6bba7278-a9c9-4fa8-95db-1ea4514e84dd tempest-GroupSnapshotsTest-1581907882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b9c06b07-6220-4f08-8b94-9685bf4f69a7.8fbea816-8e7b-48a4-a8eb-b720f79084c7" returned: 0 in 0.572s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:48:44 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-6bba7278-a9c9-4fa8-95db-1ea4514e84dd tempest-GroupSnapshotsTest-1581907882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9c06b07-6220-4f08-8b94-9685bf4f69a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 06:48:44 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd86607d-c0ab-4f28-95ee-4f30591ea888]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:48:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6bba7278-a9c9-4fa8-95db-1ea4514e84dd tempest-GroupSnapshotsTest-1581907882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b9c06b07-6220-4f08-8b94-9685bf4f69a7 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:48:44 devstack sudo[96717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b9c06b07-6220-4f08-8b94-9685bf4f69a7 Sep 08 06:48:44 devstack sudo[96717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:48:45 devstack sudo[96717]: pam_unix(sudo:session): session closed for user root Sep 08 06:48:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6bba7278-a9c9-4fa8-95db-1ea4514e84dd tempest-GroupSnapshotsTest-1581907882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b9c06b07-6220-4f08-8b94-9685bf4f69a7" returned: 0 in 0.961s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:48:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6bba7278-a9c9-4fa8-95db-1ea4514e84dd tempest-GroupSnapshotsTest-1581907882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b9c06b07-6220-4f08-8b94-9685bf4f69a7.8fbea816-8e7b-48a4-a8eb-b720f79084c7 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:48:45 devstack sudo[96751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b9c06b07-6220-4f08-8b94-9685bf4f69a7.8fbea816-8e7b-48a4-a8eb-b720f79084c7 Sep 08 06:48:45 devstack sudo[96751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:48:46 devstack sudo[96751]: pam_unix(sudo:session): session closed for user root Sep 08 06:48:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6bba7278-a9c9-4fa8-95db-1ea4514e84dd tempest-GroupSnapshotsTest-1581907882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b9c06b07-6220-4f08-8b94-9685bf4f69a7.8fbea816-8e7b-48a4-a8eb-b720f79084c7" returned: 0 in 1.181s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:48:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6bba7278-a9c9-4fa8-95db-1ea4514e84dd tempest-GroupSnapshotsTest-1581907882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b9c06b07-6220-4f08-8b94-9685bf4f69a7.8fbea816-8e7b-48a4-a8eb-b720f79084c7 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:48:46 devstack sudo[96791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b9c06b07-6220-4f08-8b94-9685bf4f69a7.8fbea816-8e7b-48a4-a8eb-b720f79084c7 Sep 08 06:48:46 devstack sudo[96791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:48:46 devstack sudo[96791]: pam_unix(sudo:session): session closed for user root Sep 08 06:48:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6bba7278-a9c9-4fa8-95db-1ea4514e84dd tempest-GroupSnapshotsTest-1581907882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b9c06b07-6220-4f08-8b94-9685bf4f69a7.8fbea816-8e7b-48a4-a8eb-b720f79084c7" returned: 0 in 0.481s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:48:46 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-6bba7278-a9c9-4fa8-95db-1ea4514e84dd tempest-GroupSnapshotsTest-1581907882 None] Lock "cinder-quobyte-8fbea816-8e7b-48a4-a8eb-b720f79084c7" released by "_delete_snapshot" :: held 3.360s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:48:46 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-6bba7278-a9c9-4fa8-95db-1ea4514e84dd tempest-GroupSnapshotsTest-1581907882 None] Lock "cinder-quobyte-b9c06b07-6220-4f08-8b94-9685bf4f69a7" released by "delete_snapshot" :: held 3.430s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:48:47 devstack cinder-volume[87507]: WARNING cinder.quota [None req-6bba7278-a9c9-4fa8-95db-1ea4514e84dd tempest-GroupSnapshotsTest-1581907882 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1989492962 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1989492962, it is now deprecated. Please use the default quota class for default quota. Sep 08 06:48:47 devstack cinder-volume[87507]: WARNING cinder.quota [None req-6bba7278-a9c9-4fa8-95db-1ea4514e84dd tempest-GroupSnapshotsTest-1581907882 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1989492962 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1989492962, it is now deprecated. Please use the default quota class for default quota. Sep 08 06:48:47 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-6bba7278-a9c9-4fa8-95db-1ea4514e84dd tempest-GroupSnapshotsTest-1581907882 None] Created reservations ['1d167c5f-70db-40c1-beef-171d11dae316', '0112f696-8564-4bd7-9859-e1a4a2966c4a', '5c4a7143-728d-4f53-8b70-33458069bd8c', 'dd511314-9b39-43b8-abf1-7019d5466ada'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:48:47 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-6bba7278-a9c9-4fa8-95db-1ea4514e84dd tempest-GroupSnapshotsTest-1581907882 None] group_snapshot 1b017efe-8fb1-40bb-ac45-c941bc8493dc: deleted successfully Sep 08 06:48:48 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-1e3571ee-192d-43fb-8aee-82dc6c0113d0 tempest-GroupSnapshotsTest-1581907882 None] Acquiring lock "cinder-quobyte-b9c06b07-6220-4f08-8b94-9685bf4f69a7" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:48:48 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-1e3571ee-192d-43fb-8aee-82dc6c0113d0 tempest-GroupSnapshotsTest-1581907882 None] Lock "cinder-quobyte-b9c06b07-6220-4f08-8b94-9685bf4f69a7" acquired by "delete_volume" :: waited 0.054s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:48:48 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[94dfc9c1-0e79-45f7-b151-ba66e8ca104b]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:48:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1e3571ee-192d-43fb-8aee-82dc6c0113d0 tempest-GroupSnapshotsTest-1581907882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b9c06b07-6220-4f08-8b94-9685bf4f69a7 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:48:49 devstack sudo[96828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b9c06b07-6220-4f08-8b94-9685bf4f69a7 Sep 08 06:48:49 devstack sudo[96828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:48:49 devstack sudo[96828]: pam_unix(sudo:session): session closed for user root Sep 08 06:48:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1e3571ee-192d-43fb-8aee-82dc6c0113d0 tempest-GroupSnapshotsTest-1581907882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b9c06b07-6220-4f08-8b94-9685bf4f69a7" returned: 0 in 0.776s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:48:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1e3571ee-192d-43fb-8aee-82dc6c0113d0 tempest-GroupSnapshotsTest-1581907882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b9c06b07-6220-4f08-8b94-9685bf4f69a7 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:48:49 devstack sudo[96856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b9c06b07-6220-4f08-8b94-9685bf4f69a7 Sep 08 06:48:49 devstack sudo[96856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:48:50 devstack sudo[96856]: pam_unix(sudo:session): session closed for user root Sep 08 06:48:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1e3571ee-192d-43fb-8aee-82dc6c0113d0 tempest-GroupSnapshotsTest-1581907882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b9c06b07-6220-4f08-8b94-9685bf4f69a7" returned: 0 in 0.509s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:48:50 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-1e3571ee-192d-43fb-8aee-82dc6c0113d0 tempest-GroupSnapshotsTest-1581907882 None] Lock "cinder-quobyte-b9c06b07-6220-4f08-8b94-9685bf4f69a7" released by "delete_volume" :: held 1.433s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:48:50 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-1e3571ee-192d-43fb-8aee-82dc6c0113d0 tempest-GroupSnapshotsTest-1581907882 None] Created reservations ['9a0226eb-3a1c-44af-8488-3e8b14a6db83'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:48:50 devstack cinder-volume[87507]: WARNING cinder.quota [None req-1e3571ee-192d-43fb-8aee-82dc6c0113d0 tempest-GroupSnapshotsTest-1581907882 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1989492962 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1989492962, it is now deprecated. Please use the default quota class for default quota. Sep 08 06:48:50 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-1e3571ee-192d-43fb-8aee-82dc6c0113d0 tempest-GroupSnapshotsTest-1581907882 None] Created reservations ['e3dffc3e-2c8a-4fee-ae79-dd04821c26fb', 'ccdac25f-1095-4989-b6bb-5d927264ff0b', '4a402387-4d9f-4711-9bf3-22b1519dda74', '1bf409dc-ab68-479d-a872-fbdcfebf652c'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:48:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-1e3571ee-192d-43fb-8aee-82dc6c0113d0 tempest-GroupSnapshotsTest-1581907882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:48:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-1e3571ee-192d-43fb-8aee-82dc6c0113d0 tempest-GroupSnapshotsTest-1581907882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:48:50 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-1e3571ee-192d-43fb-8aee-82dc6c0113d0 tempest-GroupSnapshotsTest-1581907882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:48:50 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-1e3571ee-192d-43fb-8aee-82dc6c0113d0 tempest-GroupSnapshotsTest-1581907882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:48:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-1e3571ee-192d-43fb-8aee-82dc6c0113d0 tempest-GroupSnapshotsTest-1581907882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:48:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1e3571ee-192d-43fb-8aee-82dc6c0113d0 tempest-GroupSnapshotsTest-1581907882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:48:50 devstack sudo[96860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:48:50 devstack sudo[96860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:48:51 devstack sudo[96860]: pam_unix(sudo:session): session closed for user root Sep 08 06:48:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1e3571ee-192d-43fb-8aee-82dc6c0113d0 tempest-GroupSnapshotsTest-1581907882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.528s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:48:51 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-1e3571ee-192d-43fb-8aee-82dc6c0113d0 tempest-GroupSnapshotsTest-1581907882 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:48:51 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-1e3571ee-192d-43fb-8aee-82dc6c0113d0 tempest-GroupSnapshotsTest-1581907882 None] Delete group completed successfully. Sep 08 06:49:00 devstack cinder-volume[87507]: DEBUG dbcounter [-] [87507] Writing DB stats cinder:UPDATE=60,cinder:SELECT=72,cinder:INSERT=17,cinder:DELETE=2 {{(pid=87507) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 06:49:00 devstack cinder-volume[87507]: DEBUG dbcounter [-] [87507] Writing DB stats cinder:SELECT=70,cinder:UPDATE=70,cinder:INSERT=14 {{(pid=87507) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 06:49:04 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-685500d4-9e01-4bca-8de3-aa7ed80ad4c0 tempest-GroupsTest-1306337840 None] Group tempest-Group1-552547497: creating Sep 08 06:49:04 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-36b0dc47-4305-464a-893d-fcdafc22ab95 tempest-AttachVolumeShelveTestJSON-842071274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:49:04 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-36b0dc47-4305-464a-893d-fcdafc22ab95 tempest-AttachVolumeShelveTestJSON-842071274 None] Flow 'volume_create_manager' (d72f70cb-14fd-4b95-8438-615ca2e4f66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:49:04 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-36b0dc47-4305-464a-893d-fcdafc22ab95 tempest-AttachVolumeShelveTestJSON-842071274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d25fd86-0540-44e2-8d44-43e4598e14ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:49:04 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-36b0dc47-4305-464a-893d-fcdafc22ab95 tempest-AttachVolumeShelveTestJSON-842071274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d25fd86-0540-44e2-8d44-43e4598e14ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:49:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1541572809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66786104-fc09-4aec-a345-eeb93bd62f9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f7abb19d0684009b4fa3156699fbdd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:49:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:49:04Z,use_quota=True,user_id='655e6c4a8b45435096272bfd1e56e42f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:49:04 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-36b0dc47-4305-464a-893d-fcdafc22ab95 tempest-AttachVolumeShelveTestJSON-842071274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b0fc439-b874-4161-a7b6-17b44c08ade1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:49:04 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-36b0dc47-4305-464a-893d-fcdafc22ab95 tempest-AttachVolumeShelveTestJSON-842071274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b0fc439-b874-4161-a7b6-17b44c08ade1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:49:04 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-36b0dc47-4305-464a-893d-fcdafc22ab95 tempest-AttachVolumeShelveTestJSON-842071274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9b95790-16c9-4438-9124-6adbb075ff02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:49:04 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-36b0dc47-4305-464a-893d-fcdafc22ab95 tempest-AttachVolumeShelveTestJSON-842071274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9b95790-16c9-4438-9124-6adbb075ff02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66786104-fc09-4aec-a345-eeb93bd62f9c', 'volume_name': 'volume-66786104-fc09-4aec-a345-eeb93bd62f9c', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:49:04 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-36b0dc47-4305-464a-893d-fcdafc22ab95 tempest-AttachVolumeShelveTestJSON-842071274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bb91d07-8aeb-4c0a-96c1-9973e0b8e0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:49:04 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-36b0dc47-4305-464a-893d-fcdafc22ab95 tempest-AttachVolumeShelveTestJSON-842071274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bb91d07-8aeb-4c0a-96c1-9973e0b8e0fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:49:04 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-36b0dc47-4305-464a-893d-fcdafc22ab95 tempest-AttachVolumeShelveTestJSON-842071274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ae59037-8e08-44b6-b8ca-8f56ec41013a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:49:04 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-36b0dc47-4305-464a-893d-fcdafc22ab95 tempest-AttachVolumeShelveTestJSON-842071274 None] Volume 66786104-fc09-4aec-a345-eeb93bd62f9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66786104-fc09-4aec-a345-eeb93bd62f9c', 'volume_size': 1} Sep 08 06:49:04 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-36b0dc47-4305-464a-893d-fcdafc22ab95 tempest-AttachVolumeShelveTestJSON-842071274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:49:04 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-36b0dc47-4305-464a-893d-fcdafc22ab95 tempest-AttachVolumeShelveTestJSON-842071274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:49:04 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-36b0dc47-4305-464a-893d-fcdafc22ab95 tempest-AttachVolumeShelveTestJSON-842071274 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:49:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1541572809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66786104-fc09-4aec-a345-eeb93bd62f9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f7abb19d0684009b4fa3156699fbdd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:49:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:49:04Z,use_quota=True,user_id='655e6c4a8b45435096272bfd1e56e42f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:49:04 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-36b0dc47-4305-464a-893d-fcdafc22ab95 tempest-AttachVolumeShelveTestJSON-842071274 None] Creating volume 66786104-fc09-4aec-a345-eeb93bd62f9c {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:49:04 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-36b0dc47-4305-464a-893d-fcdafc22ab95 tempest-AttachVolumeShelveTestJSON-842071274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:49:04 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-36b0dc47-4305-464a-893d-fcdafc22ab95 tempest-AttachVolumeShelveTestJSON-842071274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:49:04 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-36b0dc47-4305-464a-893d-fcdafc22ab95 tempest-AttachVolumeShelveTestJSON-842071274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:49:04 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-36b0dc47-4305-464a-893d-fcdafc22ab95 tempest-AttachVolumeShelveTestJSON-842071274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:49:04 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-36b0dc47-4305-464a-893d-fcdafc22ab95 tempest-AttachVolumeShelveTestJSON-842071274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:49:04 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-36b0dc47-4305-464a-893d-fcdafc22ab95 tempest-AttachVolumeShelveTestJSON-842071274 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:49:04 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-36b0dc47-4305-464a-893d-fcdafc22ab95 tempest-AttachVolumeShelveTestJSON-842071274 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:49:04 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-36b0dc47-4305-464a-893d-fcdafc22ab95 tempest-AttachVolumeShelveTestJSON-842071274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-66786104-fc09-4aec-a345-eeb93bd62f9c 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:49:04 devstack sudo[96943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-66786104-fc09-4aec-a345-eeb93bd62f9c 1073741824 Sep 08 06:49:04 devstack sudo[96943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:49:04 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-685500d4-9e01-4bca-8de3-aa7ed80ad4c0 tempest-GroupsTest-1306337840 None] Group tempest-Group1-552547497: created successfully Sep 08 06:49:04 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-685500d4-9e01-4bca-8de3-aa7ed80ad4c0 tempest-GroupsTest-1306337840 None] Create group completed successfully. Sep 08 06:49:04 devstack sudo[96943]: pam_unix(sudo:session): session closed for user root Sep 08 06:49:04 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-36b0dc47-4305-464a-893d-fcdafc22ab95 tempest-AttachVolumeShelveTestJSON-842071274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-66786104-fc09-4aec-a345-eeb93bd62f9c 1073741824" returned: 0 in 0.444s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:49:04 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-36b0dc47-4305-464a-893d-fcdafc22ab95 tempest-AttachVolumeShelveTestJSON-842071274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-66786104-fc09-4aec-a345-eeb93bd62f9c {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:49:05 devstack sudo[96949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-66786104-fc09-4aec-a345-eeb93bd62f9c Sep 08 06:49:05 devstack sudo[96949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:49:05 devstack sudo[96949]: pam_unix(sudo:session): session closed for user root Sep 08 06:49:05 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-36b0dc47-4305-464a-893d-fcdafc22ab95 tempest-AttachVolumeShelveTestJSON-842071274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-66786104-fc09-4aec-a345-eeb93bd62f9c" returned: 0 in 0.249s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:49:05 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-36b0dc47-4305-464a-893d-fcdafc22ab95 tempest-AttachVolumeShelveTestJSON-842071274 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:49:05 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-36b0dc47-4305-464a-893d-fcdafc22ab95 tempest-AttachVolumeShelveTestJSON-842071274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:49:05 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-36b0dc47-4305-464a-893d-fcdafc22ab95 tempest-AttachVolumeShelveTestJSON-842071274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ae59037-8e08-44b6-b8ca-8f56ec41013a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66786104-fc09-4aec-a345-eeb93bd62f9c', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:49:05 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-36b0dc47-4305-464a-893d-fcdafc22ab95 tempest-AttachVolumeShelveTestJSON-842071274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c96dc3c-fe5f-4357-ad11-af89a377540c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:49:05 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-36b0dc47-4305-464a-893d-fcdafc22ab95 tempest-AttachVolumeShelveTestJSON-842071274 None] Volume volume-66786104-fc09-4aec-a345-eeb93bd62f9c (66786104-fc09-4aec-a345-eeb93bd62f9c): created successfully Sep 08 06:49:05 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-36b0dc47-4305-464a-893d-fcdafc22ab95 tempest-AttachVolumeShelveTestJSON-842071274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c96dc3c-fe5f-4357-ad11-af89a377540c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:49:05 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-36b0dc47-4305-464a-893d-fcdafc22ab95 tempest-AttachVolumeShelveTestJSON-842071274 None] Flow 'volume_create_manager' (d72f70cb-14fd-4b95-8438-615ca2e4f66a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:49:05 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-36b0dc47-4305-464a-893d-fcdafc22ab95 tempest-AttachVolumeShelveTestJSON-842071274 None] Created volume successfully. Sep 08 06:49:05 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-7d1c9845-1efc-43ba-9b20-ef1cf5d18fe3 tempest-GroupsTest-1306337840 None] Group tempest-Group2-744843760: creating Sep 08 06:49:05 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-7d1c9845-1efc-43ba-9b20-ef1cf5d18fe3 tempest-GroupsTest-1306337840 None] Group tempest-Group2-744843760: created successfully Sep 08 06:49:05 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-7d1c9845-1efc-43ba-9b20-ef1cf5d18fe3 tempest-GroupsTest-1306337840 None] Create group completed successfully. Sep 08 06:49:07 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-486af43f-d832-423d-a151-df85ff77da50 tempest-GroupsTest-1306337840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:49:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-486af43f-d832-423d-a151-df85ff77da50 tempest-GroupsTest-1306337840 None] Flow 'volume_create_manager' (4c9cd0c1-1426-4898-a440-76bf7b55d863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:49:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-486af43f-d832-423d-a151-df85ff77da50 tempest-GroupsTest-1306337840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63ec2d33-ac74-4b18-87bc-cfb1b34bdf78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:49:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-486af43f-d832-423d-a151-df85ff77da50 tempest-GroupsTest-1306337840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63ec2d33-ac74-4b18-87bc-cfb1b34bdf78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:49:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-965360855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a7452290-c5e3-4754-bf6f-af69d486b5b3,host='devstack@QuobyteHD#QuobyteHD',id=0669bc24-f349-415e-983e-7bb22cb362cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7c9268906d6435a94f5910658f68678',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:49:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:49:07Z,use_quota=True,user_id='e44cdcc75e4c40a48c36c0a7885c0bdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(53f3b547-3be9-458c-b6ba-7b77c6bb3e4d),volume_type_id=53f3b547-3be9-458c-b6ba-7b77c6bb3e4d)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:49:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-486af43f-d832-423d-a151-df85ff77da50 tempest-GroupsTest-1306337840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (676bcaa2-db75-4c68-ab44-2b8870d4bce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:49:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-486af43f-d832-423d-a151-df85ff77da50 tempest-GroupsTest-1306337840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (676bcaa2-db75-4c68-ab44-2b8870d4bce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:49:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-486af43f-d832-423d-a151-df85ff77da50 tempest-GroupsTest-1306337840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57eb5eec-a67a-4236-8dc4-99352d9a7cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:49:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-486af43f-d832-423d-a151-df85ff77da50 tempest-GroupsTest-1306337840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57eb5eec-a67a-4236-8dc4-99352d9a7cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0669bc24-f349-415e-983e-7bb22cb362cf', 'volume_name': 'volume-0669bc24-f349-415e-983e-7bb22cb362cf', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:49:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-486af43f-d832-423d-a151-df85ff77da50 tempest-GroupsTest-1306337840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5a038d3-a91e-417e-85a0-621a143161fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:49:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-486af43f-d832-423d-a151-df85ff77da50 tempest-GroupsTest-1306337840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5a038d3-a91e-417e-85a0-621a143161fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:49:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-486af43f-d832-423d-a151-df85ff77da50 tempest-GroupsTest-1306337840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c08377f2-4f63-4a48-8d48-245f1ba25c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:49:07 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-486af43f-d832-423d-a151-df85ff77da50 tempest-GroupsTest-1306337840 None] Volume 0669bc24-f349-415e-983e-7bb22cb362cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0669bc24-f349-415e-983e-7bb22cb362cf', 'volume_size': 1} Sep 08 06:49:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-486af43f-d832-423d-a151-df85ff77da50 tempest-GroupsTest-1306337840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:49:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-486af43f-d832-423d-a151-df85ff77da50 tempest-GroupsTest-1306337840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:49:07 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-486af43f-d832-423d-a151-df85ff77da50 tempest-GroupsTest-1306337840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a7452290-c5e3-4754-bf6f-af69d486b5b3,created_at=2026-09-08T04:49:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-965360855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a7452290-c5e3-4754-bf6f-af69d486b5b3,host='devstack@QuobyteHD#QuobyteHD',id=0669bc24-f349-415e-983e-7bb22cb362cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7c9268906d6435a94f5910658f68678',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:49:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:49:07Z,use_quota=True,user_id='e44cdcc75e4c40a48c36c0a7885c0bdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(53f3b547-3be9-458c-b6ba-7b77c6bb3e4d),volume_type_id=53f3b547-3be9-458c-b6ba-7b77c6bb3e4d)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:49:07 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-486af43f-d832-423d-a151-df85ff77da50 tempest-GroupsTest-1306337840 None] Creating volume 0669bc24-f349-415e-983e-7bb22cb362cf {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:49:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-486af43f-d832-423d-a151-df85ff77da50 tempest-GroupsTest-1306337840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:49:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-486af43f-d832-423d-a151-df85ff77da50 tempest-GroupsTest-1306337840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:49:07 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-486af43f-d832-423d-a151-df85ff77da50 tempest-GroupsTest-1306337840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:49:07 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-486af43f-d832-423d-a151-df85ff77da50 tempest-GroupsTest-1306337840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:49:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-486af43f-d832-423d-a151-df85ff77da50 tempest-GroupsTest-1306337840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:49:07 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-486af43f-d832-423d-a151-df85ff77da50 tempest-GroupsTest-1306337840 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:49:07 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-486af43f-d832-423d-a151-df85ff77da50 tempest-GroupsTest-1306337840 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:49:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-486af43f-d832-423d-a151-df85ff77da50 tempest-GroupsTest-1306337840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0669bc24-f349-415e-983e-7bb22cb362cf 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:49:07 devstack sudo[96976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0669bc24-f349-415e-983e-7bb22cb362cf 1073741824 Sep 08 06:49:07 devstack sudo[96976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:49:07 devstack sudo[96976]: pam_unix(sudo:session): session closed for user root Sep 08 06:49:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-486af43f-d832-423d-a151-df85ff77da50 tempest-GroupsTest-1306337840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0669bc24-f349-415e-983e-7bb22cb362cf 1073741824" returned: 0 in 0.483s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:49:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-486af43f-d832-423d-a151-df85ff77da50 tempest-GroupsTest-1306337840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0669bc24-f349-415e-983e-7bb22cb362cf {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:49:07 devstack sudo[96987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0669bc24-f349-415e-983e-7bb22cb362cf Sep 08 06:49:07 devstack sudo[96987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:49:08 devstack sudo[96987]: pam_unix(sudo:session): session closed for user root Sep 08 06:49:08 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-486af43f-d832-423d-a151-df85ff77da50 tempest-GroupsTest-1306337840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0669bc24-f349-415e-983e-7bb22cb362cf" returned: 0 in 0.263s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:49:08 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-486af43f-d832-423d-a151-df85ff77da50 tempest-GroupsTest-1306337840 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:49:08 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-486af43f-d832-423d-a151-df85ff77da50 tempest-GroupsTest-1306337840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:49:08 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-486af43f-d832-423d-a151-df85ff77da50 tempest-GroupsTest-1306337840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c08377f2-4f63-4a48-8d48-245f1ba25c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0669bc24-f349-415e-983e-7bb22cb362cf', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:49:08 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-486af43f-d832-423d-a151-df85ff77da50 tempest-GroupsTest-1306337840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01b24d64-0680-4039-9922-56fa2de3c53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:49:08 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-486af43f-d832-423d-a151-df85ff77da50 tempest-GroupsTest-1306337840 None] Volume volume-0669bc24-f349-415e-983e-7bb22cb362cf (0669bc24-f349-415e-983e-7bb22cb362cf): created successfully Sep 08 06:49:08 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-486af43f-d832-423d-a151-df85ff77da50 tempest-GroupsTest-1306337840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01b24d64-0680-4039-9922-56fa2de3c53f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:49:08 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-486af43f-d832-423d-a151-df85ff77da50 tempest-GroupsTest-1306337840 None] Flow 'volume_create_manager' (4c9cd0c1-1426-4898-a440-76bf7b55d863) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:49:08 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-486af43f-d832-423d-a151-df85ff77da50 tempest-GroupsTest-1306337840 None] Created volume successfully. Sep 08 06:49:09 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-288d3945-ea3e-49ab-b651-f17f824e276d tempest-GroupsTest-1306337840 None] Acquiring lock "cinder-quobyte-0669bc24-f349-415e-983e-7bb22cb362cf" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:49:09 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-288d3945-ea3e-49ab-b651-f17f824e276d tempest-GroupsTest-1306337840 None] Lock "cinder-quobyte-0669bc24-f349-415e-983e-7bb22cb362cf" acquired by "delete_volume" :: waited 0.019s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:49:09 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7af89c7-94ff-4421-9c10-219bd71fc2de]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:49:09 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-288d3945-ea3e-49ab-b651-f17f824e276d tempest-GroupsTest-1306337840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0669bc24-f349-415e-983e-7bb22cb362cf {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:49:09 devstack sudo[96999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0669bc24-f349-415e-983e-7bb22cb362cf Sep 08 06:49:09 devstack sudo[96999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:49:09 devstack sudo[96999]: pam_unix(sudo:session): session closed for user root Sep 08 06:49:09 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-288d3945-ea3e-49ab-b651-f17f824e276d tempest-GroupsTest-1306337840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0669bc24-f349-415e-983e-7bb22cb362cf" returned: 0 in 0.373s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:49:09 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-288d3945-ea3e-49ab-b651-f17f824e276d tempest-GroupsTest-1306337840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0669bc24-f349-415e-983e-7bb22cb362cf {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:49:09 devstack sudo[97004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0669bc24-f349-415e-983e-7bb22cb362cf Sep 08 06:49:09 devstack sudo[97004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:49:09 devstack sudo[97004]: pam_unix(sudo:session): session closed for user root Sep 08 06:49:09 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-288d3945-ea3e-49ab-b651-f17f824e276d tempest-GroupsTest-1306337840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0669bc24-f349-415e-983e-7bb22cb362cf" returned: 0 in 0.281s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:49:09 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-288d3945-ea3e-49ab-b651-f17f824e276d tempest-GroupsTest-1306337840 None] Lock "cinder-quobyte-0669bc24-f349-415e-983e-7bb22cb362cf" released by "delete_volume" :: held 0.709s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:49:09 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-288d3945-ea3e-49ab-b651-f17f824e276d tempest-GroupsTest-1306337840 None] Created reservations ['0d3e2c5a-3c8a-486d-bf6b-43e283b10c29'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:49:09 devstack cinder-volume[87507]: WARNING cinder.quota [None req-288d3945-ea3e-49ab-b651-f17f824e276d tempest-GroupsTest-1306337840 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1352579687 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1352579687, it is now deprecated. Please use the default quota class for default quota. Sep 08 06:49:09 devstack cinder-volume[87507]: WARNING cinder.quota [None req-288d3945-ea3e-49ab-b651-f17f824e276d tempest-GroupsTest-1306337840 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1352579687 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1352579687, it is now deprecated. Please use the default quota class for default quota. Sep 08 06:49:09 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-288d3945-ea3e-49ab-b651-f17f824e276d tempest-GroupsTest-1306337840 None] Created reservations ['6fd9abcb-55bd-4a19-a3b8-e9936e6db287', '7887d20e-774c-4cb5-b309-f14d3776a7d1', 'f9f1c3da-e48b-4ad5-bd92-57b2f0465cb4', '66010900-0988-4db9-a2f6-7bef376f25ae'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:49:10 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-288d3945-ea3e-49ab-b651-f17f824e276d tempest-GroupsTest-1306337840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:49:10 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-288d3945-ea3e-49ab-b651-f17f824e276d tempest-GroupsTest-1306337840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:49:10 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-288d3945-ea3e-49ab-b651-f17f824e276d tempest-GroupsTest-1306337840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:49:10 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-288d3945-ea3e-49ab-b651-f17f824e276d tempest-GroupsTest-1306337840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:49:10 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-288d3945-ea3e-49ab-b651-f17f824e276d tempest-GroupsTest-1306337840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:49:10 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-288d3945-ea3e-49ab-b651-f17f824e276d tempest-GroupsTest-1306337840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:49:10 devstack sudo[97007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:49:10 devstack sudo[97007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:49:10 devstack sudo[97007]: pam_unix(sudo:session): session closed for user root Sep 08 06:49:10 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-288d3945-ea3e-49ab-b651-f17f824e276d tempest-GroupsTest-1306337840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.383s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:49:10 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-288d3945-ea3e-49ab-b651-f17f824e276d tempest-GroupsTest-1306337840 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:49:10 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-288d3945-ea3e-49ab-b651-f17f824e276d tempest-GroupsTest-1306337840 None] Delete group completed successfully. Sep 08 06:49:10 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-3e096d15-9e26-4713-9471-5ab9d926631c tempest-GroupsTest-1306337840 None] Created reservations ['52d8f488-2c4e-4ad2-bcb1-16c687e8b0da'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:49:10 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-3e096d15-9e26-4713-9471-5ab9d926631c tempest-GroupsTest-1306337840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:49:10 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-3e096d15-9e26-4713-9471-5ab9d926631c tempest-GroupsTest-1306337840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:49:10 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-3e096d15-9e26-4713-9471-5ab9d926631c tempest-GroupsTest-1306337840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:49:10 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-3e096d15-9e26-4713-9471-5ab9d926631c tempest-GroupsTest-1306337840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:49:10 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-3e096d15-9e26-4713-9471-5ab9d926631c tempest-GroupsTest-1306337840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:49:10 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3e096d15-9e26-4713-9471-5ab9d926631c tempest-GroupsTest-1306337840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:49:10 devstack sudo[97010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:49:10 devstack sudo[97010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:49:10 devstack sudo[97010]: pam_unix(sudo:session): session closed for user root Sep 08 06:49:10 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3e096d15-9e26-4713-9471-5ab9d926631c tempest-GroupsTest-1306337840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.268s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:49:10 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-3e096d15-9e26-4713-9471-5ab9d926631c tempest-GroupsTest-1306337840 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:49:10 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-3e096d15-9e26-4713-9471-5ab9d926631c tempest-GroupsTest-1306337840 None] Delete group completed successfully. Sep 08 06:49:12 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-918f6c55-9cb3-4afa-b7f5-87b146500790 tempest-GroupsTest-1306337840 None] Group tempest-GroupsTest-Group-1635732425: creating Sep 08 06:49:12 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-918f6c55-9cb3-4afa-b7f5-87b146500790 tempest-GroupsTest-1306337840 None] Group tempest-GroupsTest-Group-1635732425: created successfully Sep 08 06:49:12 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-918f6c55-9cb3-4afa-b7f5-87b146500790 tempest-GroupsTest-1306337840 None] Create group completed successfully. Sep 08 06:49:12 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-abb70dea-f4f7-4a0d-bff8-362bbbe5cc6f tempest-AttachVolumeTestJSON-921065048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:49:12 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-abb70dea-f4f7-4a0d-bff8-362bbbe5cc6f tempest-AttachVolumeTestJSON-921065048 None] Flow 'volume_create_manager' (3969229b-faf2-472f-80b4-edf5542ebcb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:49:12 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-abb70dea-f4f7-4a0d-bff8-362bbbe5cc6f tempest-AttachVolumeTestJSON-921065048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (651d7edf-5f47-4f5b-9e59-20ab17ad1ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:49:12 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-abb70dea-f4f7-4a0d-bff8-362bbbe5cc6f tempest-AttachVolumeTestJSON-921065048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (651d7edf-5f47-4f5b-9e59-20ab17ad1ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:49:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1168841575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3e5ebbb-2dea-45b0-bbff-7fcaf0394604,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d24378ce46b49c998e4274f6641dc7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:49:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:49:13Z,use_quota=True,user_id='be05327e06eb4b9d9c691b01580cfdf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:49:12 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-abb70dea-f4f7-4a0d-bff8-362bbbe5cc6f tempest-AttachVolumeTestJSON-921065048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d30c3cd-129e-46c3-a096-0fd8dbaf1111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:49:13 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-abb70dea-f4f7-4a0d-bff8-362bbbe5cc6f tempest-AttachVolumeTestJSON-921065048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d30c3cd-129e-46c3-a096-0fd8dbaf1111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:49:13 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-abb70dea-f4f7-4a0d-bff8-362bbbe5cc6f tempest-AttachVolumeTestJSON-921065048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e050953-f249-4845-823d-c6ae8e500e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:49:13 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-abb70dea-f4f7-4a0d-bff8-362bbbe5cc6f tempest-AttachVolumeTestJSON-921065048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e050953-f249-4845-823d-c6ae8e500e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3e5ebbb-2dea-45b0-bbff-7fcaf0394604', 'volume_name': 'volume-c3e5ebbb-2dea-45b0-bbff-7fcaf0394604', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:49:13 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-abb70dea-f4f7-4a0d-bff8-362bbbe5cc6f tempest-AttachVolumeTestJSON-921065048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2967d4bb-2e39-434e-b29b-b866e896b581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:49:13 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-abb70dea-f4f7-4a0d-bff8-362bbbe5cc6f tempest-AttachVolumeTestJSON-921065048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2967d4bb-2e39-434e-b29b-b866e896b581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:49:13 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-abb70dea-f4f7-4a0d-bff8-362bbbe5cc6f tempest-AttachVolumeTestJSON-921065048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57e3772e-bea1-4c47-8a8a-dba4d76761e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:49:13 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-abb70dea-f4f7-4a0d-bff8-362bbbe5cc6f tempest-AttachVolumeTestJSON-921065048 None] Volume c3e5ebbb-2dea-45b0-bbff-7fcaf0394604: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3e5ebbb-2dea-45b0-bbff-7fcaf0394604', 'volume_size': 1} Sep 08 06:49:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-abb70dea-f4f7-4a0d-bff8-362bbbe5cc6f tempest-AttachVolumeTestJSON-921065048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:49:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-abb70dea-f4f7-4a0d-bff8-362bbbe5cc6f tempest-AttachVolumeTestJSON-921065048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:49:13 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-abb70dea-f4f7-4a0d-bff8-362bbbe5cc6f tempest-AttachVolumeTestJSON-921065048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:49:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1168841575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3e5ebbb-2dea-45b0-bbff-7fcaf0394604,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d24378ce46b49c998e4274f6641dc7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:49:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:49:13Z,use_quota=True,user_id='be05327e06eb4b9d9c691b01580cfdf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:49:13 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-abb70dea-f4f7-4a0d-bff8-362bbbe5cc6f tempest-AttachVolumeTestJSON-921065048 None] Creating volume c3e5ebbb-2dea-45b0-bbff-7fcaf0394604 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:49:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-abb70dea-f4f7-4a0d-bff8-362bbbe5cc6f tempest-AttachVolumeTestJSON-921065048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:49:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-abb70dea-f4f7-4a0d-bff8-362bbbe5cc6f tempest-AttachVolumeTestJSON-921065048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:49:13 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-abb70dea-f4f7-4a0d-bff8-362bbbe5cc6f tempest-AttachVolumeTestJSON-921065048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:49:13 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-abb70dea-f4f7-4a0d-bff8-362bbbe5cc6f tempest-AttachVolumeTestJSON-921065048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:49:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-abb70dea-f4f7-4a0d-bff8-362bbbe5cc6f tempest-AttachVolumeTestJSON-921065048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:49:13 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-abb70dea-f4f7-4a0d-bff8-362bbbe5cc6f tempest-AttachVolumeTestJSON-921065048 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:49:13 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-abb70dea-f4f7-4a0d-bff8-362bbbe5cc6f tempest-AttachVolumeTestJSON-921065048 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:49:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-abb70dea-f4f7-4a0d-bff8-362bbbe5cc6f tempest-AttachVolumeTestJSON-921065048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c3e5ebbb-2dea-45b0-bbff-7fcaf0394604 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:49:13 devstack sudo[97016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c3e5ebbb-2dea-45b0-bbff-7fcaf0394604 1073741824 Sep 08 06:49:13 devstack sudo[97016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:49:13 devstack sudo[97016]: pam_unix(sudo:session): session closed for user root Sep 08 06:49:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-abb70dea-f4f7-4a0d-bff8-362bbbe5cc6f tempest-AttachVolumeTestJSON-921065048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c3e5ebbb-2dea-45b0-bbff-7fcaf0394604 1073741824" returned: 0 in 0.624s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:49:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-abb70dea-f4f7-4a0d-bff8-362bbbe5cc6f tempest-AttachVolumeTestJSON-921065048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c3e5ebbb-2dea-45b0-bbff-7fcaf0394604 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:49:13 devstack sudo[97041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c3e5ebbb-2dea-45b0-bbff-7fcaf0394604 Sep 08 06:49:13 devstack sudo[97041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:49:14 devstack sudo[97041]: pam_unix(sudo:session): session closed for user root Sep 08 06:49:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-abb70dea-f4f7-4a0d-bff8-362bbbe5cc6f tempest-AttachVolumeTestJSON-921065048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c3e5ebbb-2dea-45b0-bbff-7fcaf0394604" returned: 0 in 0.308s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:49:14 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-abb70dea-f4f7-4a0d-bff8-362bbbe5cc6f tempest-AttachVolumeTestJSON-921065048 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:49:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-abb70dea-f4f7-4a0d-bff8-362bbbe5cc6f tempest-AttachVolumeTestJSON-921065048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:49:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-abb70dea-f4f7-4a0d-bff8-362bbbe5cc6f tempest-AttachVolumeTestJSON-921065048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57e3772e-bea1-4c47-8a8a-dba4d76761e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3e5ebbb-2dea-45b0-bbff-7fcaf0394604', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:49:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-abb70dea-f4f7-4a0d-bff8-362bbbe5cc6f tempest-AttachVolumeTestJSON-921065048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac99c39a-d982-494b-aadf-96f96c315ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:49:14 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-abb70dea-f4f7-4a0d-bff8-362bbbe5cc6f tempest-AttachVolumeTestJSON-921065048 None] Volume volume-c3e5ebbb-2dea-45b0-bbff-7fcaf0394604 (c3e5ebbb-2dea-45b0-bbff-7fcaf0394604): created successfully Sep 08 06:49:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-abb70dea-f4f7-4a0d-bff8-362bbbe5cc6f tempest-AttachVolumeTestJSON-921065048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac99c39a-d982-494b-aadf-96f96c315ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:49:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-abb70dea-f4f7-4a0d-bff8-362bbbe5cc6f tempest-AttachVolumeTestJSON-921065048 None] Flow 'volume_create_manager' (3969229b-faf2-472f-80b4-edf5542ebcb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:49:14 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-d76ca934-6e1e-441f-a7a1-4cde8f5c3d10 tempest-GroupsTest-1306337840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:49:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-d76ca934-6e1e-441f-a7a1-4cde8f5c3d10 tempest-GroupsTest-1306337840 None] Flow 'volume_create_manager' (9d0a5520-9310-4355-8c69-612e1c4df96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:49:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-d76ca934-6e1e-441f-a7a1-4cde8f5c3d10 tempest-GroupsTest-1306337840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b8bdbac-4dfc-4035-b8ba-5a3ebc55e2a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:49:14 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-abb70dea-f4f7-4a0d-bff8-362bbbe5cc6f tempest-AttachVolumeTestJSON-921065048 None] Created volume successfully. Sep 08 06:49:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-d76ca934-6e1e-441f-a7a1-4cde8f5c3d10 tempest-GroupsTest-1306337840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b8bdbac-4dfc-4035-b8ba-5a3ebc55e2a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:49:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-485688073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b7bf8b07-ffbe-4330-a937-5b219810763f,host='devstack@QuobyteHD#QuobyteHD',id=ad52986d-bae2-447f-a281-9c35cba208aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7c9268906d6435a94f5910658f68678',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:49:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:49:14Z,use_quota=True,user_id='e44cdcc75e4c40a48c36c0a7885c0bdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77ce1bc-323e-4394-a9a1-256009f356ab),volume_type_id=c77ce1bc-323e-4394-a9a1-256009f356ab)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:49:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-d76ca934-6e1e-441f-a7a1-4cde8f5c3d10 tempest-GroupsTest-1306337840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea89da88-902e-4724-ae7c-2693701ef050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:49:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-d76ca934-6e1e-441f-a7a1-4cde8f5c3d10 tempest-GroupsTest-1306337840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea89da88-902e-4724-ae7c-2693701ef050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:49:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-d76ca934-6e1e-441f-a7a1-4cde8f5c3d10 tempest-GroupsTest-1306337840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66df34e4-a992-4314-92bf-62d63835966a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:49:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-d76ca934-6e1e-441f-a7a1-4cde8f5c3d10 tempest-GroupsTest-1306337840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66df34e4-a992-4314-92bf-62d63835966a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad52986d-bae2-447f-a281-9c35cba208aa', 'volume_name': 'volume-ad52986d-bae2-447f-a281-9c35cba208aa', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:49:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-d76ca934-6e1e-441f-a7a1-4cde8f5c3d10 tempest-GroupsTest-1306337840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37f99d5f-a782-4560-bce5-1891cfd669c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:49:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-d76ca934-6e1e-441f-a7a1-4cde8f5c3d10 tempest-GroupsTest-1306337840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37f99d5f-a782-4560-bce5-1891cfd669c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:49:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-d76ca934-6e1e-441f-a7a1-4cde8f5c3d10 tempest-GroupsTest-1306337840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (620df6da-5720-43dc-b9f8-cb0ffca451fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:49:14 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-d76ca934-6e1e-441f-a7a1-4cde8f5c3d10 tempest-GroupsTest-1306337840 None] Volume ad52986d-bae2-447f-a281-9c35cba208aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad52986d-bae2-447f-a281-9c35cba208aa', 'volume_size': 1} Sep 08 06:49:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-d76ca934-6e1e-441f-a7a1-4cde8f5c3d10 tempest-GroupsTest-1306337840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:49:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-d76ca934-6e1e-441f-a7a1-4cde8f5c3d10 tempest-GroupsTest-1306337840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:49:14 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-d76ca934-6e1e-441f-a7a1-4cde8f5c3d10 tempest-GroupsTest-1306337840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b7bf8b07-ffbe-4330-a937-5b219810763f,created_at=2026-09-08T04:49:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-485688073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b7bf8b07-ffbe-4330-a937-5b219810763f,host='devstack@QuobyteHD#QuobyteHD',id=ad52986d-bae2-447f-a281-9c35cba208aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7c9268906d6435a94f5910658f68678',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:49:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:49:14Z,use_quota=True,user_id='e44cdcc75e4c40a48c36c0a7885c0bdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77ce1bc-323e-4394-a9a1-256009f356ab),volume_type_id=c77ce1bc-323e-4394-a9a1-256009f356ab)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:49:14 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-d76ca934-6e1e-441f-a7a1-4cde8f5c3d10 tempest-GroupsTest-1306337840 None] Creating volume ad52986d-bae2-447f-a281-9c35cba208aa {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:49:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-d76ca934-6e1e-441f-a7a1-4cde8f5c3d10 tempest-GroupsTest-1306337840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:49:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-d76ca934-6e1e-441f-a7a1-4cde8f5c3d10 tempest-GroupsTest-1306337840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:49:14 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-d76ca934-6e1e-441f-a7a1-4cde8f5c3d10 tempest-GroupsTest-1306337840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:49:14 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-d76ca934-6e1e-441f-a7a1-4cde8f5c3d10 tempest-GroupsTest-1306337840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:49:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-d76ca934-6e1e-441f-a7a1-4cde8f5c3d10 tempest-GroupsTest-1306337840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:49:14 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-d76ca934-6e1e-441f-a7a1-4cde8f5c3d10 tempest-GroupsTest-1306337840 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:49:14 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-d76ca934-6e1e-441f-a7a1-4cde8f5c3d10 tempest-GroupsTest-1306337840 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:49:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-d76ca934-6e1e-441f-a7a1-4cde8f5c3d10 tempest-GroupsTest-1306337840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ad52986d-bae2-447f-a281-9c35cba208aa 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:49:14 devstack sudo[97048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ad52986d-bae2-447f-a281-9c35cba208aa 1073741824 Sep 08 06:49:14 devstack sudo[97048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:49:14 devstack sudo[97048]: pam_unix(sudo:session): session closed for user root Sep 08 06:49:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-d76ca934-6e1e-441f-a7a1-4cde8f5c3d10 tempest-GroupsTest-1306337840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ad52986d-bae2-447f-a281-9c35cba208aa 1073741824" returned: 0 in 0.524s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:49:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-d76ca934-6e1e-441f-a7a1-4cde8f5c3d10 tempest-GroupsTest-1306337840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ad52986d-bae2-447f-a281-9c35cba208aa {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:49:14 devstack sudo[97055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ad52986d-bae2-447f-a281-9c35cba208aa Sep 08 06:49:14 devstack sudo[97055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:49:15 devstack sudo[97055]: pam_unix(sudo:session): session closed for user root Sep 08 06:49:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-d76ca934-6e1e-441f-a7a1-4cde8f5c3d10 tempest-GroupsTest-1306337840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ad52986d-bae2-447f-a281-9c35cba208aa" returned: 0 in 0.274s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:49:15 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-d76ca934-6e1e-441f-a7a1-4cde8f5c3d10 tempest-GroupsTest-1306337840 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:49:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-d76ca934-6e1e-441f-a7a1-4cde8f5c3d10 tempest-GroupsTest-1306337840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:49:15 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-d76ca934-6e1e-441f-a7a1-4cde8f5c3d10 tempest-GroupsTest-1306337840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (620df6da-5720-43dc-b9f8-cb0ffca451fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad52986d-bae2-447f-a281-9c35cba208aa', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:49:15 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-d76ca934-6e1e-441f-a7a1-4cde8f5c3d10 tempest-GroupsTest-1306337840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32bb6274-c4c6-40ff-909a-448cfc786661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:49:15 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-d76ca934-6e1e-441f-a7a1-4cde8f5c3d10 tempest-GroupsTest-1306337840 None] Volume volume-ad52986d-bae2-447f-a281-9c35cba208aa (ad52986d-bae2-447f-a281-9c35cba208aa): created successfully Sep 08 06:49:15 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-d76ca934-6e1e-441f-a7a1-4cde8f5c3d10 tempest-GroupsTest-1306337840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32bb6274-c4c6-40ff-909a-448cfc786661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:49:15 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-d76ca934-6e1e-441f-a7a1-4cde8f5c3d10 tempest-GroupsTest-1306337840 None] Flow 'volume_create_manager' (9d0a5520-9310-4355-8c69-612e1c4df96b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:49:15 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-d76ca934-6e1e-441f-a7a1-4cde8f5c3d10 tempest-GroupsTest-1306337840 None] Created volume successfully. Sep 08 06:49:15 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-3324b8ce-8123-42de-b404-171241383ad3 req-50889200-ddc6-4682-a6f2-5583ca229de1 tempest-AttachVolumeShelveTestJSON-842071274 None] No connector for attachment 6165f44f-67f0-4e3b-ab2b-82bb30d808fd; skipping storage backend terminate_connection call. {{(pid=87507) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 08 06:49:15 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-3324b8ce-8123-42de-b404-171241383ad3 req-50889200-ddc6-4682-a6f2-5583ca229de1 tempest-AttachVolumeShelveTestJSON-842071274 None] Deleting attachment 6165f44f-67f0-4e3b-ab2b-82bb30d808fd. {{(pid=87507) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 06:49:16 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa35a9af-ad9f-45db-8b10-310eb2ce18da tempest-GroupsTest-1306337840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:49:16 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-aa35a9af-ad9f-45db-8b10-310eb2ce18da tempest-GroupsTest-1306337840 None] Flow 'volume_create_manager' (7f5f234a-0213-4e83-9d5c-a39d96c7de8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:49:16 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-aa35a9af-ad9f-45db-8b10-310eb2ce18da tempest-GroupsTest-1306337840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea8c5f09-95c1-47b5-aa86-3f8f52c4cdd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:49:16 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-aa35a9af-ad9f-45db-8b10-310eb2ce18da tempest-GroupsTest-1306337840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea8c5f09-95c1-47b5-aa86-3f8f52c4cdd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:49:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1243016624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b7bf8b07-ffbe-4330-a937-5b219810763f,host='devstack@QuobyteHD#QuobyteHD',id=5ea0f439-1735-496b-b0f5-98131f94d45f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7c9268906d6435a94f5910658f68678',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:49:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:49:16Z,use_quota=True,user_id='e44cdcc75e4c40a48c36c0a7885c0bdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77ce1bc-323e-4394-a9a1-256009f356ab),volume_type_id=c77ce1bc-323e-4394-a9a1-256009f356ab)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:49:16 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-aa35a9af-ad9f-45db-8b10-310eb2ce18da tempest-GroupsTest-1306337840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb75b5a9-81a4-43c1-853d-925d975e950d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:49:16 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-aa35a9af-ad9f-45db-8b10-310eb2ce18da tempest-GroupsTest-1306337840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb75b5a9-81a4-43c1-853d-925d975e950d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:49:16 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-aa35a9af-ad9f-45db-8b10-310eb2ce18da tempest-GroupsTest-1306337840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4f7ef41-496a-4f45-b7f0-01968b95949d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:49:16 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-aa35a9af-ad9f-45db-8b10-310eb2ce18da tempest-GroupsTest-1306337840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4f7ef41-496a-4f45-b7f0-01968b95949d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ea0f439-1735-496b-b0f5-98131f94d45f', 'volume_name': 'volume-5ea0f439-1735-496b-b0f5-98131f94d45f', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:49:16 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-aa35a9af-ad9f-45db-8b10-310eb2ce18da tempest-GroupsTest-1306337840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (744f3a3a-b407-4f9b-8e10-3ee9ec8f0863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:49:16 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-aa35a9af-ad9f-45db-8b10-310eb2ce18da tempest-GroupsTest-1306337840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (744f3a3a-b407-4f9b-8e10-3ee9ec8f0863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:49:16 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-aa35a9af-ad9f-45db-8b10-310eb2ce18da tempest-GroupsTest-1306337840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93134de9-8997-449b-b235-5a78c7826c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:49:16 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-aa35a9af-ad9f-45db-8b10-310eb2ce18da tempest-GroupsTest-1306337840 None] Volume 5ea0f439-1735-496b-b0f5-98131f94d45f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ea0f439-1735-496b-b0f5-98131f94d45f', 'volume_size': 1} Sep 08 06:49:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-aa35a9af-ad9f-45db-8b10-310eb2ce18da tempest-GroupsTest-1306337840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:49:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-aa35a9af-ad9f-45db-8b10-310eb2ce18da tempest-GroupsTest-1306337840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:49:16 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-aa35a9af-ad9f-45db-8b10-310eb2ce18da tempest-GroupsTest-1306337840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b7bf8b07-ffbe-4330-a937-5b219810763f,created_at=2026-09-08T04:49:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1243016624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b7bf8b07-ffbe-4330-a937-5b219810763f,host='devstack@QuobyteHD#QuobyteHD',id=5ea0f439-1735-496b-b0f5-98131f94d45f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7c9268906d6435a94f5910658f68678',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:49:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:49:16Z,use_quota=True,user_id='e44cdcc75e4c40a48c36c0a7885c0bdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77ce1bc-323e-4394-a9a1-256009f356ab),volume_type_id=c77ce1bc-323e-4394-a9a1-256009f356ab)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:49:16 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-aa35a9af-ad9f-45db-8b10-310eb2ce18da tempest-GroupsTest-1306337840 None] Creating volume 5ea0f439-1735-496b-b0f5-98131f94d45f {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:49:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-aa35a9af-ad9f-45db-8b10-310eb2ce18da tempest-GroupsTest-1306337840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:49:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-aa35a9af-ad9f-45db-8b10-310eb2ce18da tempest-GroupsTest-1306337840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:49:16 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-aa35a9af-ad9f-45db-8b10-310eb2ce18da tempest-GroupsTest-1306337840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:49:16 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-aa35a9af-ad9f-45db-8b10-310eb2ce18da tempest-GroupsTest-1306337840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:49:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-aa35a9af-ad9f-45db-8b10-310eb2ce18da tempest-GroupsTest-1306337840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:49:16 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-aa35a9af-ad9f-45db-8b10-310eb2ce18da tempest-GroupsTest-1306337840 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:49:16 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-aa35a9af-ad9f-45db-8b10-310eb2ce18da tempest-GroupsTest-1306337840 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:49:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-aa35a9af-ad9f-45db-8b10-310eb2ce18da tempest-GroupsTest-1306337840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5ea0f439-1735-496b-b0f5-98131f94d45f 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:49:16 devstack sudo[97065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5ea0f439-1735-496b-b0f5-98131f94d45f 1073741824 Sep 08 06:49:16 devstack sudo[97065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:49:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-e24b97aa-dbfc-474e-b502-53ec70849f7b req-faf12c48-aa34-4145-a4d7-ddd5ceb43fe4 tempest-AttachVolumeTestJSON-921065048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:49:17 devstack sudo[97065]: pam_unix(sudo:session): session closed for user root Sep 08 06:49:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-aa35a9af-ad9f-45db-8b10-310eb2ce18da tempest-GroupsTest-1306337840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5ea0f439-1735-496b-b0f5-98131f94d45f 1073741824" returned: 0 in 0.727s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:49:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-aa35a9af-ad9f-45db-8b10-310eb2ce18da tempest-GroupsTest-1306337840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5ea0f439-1735-496b-b0f5-98131f94d45f {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:49:17 devstack sudo[97081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5ea0f439-1735-496b-b0f5-98131f94d45f Sep 08 06:49:17 devstack sudo[97081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:49:17 devstack sudo[97081]: pam_unix(sudo:session): session closed for user root Sep 08 06:49:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-aa35a9af-ad9f-45db-8b10-310eb2ce18da tempest-GroupsTest-1306337840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5ea0f439-1735-496b-b0f5-98131f94d45f" returned: 0 in 0.383s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:49:17 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-aa35a9af-ad9f-45db-8b10-310eb2ce18da tempest-GroupsTest-1306337840 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:49:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-aa35a9af-ad9f-45db-8b10-310eb2ce18da tempest-GroupsTest-1306337840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:49:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-e24b97aa-dbfc-474e-b502-53ec70849f7b req-faf12c48-aa34-4145-a4d7-ddd5ceb43fe4 tempest-AttachVolumeTestJSON-921065048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.685s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:49:17 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-aa35a9af-ad9f-45db-8b10-310eb2ce18da tempest-GroupsTest-1306337840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93134de9-8997-449b-b235-5a78c7826c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ea0f439-1735-496b-b0f5-98131f94d45f', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:49:17 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-aa35a9af-ad9f-45db-8b10-310eb2ce18da tempest-GroupsTest-1306337840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01249ec6-3e61-40a8-8f24-7c41a694b6e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:49:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-e24b97aa-dbfc-474e-b502-53ec70849f7b req-faf12c48-aa34-4145-a4d7-ddd5ceb43fe4 tempest-AttachVolumeTestJSON-921065048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.078s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:49:17 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-aa35a9af-ad9f-45db-8b10-310eb2ce18da tempest-GroupsTest-1306337840 None] Volume volume-5ea0f439-1735-496b-b0f5-98131f94d45f (5ea0f439-1735-496b-b0f5-98131f94d45f): created successfully Sep 08 06:49:17 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-aa35a9af-ad9f-45db-8b10-310eb2ce18da tempest-GroupsTest-1306337840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01249ec6-3e61-40a8-8f24-7c41a694b6e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:49:17 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-aa35a9af-ad9f-45db-8b10-310eb2ce18da tempest-GroupsTest-1306337840 None] Flow 'volume_create_manager' (7f5f234a-0213-4e83-9d5c-a39d96c7de8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:49:17 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-aa35a9af-ad9f-45db-8b10-310eb2ce18da tempest-GroupsTest-1306337840 None] Created volume successfully. Sep 08 06:49:17 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-e24b97aa-dbfc-474e-b502-53ec70849f7b req-faf12c48-aa34-4145-a4d7-ddd5ceb43fe4 tempest-AttachVolumeTestJSON-921065048 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d', 'name': 'volume-c3e5ebbb-2dea-45b0-bbff-7fcaf0394604', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cab03562-4384-4cef-becd-692d975f779a', 'enforce_multipath': True} {{(pid=87507) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 06:49:17 devstack cinder-volume[87507]: INFO cinder.volume.manager [req-e24b97aa-dbfc-474e-b502-53ec70849f7b req-faf12c48-aa34-4145-a4d7-ddd5ceb43fe4 tempest-AttachVolumeTestJSON-921065048 None] attachment_update completed successfully. Sep 08 06:49:18 devstack cinder-volume[87507]: INFO cinder.volume.manager [req-d346ded1-1383-456c-8dc8-b55bfc95566d req-cf986d40-343f-43f1-8f25-ef78fc139cb1 tempest-TestMinimumBasicScenario-251746191 None] Terminate volume connection completed successfully. Sep 08 06:49:18 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-d346ded1-1383-456c-8dc8-b55bfc95566d req-cf986d40-343f-43f1-8f25-ef78fc139cb1 tempest-TestMinimumBasicScenario-251746191 None] Deleting attachment f111a531-41ae-47f6-801d-7a678f2ef3c5. {{(pid=87507) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 06:49:18 devstack cinder-volume[87507]: INFO cinder.volume.manager [req-e24b97aa-dbfc-474e-b502-53ec70849f7b req-edf1ff31-980d-489e-bb6d-ac5ee7ad8b8c tempest-AttachVolumeTestJSON-921065048 None] Terminate volume connection completed successfully. Sep 08 06:49:18 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-e24b97aa-dbfc-474e-b502-53ec70849f7b req-edf1ff31-980d-489e-bb6d-ac5ee7ad8b8c tempest-AttachVolumeTestJSON-921065048 None] Deleting attachment cab03562-4384-4cef-becd-692d975f779a. {{(pid=87507) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 06:49:18 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-621f42d5-0af1-4c0d-9f43-ec64d86786d3 tempest-TestMinimumBasicScenario-251746191 None] Acquiring lock "cinder-32dfdd20-d80c-4b10-ab03-dc6ad578d7b1-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:49:18 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-621f42d5-0af1-4c0d-9f43-ec64d86786d3 tempest-TestMinimumBasicScenario-251746191 None] Lock "cinder-32dfdd20-d80c-4b10-ab03-dc6ad578d7b1-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:49:18 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-621f42d5-0af1-4c0d-9f43-ec64d86786d3 tempest-TestMinimumBasicScenario-251746191 None] Acquiring lock "cinder-quobyte-32dfdd20-d80c-4b10-ab03-dc6ad578d7b1" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:49:18 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-621f42d5-0af1-4c0d-9f43-ec64d86786d3 tempest-TestMinimumBasicScenario-251746191 None] Lock "cinder-quobyte-32dfdd20-d80c-4b10-ab03-dc6ad578d7b1" acquired by "delete_volume" :: waited 0.021s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:49:19 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c575161d-2170-4cc2-8759-0d8ef904673f]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:49:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-621f42d5-0af1-4c0d-9f43-ec64d86786d3 tempest-TestMinimumBasicScenario-251746191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-32dfdd20-d80c-4b10-ab03-dc6ad578d7b1 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:49:19 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-f44a16a5-d660-4ce4-bf08-a7a01a36987b tempest-GroupsTest-1306337840 None] Update group completed successfully. Sep 08 06:49:19 devstack sudo[97125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-32dfdd20-d80c-4b10-ab03-dc6ad578d7b1 Sep 08 06:49:19 devstack sudo[97125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:49:19 devstack sudo[97125]: pam_unix(sudo:session): session closed for user root Sep 08 06:49:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-621f42d5-0af1-4c0d-9f43-ec64d86786d3 tempest-TestMinimumBasicScenario-251746191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-32dfdd20-d80c-4b10-ab03-dc6ad578d7b1" returned: 0 in 0.441s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:49:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-621f42d5-0af1-4c0d-9f43-ec64d86786d3 tempest-TestMinimumBasicScenario-251746191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-32dfdd20-d80c-4b10-ab03-dc6ad578d7b1 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:49:19 devstack sudo[97131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-32dfdd20-d80c-4b10-ab03-dc6ad578d7b1 Sep 08 06:49:19 devstack sudo[97131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:49:19 devstack sudo[97131]: pam_unix(sudo:session): session closed for user root Sep 08 06:49:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-621f42d5-0af1-4c0d-9f43-ec64d86786d3 tempest-TestMinimumBasicScenario-251746191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-32dfdd20-d80c-4b10-ab03-dc6ad578d7b1" returned: 0 in 0.261s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:49:19 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-621f42d5-0af1-4c0d-9f43-ec64d86786d3 tempest-TestMinimumBasicScenario-251746191 None] Lock "cinder-quobyte-32dfdd20-d80c-4b10-ab03-dc6ad578d7b1" released by "delete_volume" :: held 0.767s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:49:19 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-621f42d5-0af1-4c0d-9f43-ec64d86786d3 tempest-TestMinimumBasicScenario-251746191 None] Created reservations ['c30af258-981c-460a-bf55-84ddcd8a7a52', '14bc8f17-af10-4d44-8182-35df2b845efc', '5b815af4-0d77-4def-933c-1ffd5a1dab7c', '67ef246c-3895-4881-8e9e-2fa46b2ff319'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:49:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-621f42d5-0af1-4c0d-9f43-ec64d86786d3 tempest-TestMinimumBasicScenario-251746191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:49:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-621f42d5-0af1-4c0d-9f43-ec64d86786d3 tempest-TestMinimumBasicScenario-251746191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:49:19 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-621f42d5-0af1-4c0d-9f43-ec64d86786d3 tempest-TestMinimumBasicScenario-251746191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:49:19 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-621f42d5-0af1-4c0d-9f43-ec64d86786d3 tempest-TestMinimumBasicScenario-251746191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:49:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-621f42d5-0af1-4c0d-9f43-ec64d86786d3 tempest-TestMinimumBasicScenario-251746191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:49:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-621f42d5-0af1-4c0d-9f43-ec64d86786d3 tempest-TestMinimumBasicScenario-251746191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:49:19 devstack sudo[97134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:49:19 devstack sudo[97134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:49:20 devstack cinder-volume[87507]: DEBUG oslo_service.periodic_task [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87507) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 06:49:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:49:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:49:20 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:49:20 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:49:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:49:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:49:20 devstack sudo[97136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:49:20 devstack sudo[97136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:49:20 devstack sudo[97134]: pam_unix(sudo:session): session closed for user root Sep 08 06:49:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-621f42d5-0af1-4c0d-9f43-ec64d86786d3 tempest-TestMinimumBasicScenario-251746191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.378s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:49:20 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-621f42d5-0af1-4c0d-9f43-ec64d86786d3 tempest-TestMinimumBasicScenario-251746191 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:49:20 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-621f42d5-0af1-4c0d-9f43-ec64d86786d3 tempest-TestMinimumBasicScenario-251746191 None] Deleted volume successfully. Sep 08 06:49:20 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-621f42d5-0af1-4c0d-9f43-ec64d86786d3 tempest-TestMinimumBasicScenario-251746191 None] Lock "cinder-32dfdd20-d80c-4b10-ab03-dc6ad578d7b1-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:49:20 devstack sudo[97136]: pam_unix(sudo:session): session closed for user root Sep 08 06:49:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.491s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:49:20 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:49:20 devstack cinder-volume[87507]: DEBUG oslo_service.periodic_task [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Running periodic task VolumeManager._thread_info {{(pid=87507) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 06:49:20 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] thread count: 29 {{(pid=87507) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 06:49:20 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] thread info: [<_MainThread(MainThread, started 127913129345152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87507) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 06:49:21 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-d421de4c-b58b-45c0-88bc-44a8184a7629 tempest-GroupsTest-1306337840 None] Update group completed successfully. Sep 08 06:49:22 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-daa9e94a-b173-4360-abb0-bb5769e7da8d tempest-GroupsTest-1306337840 None] Acquiring lock "cinder-quobyte-5ea0f439-1735-496b-b0f5-98131f94d45f" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:49:22 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-daa9e94a-b173-4360-abb0-bb5769e7da8d tempest-GroupsTest-1306337840 None] Lock "cinder-quobyte-5ea0f439-1735-496b-b0f5-98131f94d45f" acquired by "delete_volume" :: waited 0.024s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:49:22 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[201ac517-b85a-4966-a172-e8770d4e84fb]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:49:22 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-daa9e94a-b173-4360-abb0-bb5769e7da8d tempest-GroupsTest-1306337840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5ea0f439-1735-496b-b0f5-98131f94d45f {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:49:23 devstack sudo[97174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5ea0f439-1735-496b-b0f5-98131f94d45f Sep 08 06:49:23 devstack sudo[97174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:49:23 devstack sudo[97174]: pam_unix(sudo:session): session closed for user root Sep 08 06:49:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-daa9e94a-b173-4360-abb0-bb5769e7da8d tempest-GroupsTest-1306337840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5ea0f439-1735-496b-b0f5-98131f94d45f" returned: 0 in 0.446s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:49:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-daa9e94a-b173-4360-abb0-bb5769e7da8d tempest-GroupsTest-1306337840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5ea0f439-1735-496b-b0f5-98131f94d45f {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:49:23 devstack sudo[97190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5ea0f439-1735-496b-b0f5-98131f94d45f Sep 08 06:49:23 devstack sudo[97190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:49:23 devstack sudo[97190]: pam_unix(sudo:session): session closed for user root Sep 08 06:49:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-daa9e94a-b173-4360-abb0-bb5769e7da8d tempest-GroupsTest-1306337840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5ea0f439-1735-496b-b0f5-98131f94d45f" returned: 0 in 0.275s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:49:23 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-daa9e94a-b173-4360-abb0-bb5769e7da8d tempest-GroupsTest-1306337840 None] Lock "cinder-quobyte-5ea0f439-1735-496b-b0f5-98131f94d45f" released by "delete_volume" :: held 0.772s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:49:23 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-daa9e94a-b173-4360-abb0-bb5769e7da8d tempest-GroupsTest-1306337840 None] Acquiring lock "cinder-quobyte-ad52986d-bae2-447f-a281-9c35cba208aa" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:49:23 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-daa9e94a-b173-4360-abb0-bb5769e7da8d tempest-GroupsTest-1306337840 None] Lock "cinder-quobyte-ad52986d-bae2-447f-a281-9c35cba208aa" acquired by "delete_volume" :: waited 0.014s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:49:23 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b387933-dff2-40bf-b9ee-744befb04a9f]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:49:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-daa9e94a-b173-4360-abb0-bb5769e7da8d tempest-GroupsTest-1306337840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ad52986d-bae2-447f-a281-9c35cba208aa {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:49:23 devstack sudo[97199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ad52986d-bae2-447f-a281-9c35cba208aa Sep 08 06:49:23 devstack sudo[97199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:49:24 devstack sudo[97199]: pam_unix(sudo:session): session closed for user root Sep 08 06:49:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-daa9e94a-b173-4360-abb0-bb5769e7da8d tempest-GroupsTest-1306337840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ad52986d-bae2-447f-a281-9c35cba208aa" returned: 0 in 0.429s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:49:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-daa9e94a-b173-4360-abb0-bb5769e7da8d tempest-GroupsTest-1306337840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ad52986d-bae2-447f-a281-9c35cba208aa {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:49:24 devstack sudo[97210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ad52986d-bae2-447f-a281-9c35cba208aa Sep 08 06:49:24 devstack sudo[97210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:49:24 devstack sudo[97210]: pam_unix(sudo:session): session closed for user root Sep 08 06:49:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-daa9e94a-b173-4360-abb0-bb5769e7da8d tempest-GroupsTest-1306337840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ad52986d-bae2-447f-a281-9c35cba208aa" returned: 0 in 0.273s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:49:24 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-daa9e94a-b173-4360-abb0-bb5769e7da8d tempest-GroupsTest-1306337840 None] Lock "cinder-quobyte-ad52986d-bae2-447f-a281-9c35cba208aa" released by "delete_volume" :: held 0.754s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:49:24 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-daa9e94a-b173-4360-abb0-bb5769e7da8d tempest-GroupsTest-1306337840 None] Created reservations ['fa5d0e81-a3e3-43bc-9698-2eaf791a61a5'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:49:24 devstack cinder-volume[87507]: WARNING cinder.quota [None req-daa9e94a-b173-4360-abb0-bb5769e7da8d tempest-GroupsTest-1306337840 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-612796919 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-612796919, it is now deprecated. Please use the default quota class for default quota. Sep 08 06:49:24 devstack cinder-volume[87507]: WARNING cinder.quota [None req-daa9e94a-b173-4360-abb0-bb5769e7da8d tempest-GroupsTest-1306337840 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-612796919 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-612796919, it is now deprecated. Please use the default quota class for default quota. Sep 08 06:49:24 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-daa9e94a-b173-4360-abb0-bb5769e7da8d tempest-GroupsTest-1306337840 None] Created reservations ['50d67781-ae53-436a-9c5b-6cce659625c5', 'b82b4eef-9e68-4d8b-b260-5aca9951ff92', 'b16c6b7d-7f8e-4e36-88e2-df4fbed7ddbb', '7c005514-550b-4b19-b6a3-9c050072a798'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:49:24 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-daa9e94a-b173-4360-abb0-bb5769e7da8d tempest-GroupsTest-1306337840 None] Created reservations ['1c9afdda-be27-4b6e-883f-61c14bd3dcd4', '6144ef3f-60d1-4b7b-9ab6-8d62d23a5ace', '21ffaed9-e32f-4c36-82b4-aa67f7b2283e', 'ed9c51da-bc53-492d-a3f8-6285ed4422ee'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:49:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-daa9e94a-b173-4360-abb0-bb5769e7da8d tempest-GroupsTest-1306337840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:49:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-daa9e94a-b173-4360-abb0-bb5769e7da8d tempest-GroupsTest-1306337840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:49:24 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-daa9e94a-b173-4360-abb0-bb5769e7da8d tempest-GroupsTest-1306337840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:49:24 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-daa9e94a-b173-4360-abb0-bb5769e7da8d tempest-GroupsTest-1306337840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:49:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-daa9e94a-b173-4360-abb0-bb5769e7da8d tempest-GroupsTest-1306337840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:49:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-daa9e94a-b173-4360-abb0-bb5769e7da8d tempest-GroupsTest-1306337840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:49:24 devstack sudo[97213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:49:24 devstack sudo[97213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:49:25 devstack sudo[97213]: pam_unix(sudo:session): session closed for user root Sep 08 06:49:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-daa9e94a-b173-4360-abb0-bb5769e7da8d tempest-GroupsTest-1306337840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.276s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:49:25 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-daa9e94a-b173-4360-abb0-bb5769e7da8d tempest-GroupsTest-1306337840 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:49:25 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-daa9e94a-b173-4360-abb0-bb5769e7da8d tempest-GroupsTest-1306337840 None] Delete group completed successfully. Sep 08 06:49:33 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-58c57c3f-3c1e-4cf5-a5cb-f6c0d24ce534 tempest-GroupsV320Test-358976297 None] Group tempest-GroupsV320Test-Group-393982848: creating Sep 08 06:49:33 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-58c57c3f-3c1e-4cf5-a5cb-f6c0d24ce534 tempest-GroupsV320Test-358976297 None] Group tempest-GroupsV320Test-Group-393982848: created successfully Sep 08 06:49:33 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-58c57c3f-3c1e-4cf5-a5cb-f6c0d24ce534 tempest-GroupsV320Test-358976297 None] Create group completed successfully. Sep 08 06:49:35 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-627f54b3-cd51-460c-a741-bdebbb3b4df0 tempest-GroupsV320Test-358976297 None] Created reservations ['69034d75-f645-4d52-b0c2-1ed501da0e20'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:49:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-627f54b3-cd51-460c-a741-bdebbb3b4df0 tempest-GroupsV320Test-358976297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:49:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-627f54b3-cd51-460c-a741-bdebbb3b4df0 tempest-GroupsV320Test-358976297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:49:35 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-627f54b3-cd51-460c-a741-bdebbb3b4df0 tempest-GroupsV320Test-358976297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:49:35 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-627f54b3-cd51-460c-a741-bdebbb3b4df0 tempest-GroupsV320Test-358976297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:49:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-627f54b3-cd51-460c-a741-bdebbb3b4df0 tempest-GroupsV320Test-358976297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:49:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-627f54b3-cd51-460c-a741-bdebbb3b4df0 tempest-GroupsV320Test-358976297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:49:35 devstack sudo[97296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:49:35 devstack sudo[97296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:49:35 devstack sudo[97296]: pam_unix(sudo:session): session closed for user root Sep 08 06:49:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-627f54b3-cd51-460c-a741-bdebbb3b4df0 tempest-GroupsV320Test-358976297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.441s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:49:35 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-627f54b3-cd51-460c-a741-bdebbb3b4df0 tempest-GroupsV320Test-358976297 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:49:35 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-627f54b3-cd51-460c-a741-bdebbb3b4df0 tempest-GroupsV320Test-358976297 None] Delete group completed successfully. Sep 08 06:49:43 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-eba5608b-8839-4387-8ec9-60250452be2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:49:43 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-eba5608b-8839-4387-8ec9-60250452be2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Flow 'volume_create_manager' (b8696b27-c77d-4ca6-82ed-4e5ab8a5a1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:49:43 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-eba5608b-8839-4387-8ec9-60250452be2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a62b06f-7234-46d4-9e42-4db0ace1abc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:49:43 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-eba5608b-8839-4387-8ec9-60250452be2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a62b06f-7234-46d4-9e42-4db0ace1abc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:49:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1215831252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f37bffb-075c-4963-8417-021911addce5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5072e867440943af9567472bff133dfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:49:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:49:43Z,use_quota=True,user_id='ca0d40c15ace48289ab7121c67a15fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:49:43 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-eba5608b-8839-4387-8ec9-60250452be2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5e92e63-0e1f-478c-9702-559f6fa7c7da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:49:43 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-eba5608b-8839-4387-8ec9-60250452be2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5e92e63-0e1f-478c-9702-559f6fa7c7da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:49:43 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-eba5608b-8839-4387-8ec9-60250452be2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8647006-5844-4cd7-844d-d2ca6e31528c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:49:43 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-eba5608b-8839-4387-8ec9-60250452be2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8647006-5844-4cd7-844d-d2ca6e31528c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f37bffb-075c-4963-8417-021911addce5', 'volume_name': 'volume-7f37bffb-075c-4963-8417-021911addce5', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:49:43 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-eba5608b-8839-4387-8ec9-60250452be2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02c3197a-e001-42f5-9922-63b762d13d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:49:43 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-eba5608b-8839-4387-8ec9-60250452be2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02c3197a-e001-42f5-9922-63b762d13d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:49:43 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-eba5608b-8839-4387-8ec9-60250452be2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81b3c271-f1d2-4db3-92af-9544e432fcc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:49:43 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-eba5608b-8839-4387-8ec9-60250452be2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Volume 7f37bffb-075c-4963-8417-021911addce5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f37bffb-075c-4963-8417-021911addce5', 'volume_size': 1} Sep 08 06:49:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-eba5608b-8839-4387-8ec9-60250452be2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:49:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-eba5608b-8839-4387-8ec9-60250452be2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:49:43 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-eba5608b-8839-4387-8ec9-60250452be2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:49:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1215831252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f37bffb-075c-4963-8417-021911addce5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5072e867440943af9567472bff133dfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:49:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:49:43Z,use_quota=True,user_id='ca0d40c15ace48289ab7121c67a15fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:49:43 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-eba5608b-8839-4387-8ec9-60250452be2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Creating volume 7f37bffb-075c-4963-8417-021911addce5 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:49:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-eba5608b-8839-4387-8ec9-60250452be2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:49:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-eba5608b-8839-4387-8ec9-60250452be2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:49:43 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-eba5608b-8839-4387-8ec9-60250452be2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:49:43 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-eba5608b-8839-4387-8ec9-60250452be2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:49:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-eba5608b-8839-4387-8ec9-60250452be2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:49:43 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-eba5608b-8839-4387-8ec9-60250452be2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:49:43 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-eba5608b-8839-4387-8ec9-60250452be2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:49:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-eba5608b-8839-4387-8ec9-60250452be2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7f37bffb-075c-4963-8417-021911addce5 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:49:43 devstack sudo[97302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7f37bffb-075c-4963-8417-021911addce5 1073741824 Sep 08 06:49:43 devstack sudo[97302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:49:44 devstack sudo[97302]: pam_unix(sudo:session): session closed for user root Sep 08 06:49:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-eba5608b-8839-4387-8ec9-60250452be2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7f37bffb-075c-4963-8417-021911addce5 1073741824" returned: 0 in 0.433s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:49:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-eba5608b-8839-4387-8ec9-60250452be2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7f37bffb-075c-4963-8417-021911addce5 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:49:44 devstack sudo[97308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7f37bffb-075c-4963-8417-021911addce5 Sep 08 06:49:44 devstack sudo[97308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:49:44 devstack sudo[97308]: pam_unix(sudo:session): session closed for user root Sep 08 06:49:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-eba5608b-8839-4387-8ec9-60250452be2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7f37bffb-075c-4963-8417-021911addce5" returned: 0 in 0.253s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:49:44 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-eba5608b-8839-4387-8ec9-60250452be2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:49:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-eba5608b-8839-4387-8ec9-60250452be2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:49:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-eba5608b-8839-4387-8ec9-60250452be2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81b3c271-f1d2-4db3-92af-9544e432fcc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f37bffb-075c-4963-8417-021911addce5', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:49:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-eba5608b-8839-4387-8ec9-60250452be2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d3a0ace-beee-4b87-9f8f-07ed4ccb97e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:49:44 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-eba5608b-8839-4387-8ec9-60250452be2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Volume volume-7f37bffb-075c-4963-8417-021911addce5 (7f37bffb-075c-4963-8417-021911addce5): created successfully Sep 08 06:49:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-eba5608b-8839-4387-8ec9-60250452be2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d3a0ace-beee-4b87-9f8f-07ed4ccb97e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:49:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-eba5608b-8839-4387-8ec9-60250452be2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Flow 'volume_create_manager' (b8696b27-c77d-4ca6-82ed-4e5ab8a5a1dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:49:44 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-eba5608b-8839-4387-8ec9-60250452be2f tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Created volume successfully. Sep 08 06:49:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-ec4e3c8b-2f59-454b-b644-3d53dcad63b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:49:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-ec4e3c8b-2f59-454b-b644-3d53dcad63b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:49:44 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-ec4e3c8b-2f59-454b-b644-3d53dcad63b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Creating offline snapshot 71b7a5d6-7326-4d42-a626-b253d460865a of volume 7f37bffb-075c-4963-8417-021911addce5 {{(pid=87507) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 06:49:44 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7b53ab-3321-4cfc-9bcc-bc057b3675d7]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:49:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ec4e3c8b-2f59-454b-b644-3d53dcad63b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7f37bffb-075c-4963-8417-021911addce5 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:49:44 devstack sudo[97311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7f37bffb-075c-4963-8417-021911addce5 Sep 08 06:49:44 devstack sudo[97311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:49:45 devstack sudo[97311]: pam_unix(sudo:session): session closed for user root Sep 08 06:49:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ec4e3c8b-2f59-454b-b644-3d53dcad63b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7f37bffb-075c-4963-8417-021911addce5" returned: 0 in 0.373s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:49:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ec4e3c8b-2f59-454b-b644-3d53dcad63b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7f37bffb-075c-4963-8417-021911addce5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7f37bffb-075c-4963-8417-021911addce5.71b7a5d6-7326-4d42-a626-b253d460865a 1G {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:49:45 devstack sudo[97317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7f37bffb-075c-4963-8417-021911addce5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7f37bffb-075c-4963-8417-021911addce5.71b7a5d6-7326-4d42-a626-b253d460865a 1G Sep 08 06:49:45 devstack sudo[97317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:49:45 devstack sudo[97317]: pam_unix(sudo:session): session closed for user root Sep 08 06:49:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ec4e3c8b-2f59-454b-b644-3d53dcad63b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7f37bffb-075c-4963-8417-021911addce5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7f37bffb-075c-4963-8417-021911addce5.71b7a5d6-7326-4d42-a626-b253d460865a 1G" returned: 0 in 0.457s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:49:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ec4e3c8b-2f59-454b-b644-3d53dcad63b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f37bffb-075c-4963-8417-021911addce5 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7f37bffb-075c-4963-8417-021911addce5.71b7a5d6-7326-4d42-a626-b253d460865a {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:49:45 devstack sudo[97323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f37bffb-075c-4963-8417-021911addce5 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7f37bffb-075c-4963-8417-021911addce5.71b7a5d6-7326-4d42-a626-b253d460865a Sep 08 06:49:45 devstack sudo[97323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:49:45 devstack sudo[97323]: pam_unix(sudo:session): session closed for user root Sep 08 06:49:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ec4e3c8b-2f59-454b-b644-3d53dcad63b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f37bffb-075c-4963-8417-021911addce5 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7f37bffb-075c-4963-8417-021911addce5.71b7a5d6-7326-4d42-a626-b253d460865a" returned: 0 in 0.326s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:49:45 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-ec4e3c8b-2f59-454b-b644-3d53dcad63b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7f37bffb-075c-4963-8417-021911addce5.71b7a5d6-7326-4d42-a626-b253d460865a is being set with open permissions: ugo+rw Sep 08 06:49:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ec4e3c8b-2f59-454b-b644-3d53dcad63b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7f37bffb-075c-4963-8417-021911addce5.71b7a5d6-7326-4d42-a626-b253d460865a {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:49:45 devstack sudo[97328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7f37bffb-075c-4963-8417-021911addce5.71b7a5d6-7326-4d42-a626-b253d460865a Sep 08 06:49:45 devstack sudo[97328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:49:46 devstack sudo[97328]: pam_unix(sudo:session): session closed for user root Sep 08 06:49:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ec4e3c8b-2f59-454b-b644-3d53dcad63b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7f37bffb-075c-4963-8417-021911addce5.71b7a5d6-7326-4d42-a626-b253d460865a" returned: 0 in 0.265s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:49:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ec4e3c8b-2f59-454b-b644-3d53dcad63b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7f37bffb-075c-4963-8417-021911addce5.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:49:46 devstack sudo[97331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7f37bffb-075c-4963-8417-021911addce5.info Sep 08 06:49:46 devstack sudo[97331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:49:46 devstack sudo[97331]: pam_unix(sudo:session): session closed for user root Sep 08 06:49:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ec4e3c8b-2f59-454b-b644-3d53dcad63b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7f37bffb-075c-4963-8417-021911addce5.info" returned: 0 in 0.290s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:49:46 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-ec4e3c8b-2f59-454b-b644-3d53dcad63b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7f37bffb-075c-4963-8417-021911addce5.info is being set with open permissions: ugo+rw Sep 08 06:49:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ec4e3c8b-2f59-454b-b644-3d53dcad63b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7f37bffb-075c-4963-8417-021911addce5.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:49:46 devstack sudo[97334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7f37bffb-075c-4963-8417-021911addce5.info Sep 08 06:49:46 devstack sudo[97334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:49:46 devstack sudo[97334]: pam_unix(sudo:session): session closed for user root Sep 08 06:49:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ec4e3c8b-2f59-454b-b644-3d53dcad63b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7f37bffb-075c-4963-8417-021911addce5.info" returned: 0 in 0.283s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:49:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-ec4e3c8b-2f59-454b-b644-3d53dcad63b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.096s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:49:46 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-ec4e3c8b-2f59-454b-b644-3d53dcad63b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Create snapshot completed successfully Sep 08 06:49:48 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-34ee9668-1c93-4c5d-9fb2-36de33037f39 tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Acquiring lock "cinder-71b7a5d6-7326-4d42-a626-b253d460865a-delete_snapshot" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:49:48 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-34ee9668-1c93-4c5d-9fb2-36de33037f39 tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Lock "cinder-71b7a5d6-7326-4d42-a626-b253d460865a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:49:48 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-34ee9668-1c93-4c5d-9fb2-36de33037f39 tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Acquiring lock "cinder-quobyte-7f37bffb-075c-4963-8417-021911addce5" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:49:48 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-34ee9668-1c93-4c5d-9fb2-36de33037f39 tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Lock "cinder-quobyte-7f37bffb-075c-4963-8417-021911addce5" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:49:48 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-34ee9668-1c93-4c5d-9fb2-36de33037f39 tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Acquiring lock "cinder-quobyte-71b7a5d6-7326-4d42-a626-b253d460865a" by "_delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:49:48 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-34ee9668-1c93-4c5d-9fb2-36de33037f39 tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Lock "cinder-quobyte-71b7a5d6-7326-4d42-a626-b253d460865a" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:49:48 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-34ee9668-1c93-4c5d-9fb2-36de33037f39 tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Deleting offline snapshot 71b7a5d6-7326-4d42-a626-b253d460865a of volume 7f37bffb-075c-4963-8417-021911addce5 {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 06:49:48 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-34ee9668-1c93-4c5d-9fb2-36de33037f39 tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] snapshot_file for this snap is: volume-7f37bffb-075c-4963-8417-021911addce5.71b7a5d6-7326-4d42-a626-b253d460865a {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 06:49:48 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3acb54ba-b286-44e5-a5f0-f556c774c716]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:49:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-34ee9668-1c93-4c5d-9fb2-36de33037f39 tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7f37bffb-075c-4963-8417-021911addce5.71b7a5d6-7326-4d42-a626-b253d460865a {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:49:48 devstack sudo[97338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7f37bffb-075c-4963-8417-021911addce5.71b7a5d6-7326-4d42-a626-b253d460865a Sep 08 06:49:48 devstack sudo[97338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:49:48 devstack sudo[97338]: pam_unix(sudo:session): session closed for user root Sep 08 06:49:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-34ee9668-1c93-4c5d-9fb2-36de33037f39 tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7f37bffb-075c-4963-8417-021911addce5.71b7a5d6-7326-4d42-a626-b253d460865a" returned: 0 in 0.406s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:49:48 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-34ee9668-1c93-4c5d-9fb2-36de33037f39 tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f37bffb-075c-4963-8417-021911addce5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 06:49:49 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca18ca3-549b-4620-bf87-dfe66c21c7d3]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:49:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-34ee9668-1c93-4c5d-9fb2-36de33037f39 tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7f37bffb-075c-4963-8417-021911addce5 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:49:49 devstack sudo[97343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7f37bffb-075c-4963-8417-021911addce5 Sep 08 06:49:49 devstack sudo[97343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:49:49 devstack sudo[97343]: pam_unix(sudo:session): session closed for user root Sep 08 06:49:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-34ee9668-1c93-4c5d-9fb2-36de33037f39 tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7f37bffb-075c-4963-8417-021911addce5" returned: 0 in 0.361s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:49:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-34ee9668-1c93-4c5d-9fb2-36de33037f39 tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7f37bffb-075c-4963-8417-021911addce5.71b7a5d6-7326-4d42-a626-b253d460865a {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:49:49 devstack sudo[97348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7f37bffb-075c-4963-8417-021911addce5.71b7a5d6-7326-4d42-a626-b253d460865a Sep 08 06:49:49 devstack sudo[97348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:49:49 devstack sudo[97348]: pam_unix(sudo:session): session closed for user root Sep 08 06:49:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-34ee9668-1c93-4c5d-9fb2-36de33037f39 tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7f37bffb-075c-4963-8417-021911addce5.71b7a5d6-7326-4d42-a626-b253d460865a" returned: 0 in 0.391s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:49:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-34ee9668-1c93-4c5d-9fb2-36de33037f39 tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7f37bffb-075c-4963-8417-021911addce5.71b7a5d6-7326-4d42-a626-b253d460865a {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:49:49 devstack sudo[97356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7f37bffb-075c-4963-8417-021911addce5.71b7a5d6-7326-4d42-a626-b253d460865a Sep 08 06:49:49 devstack sudo[97356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:49:50 devstack sudo[97356]: pam_unix(sudo:session): session closed for user root Sep 08 06:49:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-34ee9668-1c93-4c5d-9fb2-36de33037f39 tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7f37bffb-075c-4963-8417-021911addce5.71b7a5d6-7326-4d42-a626-b253d460865a" returned: 0 in 0.294s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:49:50 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-34ee9668-1c93-4c5d-9fb2-36de33037f39 tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Lock "cinder-quobyte-71b7a5d6-7326-4d42-a626-b253d460865a" released by "_delete_snapshot" :: held 1.590s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:49:50 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-34ee9668-1c93-4c5d-9fb2-36de33037f39 tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Lock "cinder-quobyte-7f37bffb-075c-4963-8417-021911addce5" released by "delete_snapshot" :: held 1.625s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:49:50 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-34ee9668-1c93-4c5d-9fb2-36de33037f39 tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Created reservations ['7ba6783d-558d-41f5-96b4-892ae30cd1f0', '92b3ce0f-de5a-4172-b892-ee931322db0a', 'e2d63923-a64f-466f-a3dc-73b9a278dbfb', 'de1cb3e0-4d72-4609-9365-2ab453f25359'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:49:50 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-34ee9668-1c93-4c5d-9fb2-36de33037f39 tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Delete snapshot completed successfully. Sep 08 06:49:50 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-34ee9668-1c93-4c5d-9fb2-36de33037f39 tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Lock "cinder-71b7a5d6-7326-4d42-a626-b253d460865a-delete_snapshot" released by "delete_snapshot" :: held 1.816s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:49:50 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-89531413-3088-43fd-b484-a446e487d2a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Acquiring lock "cinder-7f37bffb-075c-4963-8417-021911addce5-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:49:50 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-89531413-3088-43fd-b484-a446e487d2a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Lock "cinder-7f37bffb-075c-4963-8417-021911addce5-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:49:50 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-89531413-3088-43fd-b484-a446e487d2a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Acquiring lock "cinder-quobyte-7f37bffb-075c-4963-8417-021911addce5" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:49:50 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-89531413-3088-43fd-b484-a446e487d2a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Lock "cinder-quobyte-7f37bffb-075c-4963-8417-021911addce5" acquired by "delete_volume" :: waited 0.019s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:49:51 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b6975b6-1219-4e1e-a09e-6f9660d6467b]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:49:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-89531413-3088-43fd-b484-a446e487d2a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7f37bffb-075c-4963-8417-021911addce5 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:49:51 devstack sudo[97379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7f37bffb-075c-4963-8417-021911addce5 Sep 08 06:49:51 devstack sudo[97379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:49:51 devstack sudo[97379]: pam_unix(sudo:session): session closed for user root Sep 08 06:49:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-89531413-3088-43fd-b484-a446e487d2a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7f37bffb-075c-4963-8417-021911addce5" returned: 0 in 0.469s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:49:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-89531413-3088-43fd-b484-a446e487d2a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7f37bffb-075c-4963-8417-021911addce5 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:49:51 devstack sudo[97386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7f37bffb-075c-4963-8417-021911addce5 Sep 08 06:49:51 devstack sudo[97386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:49:51 devstack sudo[97386]: pam_unix(sudo:session): session closed for user root Sep 08 06:49:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-89531413-3088-43fd-b484-a446e487d2a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7f37bffb-075c-4963-8417-021911addce5" returned: 0 in 0.275s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:49:51 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-89531413-3088-43fd-b484-a446e487d2a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Lock "cinder-quobyte-7f37bffb-075c-4963-8417-021911addce5" released by "delete_volume" :: held 0.826s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:49:51 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-89531413-3088-43fd-b484-a446e487d2a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Created reservations ['96db6473-07e6-44f2-8715-b5733d56a2c8', '6159ecf6-655e-4182-8aef-5a96c099e70c', '40eb5cc4-9ab0-49eb-a480-bf7954bb4880', 'ca4dbbab-9ae8-43de-bcd9-68d2f046adc5'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:49:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-89531413-3088-43fd-b484-a446e487d2a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:49:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-89531413-3088-43fd-b484-a446e487d2a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:49:51 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-89531413-3088-43fd-b484-a446e487d2a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:49:51 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-89531413-3088-43fd-b484-a446e487d2a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:49:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-89531413-3088-43fd-b484-a446e487d2a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:49:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-89531413-3088-43fd-b484-a446e487d2a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:49:51 devstack sudo[97389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:49:51 devstack sudo[97389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:49:52 devstack sudo[97389]: pam_unix(sudo:session): session closed for user root Sep 08 06:49:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-89531413-3088-43fd-b484-a446e487d2a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.323s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:49:52 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-89531413-3088-43fd-b484-a446e487d2a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:49:52 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-89531413-3088-43fd-b484-a446e487d2a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Deleted volume successfully. Sep 08 06:49:52 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-89531413-3088-43fd-b484-a446e487d2a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1407975420 None] Lock "cinder-7f37bffb-075c-4963-8417-021911addce5-delete_volume" released by "delete_volume" :: held 1.392s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:49:56 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-af322f6e-f718-4679-9486-17280938416c tempest-AttachVolumeShelveTestJSON-842071274 None] Acquiring lock "cinder-66786104-fc09-4aec-a345-eeb93bd62f9c-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:49:56 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-af322f6e-f718-4679-9486-17280938416c tempest-AttachVolumeShelveTestJSON-842071274 None] Lock "cinder-66786104-fc09-4aec-a345-eeb93bd62f9c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:49:56 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-af322f6e-f718-4679-9486-17280938416c tempest-AttachVolumeShelveTestJSON-842071274 None] Acquiring lock "cinder-quobyte-66786104-fc09-4aec-a345-eeb93bd62f9c" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:49:57 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-af322f6e-f718-4679-9486-17280938416c tempest-AttachVolumeShelveTestJSON-842071274 None] Lock "cinder-quobyte-66786104-fc09-4aec-a345-eeb93bd62f9c" acquired by "delete_volume" :: waited 0.021s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:49:57 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3469e3ac-dc6a-4859-b510-04350f358d20]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:49:57 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-af322f6e-f718-4679-9486-17280938416c tempest-AttachVolumeShelveTestJSON-842071274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-66786104-fc09-4aec-a345-eeb93bd62f9c {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:49:57 devstack sudo[97395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-66786104-fc09-4aec-a345-eeb93bd62f9c Sep 08 06:49:57 devstack sudo[97395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:49:57 devstack sudo[97395]: pam_unix(sudo:session): session closed for user root Sep 08 06:49:57 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-af322f6e-f718-4679-9486-17280938416c tempest-AttachVolumeShelveTestJSON-842071274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-66786104-fc09-4aec-a345-eeb93bd62f9c" returned: 0 in 0.453s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:49:57 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-af322f6e-f718-4679-9486-17280938416c tempest-AttachVolumeShelveTestJSON-842071274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-66786104-fc09-4aec-a345-eeb93bd62f9c {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:49:57 devstack sudo[97400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-66786104-fc09-4aec-a345-eeb93bd62f9c Sep 08 06:49:57 devstack sudo[97400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:49:57 devstack sudo[97400]: pam_unix(sudo:session): session closed for user root Sep 08 06:49:57 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-af322f6e-f718-4679-9486-17280938416c tempest-AttachVolumeShelveTestJSON-842071274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-66786104-fc09-4aec-a345-eeb93bd62f9c" returned: 0 in 0.307s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:49:57 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-af322f6e-f718-4679-9486-17280938416c tempest-AttachVolumeShelveTestJSON-842071274 None] Lock "cinder-quobyte-66786104-fc09-4aec-a345-eeb93bd62f9c" released by "delete_volume" :: held 0.816s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:49:57 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-af322f6e-f718-4679-9486-17280938416c tempest-AttachVolumeShelveTestJSON-842071274 None] Created reservations ['6adc3f2b-3a78-4604-a946-62d1801d9e1d', '29840169-0271-4df7-83c2-67a72e4bca95', 'b1948fc6-ff24-4e01-a9ae-f59564f862e4', '26cf7fd5-f645-4271-aa45-a22838def1bf'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:49:57 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-af322f6e-f718-4679-9486-17280938416c tempest-AttachVolumeShelveTestJSON-842071274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:49:57 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-af322f6e-f718-4679-9486-17280938416c tempest-AttachVolumeShelveTestJSON-842071274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:49:57 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-af322f6e-f718-4679-9486-17280938416c tempest-AttachVolumeShelveTestJSON-842071274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:49:57 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-af322f6e-f718-4679-9486-17280938416c tempest-AttachVolumeShelveTestJSON-842071274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:49:57 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-af322f6e-f718-4679-9486-17280938416c tempest-AttachVolumeShelveTestJSON-842071274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:49:57 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-af322f6e-f718-4679-9486-17280938416c tempest-AttachVolumeShelveTestJSON-842071274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:49:58 devstack sudo[97403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:49:58 devstack sudo[97403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:49:58 devstack sudo[97403]: pam_unix(sudo:session): session closed for user root Sep 08 06:49:58 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-af322f6e-f718-4679-9486-17280938416c tempest-AttachVolumeShelveTestJSON-842071274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.392s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:49:58 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-af322f6e-f718-4679-9486-17280938416c tempest-AttachVolumeShelveTestJSON-842071274 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:49:58 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-af322f6e-f718-4679-9486-17280938416c tempest-AttachVolumeShelveTestJSON-842071274 None] Deleted volume successfully. Sep 08 06:49:58 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-af322f6e-f718-4679-9486-17280938416c tempest-AttachVolumeShelveTestJSON-842071274 None] Lock "cinder-66786104-fc09-4aec-a345-eeb93bd62f9c-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:50:07 devstack cinder-volume[87507]: DEBUG dbcounter [-] [87507] Writing DB stats cinder:SELECT=89,cinder:UPDATE=105,cinder:INSERT=16,cinder:DELETE=2 {{(pid=87507) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 06:50:07 devstack cinder-volume[87507]: DEBUG dbcounter [-] [87507] Writing DB stats cinder:UPDATE=78,cinder:SELECT=87,cinder:INSERT=23,cinder:DELETE=8 {{(pid=87507) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 06:50:07 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bc653ea-2d28-45b8-9a6c-ec0abe95446d tempest-TestShelveInstance-1110004772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:50:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-3bc653ea-2d28-45b8-9a6c-ec0abe95446d tempest-TestShelveInstance-1110004772 None] Flow 'volume_create_manager' (9ee81cf1-a62c-467d-8277-7cbb0682e580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:50:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-3bc653ea-2d28-45b8-9a6c-ec0abe95446d tempest-TestShelveInstance-1110004772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b1df0c9-dd75-41df-9709-ea7b49520171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:50:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-3bc653ea-2d28-45b8-9a6c-ec0abe95446d tempest-TestShelveInstance-1110004772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b1df0c9-dd75-41df-9709-ea7b49520171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:50:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-659190434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1565e55f-2dc7-43fa-84fb-cade2f0551ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e93c5a3f5e2e4df79cc00b154d4cadf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:50:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:50:07Z,use_quota=True,user_id='84c3a9dee5794a548e8fba4bf0b0a398',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:50:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-3bc653ea-2d28-45b8-9a6c-ec0abe95446d tempest-TestShelveInstance-1110004772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (babec6ab-9efe-43f8-b4a6-44156dfdc6ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:50:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-3bc653ea-2d28-45b8-9a6c-ec0abe95446d tempest-TestShelveInstance-1110004772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (babec6ab-9efe-43f8-b4a6-44156dfdc6ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:50:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-3bc653ea-2d28-45b8-9a6c-ec0abe95446d tempest-TestShelveInstance-1110004772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3565a39c-363e-43fa-ae12-0ce4ae05b127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:50:07 devstack cinder-volume[87507]: DEBUG cinder.image.glance [None req-3bc653ea-2d28-45b8-9a6c-ec0abe95446d tempest-TestShelveInstance-1110004772 None] Creating Keystone auth plugin from conf {{(pid=87507) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 08 06:50:08 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-3bc653ea-2d28-45b8-9a6c-ec0abe95446d tempest-TestShelveInstance-1110004772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3565a39c-363e-43fa-ae12-0ce4ae05b127) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1565e55f-2dc7-43fa-84fb-cade2f0551ed', 'volume_name': 'volume-1565e55f-2dc7-43fa-84fb-cade2f0551ed', 'volume_size': 1, 'image_id': '69da6bac-8b7b-48c5-af3b-29466563452a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/69da6bac-8b7b-48c5-af3b-29466563452a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '95d2d5dbb3e04d74b8da31fc6ee47f98', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '69da6bac-8b7b-48c5-af3b-29466563452a', 'created_at': datetime.datetime(2026, 9, 8, 4, 36, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 4, 36, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/69da6bac-8b7b-48c5-af3b-29466563452a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:50:08 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-3bc653ea-2d28-45b8-9a6c-ec0abe95446d tempest-TestShelveInstance-1110004772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7da6062-96e7-4db8-818d-8ba6b760e41b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:50:08 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-3bc653ea-2d28-45b8-9a6c-ec0abe95446d tempest-TestShelveInstance-1110004772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7da6062-96e7-4db8-818d-8ba6b760e41b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:50:08 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-3bc653ea-2d28-45b8-9a6c-ec0abe95446d tempest-TestShelveInstance-1110004772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9772ec9c-84a2-4399-978d-8fb068cfd409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:50:08 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-3bc653ea-2d28-45b8-9a6c-ec0abe95446d tempest-TestShelveInstance-1110004772 None] Volume 1565e55f-2dc7-43fa-84fb-cade2f0551ed: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1565e55f-2dc7-43fa-84fb-cade2f0551ed', 'volume_size': 1, 'image_id': '69da6bac-8b7b-48c5-af3b-29466563452a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/69da6bac-8b7b-48c5-af3b-29466563452a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '95d2d5dbb3e04d74b8da31fc6ee47f98', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '69da6bac-8b7b-48c5-af3b-29466563452a', 'created_at': datetime.datetime(2026, 9, 8, 4, 36, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 4, 36, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/69da6bac-8b7b-48c5-af3b-29466563452a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 08 06:50:08 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bc653ea-2d28-45b8-9a6c-ec0abe95446d tempest-TestShelveInstance-1110004772 None] Trying to clone 1565e55f-2dc7-43fa-84fb-cade2f0551ed from image 69da6bac-8b7b-48c5-af3b-29466563452a at location (None, [{'url': 'file:///opt/stack/data/glance/images/69da6bac-8b7b-48c5-af3b-29466563452a', 'metadata': {}}]). {{(pid=87507) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 08 06:50:08 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-3bc653ea-2d28-45b8-9a6c-ec0abe95446d tempest-TestShelveInstance-1110004772 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_zb1414hfdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87507) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 08 06:50:08 devstack cinder-volume[87507]: INFO cinder.image.image_utils [None req-3bc653ea-2d28-45b8-9a6c-ec0abe95446d tempest-TestShelveInstance-1110004772 None] Image download 20.69 MB at 20.69 MB/s Sep 08 06:50:08 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dbf3cb7-1246-4a39-ac2b-65892a8affa7]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:50:08 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3bc653ea-2d28-45b8-9a6c-ec0abe95446d tempest-TestShelveInstance-1110004772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_zb1414hfdevstack@QuobyteHD {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:08 devstack sudo[97424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_zb1414hfdevstack@QuobyteHD Sep 08 06:50:08 devstack sudo[97424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:08 devstack sudo[97424]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:08 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3bc653ea-2d28-45b8-9a6c-ec0abe95446d tempest-TestShelveInstance-1110004772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_zb1414hfdevstack@QuobyteHD" returned: 0 in 0.349s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:08 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-3bc653ea-2d28-45b8-9a6c-ec0abe95446d tempest-TestShelveInstance-1110004772 None] Temporary image 69da6bac-8b7b-48c5-af3b-29466563452a is fetched for user 84c3a9dee5794a548e8fba4bf0b0a398. {{(pid=87507) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 08 06:50:09 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a51c7d-ac74-4cfd-a9e5-817a5fb72536]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:50:09 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3bc653ea-2d28-45b8-9a6c-ec0abe95446d tempest-TestShelveInstance-1110004772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_zb1414hfdevstack@QuobyteHD {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:09 devstack sudo[97431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_zb1414hfdevstack@QuobyteHD Sep 08 06:50:09 devstack sudo[97431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:09 devstack sudo[97431]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:09 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3bc653ea-2d28-45b8-9a6c-ec0abe95446d tempest-TestShelveInstance-1110004772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_zb1414hfdevstack@QuobyteHD" returned: 0 in 0.436s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:09 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-3bc653ea-2d28-45b8-9a6c-ec0abe95446d tempest-TestShelveInstance-1110004772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:50:09 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-3bc653ea-2d28-45b8-9a6c-ec0abe95446d tempest-TestShelveInstance-1110004772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:50:09 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-3bc653ea-2d28-45b8-9a6c-ec0abe95446d tempest-TestShelveInstance-1110004772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:50:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-659190434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1565e55f-2dc7-43fa-84fb-cade2f0551ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e93c5a3f5e2e4df79cc00b154d4cadf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:50:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:50:07Z,use_quota=True,user_id='84c3a9dee5794a548e8fba4bf0b0a398',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:50:09 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-3bc653ea-2d28-45b8-9a6c-ec0abe95446d tempest-TestShelveInstance-1110004772 None] Creating volume 1565e55f-2dc7-43fa-84fb-cade2f0551ed {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:50:09 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-3bc653ea-2d28-45b8-9a6c-ec0abe95446d tempest-TestShelveInstance-1110004772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:50:09 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-3bc653ea-2d28-45b8-9a6c-ec0abe95446d tempest-TestShelveInstance-1110004772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:50:09 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-3bc653ea-2d28-45b8-9a6c-ec0abe95446d tempest-TestShelveInstance-1110004772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:50:09 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-3bc653ea-2d28-45b8-9a6c-ec0abe95446d tempest-TestShelveInstance-1110004772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:50:09 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-3bc653ea-2d28-45b8-9a6c-ec0abe95446d tempest-TestShelveInstance-1110004772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:50:09 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-3bc653ea-2d28-45b8-9a6c-ec0abe95446d tempest-TestShelveInstance-1110004772 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:50:09 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-3bc653ea-2d28-45b8-9a6c-ec0abe95446d tempest-TestShelveInstance-1110004772 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:50:09 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3bc653ea-2d28-45b8-9a6c-ec0abe95446d tempest-TestShelveInstance-1110004772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1565e55f-2dc7-43fa-84fb-cade2f0551ed 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:09 devstack sudo[97437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1565e55f-2dc7-43fa-84fb-cade2f0551ed 1073741824 Sep 08 06:50:09 devstack sudo[97437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:10 devstack sudo[97437]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:10 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3bc653ea-2d28-45b8-9a6c-ec0abe95446d tempest-TestShelveInstance-1110004772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1565e55f-2dc7-43fa-84fb-cade2f0551ed 1073741824" returned: 0 in 0.557s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:10 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3bc653ea-2d28-45b8-9a6c-ec0abe95446d tempest-TestShelveInstance-1110004772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1565e55f-2dc7-43fa-84fb-cade2f0551ed {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:10 devstack sudo[97443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1565e55f-2dc7-43fa-84fb-cade2f0551ed Sep 08 06:50:10 devstack sudo[97443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:10 devstack sudo[97443]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:10 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3bc653ea-2d28-45b8-9a6c-ec0abe95446d tempest-TestShelveInstance-1110004772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1565e55f-2dc7-43fa-84fb-cade2f0551ed" returned: 0 in 0.264s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:10 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-3bc653ea-2d28-45b8-9a6c-ec0abe95446d tempest-TestShelveInstance-1110004772 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:50:10 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-3bc653ea-2d28-45b8-9a6c-ec0abe95446d tempest-TestShelveInstance-1110004772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:50:10 devstack cinder-volume[87507]: DEBUG cinder.volume.volume_utils [None req-3bc653ea-2d28-45b8-9a6c-ec0abe95446d tempest-TestShelveInstance-1110004772 None] Attempting download of 69da6bac-8b7b-48c5-af3b-29466563452a ((None, [{'url': 'file:///opt/stack/data/glance/images/69da6bac-8b7b-48c5-af3b-29466563452a', 'metadata': {}}])) to volume 1565e55f-2dc7-43fa-84fb-cade2f0551ed. {{(pid=87507) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 08 06:50:10 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c738049-a5c7-48aa-b86a-6befe0ad978e]: (4, 'raw') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:50:10 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3bc653ea-2d28-45b8-9a6c-ec0abe95446d tempest-TestShelveInstance-1110004772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_69da6bac-8b7b-48c5-af3b-29466563452a_p5zfrw4v {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:10 devstack sudo[97446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_69da6bac-8b7b-48c5-af3b-29466563452a_p5zfrw4v Sep 08 06:50:10 devstack sudo[97446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:10 devstack sudo[97446]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:10 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3bc653ea-2d28-45b8-9a6c-ec0abe95446d tempest-TestShelveInstance-1110004772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_69da6bac-8b7b-48c5-af3b-29466563452a_p5zfrw4v" returned: 0 in 0.391s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:10 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3bc653ea-2d28-45b8-9a6c-ec0abe95446d tempest-TestShelveInstance-1110004772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_69da6bac-8b7b-48c5-af3b-29466563452a_p5zfrw4v {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:10 devstack sudo[97450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_69da6bac-8b7b-48c5-af3b-29466563452a_p5zfrw4v Sep 08 06:50:10 devstack sudo[97450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:11 devstack sudo[97450]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3bc653ea-2d28-45b8-9a6c-ec0abe95446d tempest-TestShelveInstance-1110004772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_69da6bac-8b7b-48c5-af3b-29466563452a_p5zfrw4v" returned: 1 in 0.361s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3bc653ea-2d28-45b8-9a6c-ec0abe95446d tempest-TestShelveInstance-1110004772 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_69da6bac-8b7b-48c5-af3b-29466563452a_p5zfrw4v' failed. Not Retrying. {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 06:50:11 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[640540fa-9039-47a7-9b23-704c08e602c0]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:50:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3bc653ea-2d28-45b8-9a6c-ec0abe95446d tempest-TestShelveInstance-1110004772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_zb1414hfdevstack@QuobyteHD {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:11 devstack sudo[97454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_zb1414hfdevstack@QuobyteHD Sep 08 06:50:11 devstack sudo[97454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:11 devstack sudo[97454]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3bc653ea-2d28-45b8-9a6c-ec0abe95446d tempest-TestShelveInstance-1110004772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_zb1414hfdevstack@QuobyteHD" returned: 0 in 0.424s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:11 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-3bc653ea-2d28-45b8-9a6c-ec0abe95446d tempest-TestShelveInstance-1110004772 None] 69da6bac-8b7b-48c5-af3b-29466563452a was qcow2, converting to qcow2 {{(pid=87507) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 08 06:50:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3bc653ea-2d28-45b8-9a6c-ec0abe95446d tempest-TestShelveInstance-1110004772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_zb1414hfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1565e55f-2dc7-43fa-84fb-cade2f0551ed {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:11 devstack sudo[97459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_zb1414hfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1565e55f-2dc7-43fa-84fb-cade2f0551ed Sep 08 06:50:11 devstack sudo[97459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:13 devstack sudo[97459]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3bc653ea-2d28-45b8-9a6c-ec0abe95446d tempest-TestShelveInstance-1110004772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_zb1414hfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1565e55f-2dc7-43fa-84fb-cade2f0551ed" returned: 0 in 2.214s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:13 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-3bc653ea-2d28-45b8-9a6c-ec0abe95446d tempest-TestShelveInstance-1110004772 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_zb1414hfdevstack@QuobyteHD, size 112.00 MB, duration 2.22 sec, destination /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1565e55f-2dc7-43fa-84fb-cade2f0551ed {{(pid=87507) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 06:50:13 devstack cinder-volume[87507]: INFO cinder.image.image_utils [None req-3bc653ea-2d28-45b8-9a6c-ec0abe95446d tempest-TestShelveInstance-1110004772 None] Converted 112.00 MB image at 50.55 MB/s Sep 08 06:50:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3bc653ea-2d28-45b8-9a6c-ec0abe95446d tempest-TestShelveInstance-1110004772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1565e55f-2dc7-43fa-84fb-cade2f0551ed 1G {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:13 devstack sudo[97467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1565e55f-2dc7-43fa-84fb-cade2f0551ed 1G Sep 08 06:50:13 devstack sudo[97467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:14 devstack sudo[97467]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3bc653ea-2d28-45b8-9a6c-ec0abe95446d tempest-TestShelveInstance-1110004772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1565e55f-2dc7-43fa-84fb-cade2f0551ed 1G" returned: 0 in 0.357s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:14 devstack cinder-volume[87507]: DEBUG cinder.volume.volume_utils [None req-3bc653ea-2d28-45b8-9a6c-ec0abe95446d tempest-TestShelveInstance-1110004772 None] Downloaded image 69da6bac-8b7b-48c5-af3b-29466563452a ((None, [{'url': 'file:///opt/stack/data/glance/images/69da6bac-8b7b-48c5-af3b-29466563452a', 'metadata': {}}])) to volume 1565e55f-2dc7-43fa-84fb-cade2f0551ed successfully. {{(pid=87507) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 08 06:50:14 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-3bc653ea-2d28-45b8-9a6c-ec0abe95446d tempest-TestShelveInstance-1110004772 None] Temporary image 69da6bac-8b7b-48c5-af3b-29466563452a for user 84c3a9dee5794a548e8fba4bf0b0a398 is deleted. {{(pid=87507) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 08 06:50:14 devstack cinder-volume[87507]: DEBUG cinder.volume.volume_utils [None req-3bc653ea-2d28-45b8-9a6c-ec0abe95446d tempest-TestShelveInstance-1110004772 None] Marking volume 1565e55f-2dc7-43fa-84fb-cade2f0551ed as bootable. {{(pid=87507) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 08 06:50:14 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bc653ea-2d28-45b8-9a6c-ec0abe95446d tempest-TestShelveInstance-1110004772 None] Copying metadata from image 69da6bac-8b7b-48c5-af3b-29466563452a to 1565e55f-2dc7-43fa-84fb-cade2f0551ed. {{(pid=87507) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 08 06:50:14 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bc653ea-2d28-45b8-9a6c-ec0abe95446d tempest-TestShelveInstance-1110004772 None] Creating volume glance metadata for volume 1565e55f-2dc7-43fa-84fb-cade2f0551ed backed by image 69da6bac-8b7b-48c5-af3b-29466563452a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '69da6bac-8b7b-48c5-af3b-29466563452a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87507) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 08 06:50:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-3bc653ea-2d28-45b8-9a6c-ec0abe95446d tempest-TestShelveInstance-1110004772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9772ec9c-84a2-4399-978d-8fb068cfd409) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1565e55f-2dc7-43fa-84fb-cade2f0551ed', 'volume_size': 1, 'image_id': '69da6bac-8b7b-48c5-af3b-29466563452a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/69da6bac-8b7b-48c5-af3b-29466563452a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '95d2d5dbb3e04d74b8da31fc6ee47f98', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '69da6bac-8b7b-48c5-af3b-29466563452a', 'created_at': datetime.datetime(2026, 9, 8, 4, 36, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 4, 36, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/69da6bac-8b7b-48c5-af3b-29466563452a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:50:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-3bc653ea-2d28-45b8-9a6c-ec0abe95446d tempest-TestShelveInstance-1110004772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2c0b79e-0788-4c5a-a2b9-cace07d9bf8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:50:14 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-3bc653ea-2d28-45b8-9a6c-ec0abe95446d tempest-TestShelveInstance-1110004772 None] Volume volume-1565e55f-2dc7-43fa-84fb-cade2f0551ed (1565e55f-2dc7-43fa-84fb-cade2f0551ed): created successfully Sep 08 06:50:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-3bc653ea-2d28-45b8-9a6c-ec0abe95446d tempest-TestShelveInstance-1110004772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2c0b79e-0788-4c5a-a2b9-cace07d9bf8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:50:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-3bc653ea-2d28-45b8-9a6c-ec0abe95446d tempest-TestShelveInstance-1110004772 None] Flow 'volume_create_manager' (9ee81cf1-a62c-467d-8277-7cbb0682e580) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:50:14 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-3bc653ea-2d28-45b8-9a6c-ec0abe95446d tempest-TestShelveInstance-1110004772 None] Created volume successfully. Sep 08 06:50:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-38447a54-5680-45bf-a3a7-7170a474eeed req-4692b5f1-5f0a-4e38-8081-e49e43749fdf tempest-TestShelveInstance-1110004772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:50:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-38447a54-5680-45bf-a3a7-7170a474eeed req-4692b5f1-5f0a-4e38-8081-e49e43749fdf tempest-TestShelveInstance-1110004772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:50:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-38447a54-5680-45bf-a3a7-7170a474eeed req-4692b5f1-5f0a-4e38-8081-e49e43749fdf tempest-TestShelveInstance-1110004772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:50:17 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-38447a54-5680-45bf-a3a7-7170a474eeed req-4692b5f1-5f0a-4e38-8081-e49e43749fdf tempest-TestShelveInstance-1110004772 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d', 'name': 'volume-1565e55f-2dc7-43fa-84fb-cade2f0551ed', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1495bc21-cfb3-4d7c-9059-ee0830fa7288', 'enforce_multipath': True} {{(pid=87507) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 06:50:18 devstack cinder-volume[87507]: INFO cinder.volume.manager [req-38447a54-5680-45bf-a3a7-7170a474eeed req-4692b5f1-5f0a-4e38-8081-e49e43749fdf tempest-TestShelveInstance-1110004772 None] attachment_update completed successfully. Sep 08 06:50:18 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-2410f33e-1d11-4ad0-a6f2-ac9f4dc8f433 tempest-SnapshotsActionsTest-1585549037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:50:18 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2410f33e-1d11-4ad0-a6f2-ac9f4dc8f433 tempest-SnapshotsActionsTest-1585549037 None] Flow 'volume_create_manager' (ad23b7af-5022-4883-9807-53b3b2b9a44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:50:18 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2410f33e-1d11-4ad0-a6f2-ac9f4dc8f433 tempest-SnapshotsActionsTest-1585549037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50e5da23-1f53-4ca8-867a-fac7043f4b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:50:18 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2410f33e-1d11-4ad0-a6f2-ac9f4dc8f433 tempest-SnapshotsActionsTest-1585549037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50e5da23-1f53-4ca8-867a-fac7043f4b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:50:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1058424513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f821731-481f-48bc-a117-d3b8845a782d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae94c85512fb48338f4ebd1e60ac68ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:50:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:50:19Z,use_quota=True,user_id='6d8242b49c5b466dbefd864bf411e44f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:50:18 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2410f33e-1d11-4ad0-a6f2-ac9f4dc8f433 tempest-SnapshotsActionsTest-1585549037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e32ed8e-49f7-4314-8448-eb7cd9b776cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:50:18 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2410f33e-1d11-4ad0-a6f2-ac9f4dc8f433 tempest-SnapshotsActionsTest-1585549037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e32ed8e-49f7-4314-8448-eb7cd9b776cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:50:18 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2410f33e-1d11-4ad0-a6f2-ac9f4dc8f433 tempest-SnapshotsActionsTest-1585549037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73812c8b-16e1-47af-9923-a9fe470e8254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:50:18 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2410f33e-1d11-4ad0-a6f2-ac9f4dc8f433 tempest-SnapshotsActionsTest-1585549037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73812c8b-16e1-47af-9923-a9fe470e8254) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f821731-481f-48bc-a117-d3b8845a782d', 'volume_name': 'volume-2f821731-481f-48bc-a117-d3b8845a782d', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:50:18 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2410f33e-1d11-4ad0-a6f2-ac9f4dc8f433 tempest-SnapshotsActionsTest-1585549037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ca90038-9258-4bf3-8ecc-e6970e733594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:50:18 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2410f33e-1d11-4ad0-a6f2-ac9f4dc8f433 tempest-SnapshotsActionsTest-1585549037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ca90038-9258-4bf3-8ecc-e6970e733594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:50:18 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2410f33e-1d11-4ad0-a6f2-ac9f4dc8f433 tempest-SnapshotsActionsTest-1585549037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57439ccb-b310-41b4-b82b-82fcbab9e239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:50:18 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-2410f33e-1d11-4ad0-a6f2-ac9f4dc8f433 tempest-SnapshotsActionsTest-1585549037 None] Volume 2f821731-481f-48bc-a117-d3b8845a782d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f821731-481f-48bc-a117-d3b8845a782d', 'volume_size': 1} Sep 08 06:50:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-2410f33e-1d11-4ad0-a6f2-ac9f4dc8f433 tempest-SnapshotsActionsTest-1585549037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:50:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-2410f33e-1d11-4ad0-a6f2-ac9f4dc8f433 tempest-SnapshotsActionsTest-1585549037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:50:18 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-2410f33e-1d11-4ad0-a6f2-ac9f4dc8f433 tempest-SnapshotsActionsTest-1585549037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:50:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1058424513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f821731-481f-48bc-a117-d3b8845a782d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae94c85512fb48338f4ebd1e60ac68ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:50:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:50:19Z,use_quota=True,user_id='6d8242b49c5b466dbefd864bf411e44f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:50:18 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-2410f33e-1d11-4ad0-a6f2-ac9f4dc8f433 tempest-SnapshotsActionsTest-1585549037 None] Creating volume 2f821731-481f-48bc-a117-d3b8845a782d {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:50:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-2410f33e-1d11-4ad0-a6f2-ac9f4dc8f433 tempest-SnapshotsActionsTest-1585549037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:50:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-2410f33e-1d11-4ad0-a6f2-ac9f4dc8f433 tempest-SnapshotsActionsTest-1585549037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:50:18 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-2410f33e-1d11-4ad0-a6f2-ac9f4dc8f433 tempest-SnapshotsActionsTest-1585549037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:50:18 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-2410f33e-1d11-4ad0-a6f2-ac9f4dc8f433 tempest-SnapshotsActionsTest-1585549037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:50:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-2410f33e-1d11-4ad0-a6f2-ac9f4dc8f433 tempest-SnapshotsActionsTest-1585549037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:50:18 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-2410f33e-1d11-4ad0-a6f2-ac9f4dc8f433 tempest-SnapshotsActionsTest-1585549037 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:50:18 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-2410f33e-1d11-4ad0-a6f2-ac9f4dc8f433 tempest-SnapshotsActionsTest-1585549037 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:50:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2410f33e-1d11-4ad0-a6f2-ac9f4dc8f433 tempest-SnapshotsActionsTest-1585549037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:18 devstack sudo[97519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d 1073741824 Sep 08 06:50:18 devstack sudo[97519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:19 devstack sudo[97519]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2410f33e-1d11-4ad0-a6f2-ac9f4dc8f433 tempest-SnapshotsActionsTest-1585549037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d 1073741824" returned: 0 in 0.617s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2410f33e-1d11-4ad0-a6f2-ac9f4dc8f433 tempest-SnapshotsActionsTest-1585549037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:19 devstack sudo[97527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d Sep 08 06:50:19 devstack sudo[97527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:19 devstack sudo[97527]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2410f33e-1d11-4ad0-a6f2-ac9f4dc8f433 tempest-SnapshotsActionsTest-1585549037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d" returned: 0 in 0.299s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:19 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-2410f33e-1d11-4ad0-a6f2-ac9f4dc8f433 tempest-SnapshotsActionsTest-1585549037 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:50:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-2410f33e-1d11-4ad0-a6f2-ac9f4dc8f433 tempest-SnapshotsActionsTest-1585549037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:50:19 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2410f33e-1d11-4ad0-a6f2-ac9f4dc8f433 tempest-SnapshotsActionsTest-1585549037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57439ccb-b310-41b4-b82b-82fcbab9e239) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f821731-481f-48bc-a117-d3b8845a782d', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:50:19 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2410f33e-1d11-4ad0-a6f2-ac9f4dc8f433 tempest-SnapshotsActionsTest-1585549037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a15e07d-834e-49ec-87c8-526d578b3ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:50:19 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-2410f33e-1d11-4ad0-a6f2-ac9f4dc8f433 tempest-SnapshotsActionsTest-1585549037 None] Volume volume-2f821731-481f-48bc-a117-d3b8845a782d (2f821731-481f-48bc-a117-d3b8845a782d): created successfully Sep 08 06:50:19 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2410f33e-1d11-4ad0-a6f2-ac9f4dc8f433 tempest-SnapshotsActionsTest-1585549037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a15e07d-834e-49ec-87c8-526d578b3ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:50:19 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2410f33e-1d11-4ad0-a6f2-ac9f4dc8f433 tempest-SnapshotsActionsTest-1585549037 None] Flow 'volume_create_manager' (ad23b7af-5022-4883-9807-53b3b2b9a44e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:50:19 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-2410f33e-1d11-4ad0-a6f2-ac9f4dc8f433 tempest-SnapshotsActionsTest-1585549037 None] Created volume successfully. Sep 08 06:50:20 devstack cinder-volume[87507]: DEBUG oslo_service.periodic_task [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87507) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 06:50:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:50:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:50:20 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:50:20 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:50:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:50:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:20 devstack sudo[97530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:50:20 devstack sudo[97530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:20 devstack sudo[97530]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.266s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:20 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:50:20 devstack cinder-volume[87507]: DEBUG oslo_service.periodic_task [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Running periodic task VolumeManager._thread_info {{(pid=87507) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 06:50:20 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] thread count: 29 {{(pid=87507) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 06:50:20 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] thread info: [<_MainThread(MainThread, started 127913129345152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87507) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 06:50:21 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-f7cc61c1-93d7-479d-841c-5c1b6ef5893f tempest-SnapshotsActionsTest-1585549037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:50:21 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-f7cc61c1-93d7-479d-841c-5c1b6ef5893f tempest-SnapshotsActionsTest-1585549037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:50:21 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-f7cc61c1-93d7-479d-841c-5c1b6ef5893f tempest-SnapshotsActionsTest-1585549037 None] Creating offline snapshot 48790f5b-53f9-406d-ab8a-fc6d7cb48f3f of volume 2f821731-481f-48bc-a117-d3b8845a782d {{(pid=87507) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 06:50:21 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e65567-e872-4ad9-a770-a54e0d6df15f]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:50:21 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f7cc61c1-93d7-479d-841c-5c1b6ef5893f tempest-SnapshotsActionsTest-1585549037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:21 devstack sudo[97534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d Sep 08 06:50:21 devstack sudo[97534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:21 devstack sudo[97534]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:21 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f7cc61c1-93d7-479d-841c-5c1b6ef5893f tempest-SnapshotsActionsTest-1585549037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d" returned: 0 in 0.403s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:21 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f7cc61c1-93d7-479d-841c-5c1b6ef5893f tempest-SnapshotsActionsTest-1585549037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.48790f5b-53f9-406d-ab8a-fc6d7cb48f3f 1G {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:21 devstack sudo[97539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.48790f5b-53f9-406d-ab8a-fc6d7cb48f3f 1G Sep 08 06:50:21 devstack sudo[97539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:22 devstack sudo[97539]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:22 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f7cc61c1-93d7-479d-841c-5c1b6ef5893f tempest-SnapshotsActionsTest-1585549037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.48790f5b-53f9-406d-ab8a-fc6d7cb48f3f 1G" returned: 0 in 0.527s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:22 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f7cc61c1-93d7-479d-841c-5c1b6ef5893f tempest-SnapshotsActionsTest-1585549037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f821731-481f-48bc-a117-d3b8845a782d -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.48790f5b-53f9-406d-ab8a-fc6d7cb48f3f {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:22 devstack sudo[97546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f821731-481f-48bc-a117-d3b8845a782d -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.48790f5b-53f9-406d-ab8a-fc6d7cb48f3f Sep 08 06:50:22 devstack sudo[97546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:22 devstack sudo[97546]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:22 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f7cc61c1-93d7-479d-841c-5c1b6ef5893f tempest-SnapshotsActionsTest-1585549037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f821731-481f-48bc-a117-d3b8845a782d -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.48790f5b-53f9-406d-ab8a-fc6d7cb48f3f" returned: 0 in 0.399s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:22 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-f7cc61c1-93d7-479d-841c-5c1b6ef5893f tempest-SnapshotsActionsTest-1585549037 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.48790f5b-53f9-406d-ab8a-fc6d7cb48f3f is being set with open permissions: ugo+rw Sep 08 06:50:22 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f7cc61c1-93d7-479d-841c-5c1b6ef5893f tempest-SnapshotsActionsTest-1585549037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.48790f5b-53f9-406d-ab8a-fc6d7cb48f3f {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:22 devstack sudo[97625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.48790f5b-53f9-406d-ab8a-fc6d7cb48f3f Sep 08 06:50:22 devstack sudo[97625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:22 devstack sudo[97625]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:22 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f7cc61c1-93d7-479d-841c-5c1b6ef5893f tempest-SnapshotsActionsTest-1585549037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.48790f5b-53f9-406d-ab8a-fc6d7cb48f3f" returned: 0 in 0.520s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f7cc61c1-93d7-479d-841c-5c1b6ef5893f tempest-SnapshotsActionsTest-1585549037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:23 devstack sudo[97974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.info Sep 08 06:50:23 devstack sudo[97974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:23 devstack sudo[97974]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f7cc61c1-93d7-479d-841c-5c1b6ef5893f tempest-SnapshotsActionsTest-1585549037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.info" returned: 0 in 0.420s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:23 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-f7cc61c1-93d7-479d-841c-5c1b6ef5893f tempest-SnapshotsActionsTest-1585549037 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.info is being set with open permissions: ugo+rw Sep 08 06:50:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f7cc61c1-93d7-479d-841c-5c1b6ef5893f tempest-SnapshotsActionsTest-1585549037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:23 devstack sudo[97994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.info Sep 08 06:50:23 devstack sudo[97994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:23 devstack sudo[97994]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f7cc61c1-93d7-479d-841c-5c1b6ef5893f tempest-SnapshotsActionsTest-1585549037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.info" returned: 0 in 0.469s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-f7cc61c1-93d7-479d-841c-5c1b6ef5893f tempest-SnapshotsActionsTest-1585549037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.893s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:50:24 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-f7cc61c1-93d7-479d-841c-5c1b6ef5893f tempest-SnapshotsActionsTest-1585549037 None] Create snapshot completed successfully Sep 08 06:50:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-13718933-756b-4569-80d8-e21973851995 tempest-SnapshotsActionsTest-1585549037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:50:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-13718933-756b-4569-80d8-e21973851995 tempest-SnapshotsActionsTest-1585549037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:50:25 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-13718933-756b-4569-80d8-e21973851995 tempest-SnapshotsActionsTest-1585549037 None] Creating offline snapshot 5ed29e7f-5a65-4816-ba58-6c2a8d45d356 of volume 2f821731-481f-48bc-a117-d3b8845a782d {{(pid=87507) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 06:50:25 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[111691b5-c9e6-43e7-93df-79973cb2b8e9]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:50:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-13718933-756b-4569-80d8-e21973851995 tempest-SnapshotsActionsTest-1585549037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.48790f5b-53f9-406d-ab8a-fc6d7cb48f3f {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:25 devstack sudo[98001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.48790f5b-53f9-406d-ab8a-fc6d7cb48f3f Sep 08 06:50:25 devstack sudo[98001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:25 devstack sudo[98001]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-13718933-756b-4569-80d8-e21973851995 tempest-SnapshotsActionsTest-1585549037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.48790f5b-53f9-406d-ab8a-fc6d7cb48f3f" returned: 0 in 0.386s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:25 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-13718933-756b-4569-80d8-e21973851995 tempest-SnapshotsActionsTest-1585549037 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f821731-481f-48bc-a117-d3b8845a782d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 06:50:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-13718933-756b-4569-80d8-e21973851995 tempest-SnapshotsActionsTest-1585549037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.48790f5b-53f9-406d-ab8a-fc6d7cb48f3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.5ed29e7f-5a65-4816-ba58-6c2a8d45d356 1G {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:25 devstack sudo[98006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.48790f5b-53f9-406d-ab8a-fc6d7cb48f3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.5ed29e7f-5a65-4816-ba58-6c2a8d45d356 1G Sep 08 06:50:25 devstack sudo[98006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:26 devstack sudo[98006]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-13718933-756b-4569-80d8-e21973851995 tempest-SnapshotsActionsTest-1585549037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.48790f5b-53f9-406d-ab8a-fc6d7cb48f3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.5ed29e7f-5a65-4816-ba58-6c2a8d45d356 1G" returned: 0 in 0.599s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-13718933-756b-4569-80d8-e21973851995 tempest-SnapshotsActionsTest-1585549037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f821731-481f-48bc-a117-d3b8845a782d.48790f5b-53f9-406d-ab8a-fc6d7cb48f3f -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.5ed29e7f-5a65-4816-ba58-6c2a8d45d356 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:26 devstack sudo[98018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f821731-481f-48bc-a117-d3b8845a782d.48790f5b-53f9-406d-ab8a-fc6d7cb48f3f -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.5ed29e7f-5a65-4816-ba58-6c2a8d45d356 Sep 08 06:50:26 devstack sudo[98018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:26 devstack sudo[98018]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-13718933-756b-4569-80d8-e21973851995 tempest-SnapshotsActionsTest-1585549037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f821731-481f-48bc-a117-d3b8845a782d.48790f5b-53f9-406d-ab8a-fc6d7cb48f3f -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.5ed29e7f-5a65-4816-ba58-6c2a8d45d356" returned: 0 in 0.686s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:26 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-13718933-756b-4569-80d8-e21973851995 tempest-SnapshotsActionsTest-1585549037 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.5ed29e7f-5a65-4816-ba58-6c2a8d45d356 is being set with open permissions: ugo+rw Sep 08 06:50:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-13718933-756b-4569-80d8-e21973851995 tempest-SnapshotsActionsTest-1585549037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.5ed29e7f-5a65-4816-ba58-6c2a8d45d356 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:26 devstack sudo[98025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.5ed29e7f-5a65-4816-ba58-6c2a8d45d356 Sep 08 06:50:26 devstack sudo[98025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:27 devstack sudo[98025]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:27 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-13718933-756b-4569-80d8-e21973851995 tempest-SnapshotsActionsTest-1585549037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.5ed29e7f-5a65-4816-ba58-6c2a8d45d356" returned: 0 in 0.358s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:27 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-13718933-756b-4569-80d8-e21973851995 tempest-SnapshotsActionsTest-1585549037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.138s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:50:27 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-13718933-756b-4569-80d8-e21973851995 tempest-SnapshotsActionsTest-1585549037 None] Create snapshot completed successfully Sep 08 06:50:28 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-171cddb5-0df3-480a-b388-df4f803405e1 tempest-SnapshotsActionsTest-1092359652 None] Acquiring lock "cinder-5ed29e7f-5a65-4816-ba58-6c2a8d45d356-delete_snapshot" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:50:28 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-171cddb5-0df3-480a-b388-df4f803405e1 tempest-SnapshotsActionsTest-1092359652 None] Lock "cinder-5ed29e7f-5a65-4816-ba58-6c2a8d45d356-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:50:28 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-171cddb5-0df3-480a-b388-df4f803405e1 tempest-SnapshotsActionsTest-1092359652 None] Acquiring lock "cinder-quobyte-2f821731-481f-48bc-a117-d3b8845a782d" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:50:28 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-171cddb5-0df3-480a-b388-df4f803405e1 tempest-SnapshotsActionsTest-1092359652 None] Lock "cinder-quobyte-2f821731-481f-48bc-a117-d3b8845a782d" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:50:28 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-171cddb5-0df3-480a-b388-df4f803405e1 tempest-SnapshotsActionsTest-1092359652 None] Acquiring lock "cinder-quobyte-5ed29e7f-5a65-4816-ba58-6c2a8d45d356" by "_delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:50:28 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-171cddb5-0df3-480a-b388-df4f803405e1 tempest-SnapshotsActionsTest-1092359652 None] Lock "cinder-quobyte-5ed29e7f-5a65-4816-ba58-6c2a8d45d356" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:50:28 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-171cddb5-0df3-480a-b388-df4f803405e1 tempest-SnapshotsActionsTest-1092359652 None] Deleting offline snapshot 5ed29e7f-5a65-4816-ba58-6c2a8d45d356 of volume 2f821731-481f-48bc-a117-d3b8845a782d {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 06:50:28 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-171cddb5-0df3-480a-b388-df4f803405e1 tempest-SnapshotsActionsTest-1092359652 None] snapshot_file for this snap is: volume-2f821731-481f-48bc-a117-d3b8845a782d.5ed29e7f-5a65-4816-ba58-6c2a8d45d356 {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 06:50:28 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[623437f1-a3ab-44a8-b07e-d52a2f9693e0]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:50:28 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-171cddb5-0df3-480a-b388-df4f803405e1 tempest-SnapshotsActionsTest-1092359652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.5ed29e7f-5a65-4816-ba58-6c2a8d45d356 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:29 devstack sudo[98036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.5ed29e7f-5a65-4816-ba58-6c2a8d45d356 Sep 08 06:50:29 devstack sudo[98036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:29 devstack sudo[98036]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:29 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-171cddb5-0df3-480a-b388-df4f803405e1 tempest-SnapshotsActionsTest-1092359652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.5ed29e7f-5a65-4816-ba58-6c2a8d45d356" returned: 0 in 0.773s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:29 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-171cddb5-0df3-480a-b388-df4f803405e1 tempest-SnapshotsActionsTest-1092359652 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f821731-481f-48bc-a117-d3b8845a782d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 06:50:29 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e00e396-53a3-47ed-80ab-732b0e981f3f]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:50:29 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-171cddb5-0df3-480a-b388-df4f803405e1 tempest-SnapshotsActionsTest-1092359652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.48790f5b-53f9-406d-ab8a-fc6d7cb48f3f {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:29 devstack sudo[98052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.48790f5b-53f9-406d-ab8a-fc6d7cb48f3f Sep 08 06:50:29 devstack sudo[98052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:30 devstack sudo[98052]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:30 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-171cddb5-0df3-480a-b388-df4f803405e1 tempest-SnapshotsActionsTest-1092359652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.48790f5b-53f9-406d-ab8a-fc6d7cb48f3f" returned: 0 in 0.484s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:30 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-171cddb5-0df3-480a-b388-df4f803405e1 tempest-SnapshotsActionsTest-1092359652 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f821731-481f-48bc-a117-d3b8845a782d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 06:50:30 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-171cddb5-0df3-480a-b388-df4f803405e1 tempest-SnapshotsActionsTest-1092359652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.5ed29e7f-5a65-4816-ba58-6c2a8d45d356 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:30 devstack sudo[98057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.5ed29e7f-5a65-4816-ba58-6c2a8d45d356 Sep 08 06:50:30 devstack sudo[98057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:30 devstack sudo[98057]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:30 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-171cddb5-0df3-480a-b388-df4f803405e1 tempest-SnapshotsActionsTest-1092359652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.5ed29e7f-5a65-4816-ba58-6c2a8d45d356" returned: 0 in 0.659s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:30 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-171cddb5-0df3-480a-b388-df4f803405e1 tempest-SnapshotsActionsTest-1092359652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.5ed29e7f-5a65-4816-ba58-6c2a8d45d356 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:30 devstack sudo[98062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.5ed29e7f-5a65-4816-ba58-6c2a8d45d356 Sep 08 06:50:30 devstack sudo[98062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:31 devstack sudo[98062]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-171cddb5-0df3-480a-b388-df4f803405e1 tempest-SnapshotsActionsTest-1092359652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.5ed29e7f-5a65-4816-ba58-6c2a8d45d356" returned: 0 in 0.598s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:31 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-171cddb5-0df3-480a-b388-df4f803405e1 tempest-SnapshotsActionsTest-1092359652 None] Lock "cinder-quobyte-5ed29e7f-5a65-4816-ba58-6c2a8d45d356" released by "_delete_snapshot" :: held 2.715s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:50:31 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-171cddb5-0df3-480a-b388-df4f803405e1 tempest-SnapshotsActionsTest-1092359652 None] Lock "cinder-quobyte-2f821731-481f-48bc-a117-d3b8845a782d" released by "delete_snapshot" :: held 2.767s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:50:31 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-171cddb5-0df3-480a-b388-df4f803405e1 tempest-SnapshotsActionsTest-1092359652 None] Created reservations ['d357581a-ddca-4223-ab98-a40cd01974b0', '0d3d2135-c501-44f8-84d9-0144f0091fcc', '708f2113-d02d-4e8e-a525-f520891054c8', '50027aed-a436-48a1-aee9-4504aca6240b'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:50:31 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-171cddb5-0df3-480a-b388-df4f803405e1 tempest-SnapshotsActionsTest-1092359652 None] Delete snapshot completed successfully. Sep 08 06:50:31 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-171cddb5-0df3-480a-b388-df4f803405e1 tempest-SnapshotsActionsTest-1092359652 None] Lock "cinder-5ed29e7f-5a65-4816-ba58-6c2a8d45d356-delete_snapshot" released by "delete_snapshot" :: held 2.986s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:50:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-6e6e8633-133c-4240-b893-6565a9f06239 tempest-SnapshotsActionsTest-1585549037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:50:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-6e6e8633-133c-4240-b893-6565a9f06239 tempest-SnapshotsActionsTest-1585549037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:50:32 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-6e6e8633-133c-4240-b893-6565a9f06239 tempest-SnapshotsActionsTest-1585549037 None] Creating offline snapshot a465c9b2-fb4e-4703-8729-acb86612866d of volume 2f821731-481f-48bc-a117-d3b8845a782d {{(pid=87507) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 06:50:33 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f9cb97-e01d-4b04-a7f6-995991c936bc]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:50:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6e6e8633-133c-4240-b893-6565a9f06239 tempest-SnapshotsActionsTest-1585549037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.48790f5b-53f9-406d-ab8a-fc6d7cb48f3f {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:33 devstack sudo[98118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.48790f5b-53f9-406d-ab8a-fc6d7cb48f3f Sep 08 06:50:33 devstack sudo[98118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:34 devstack sudo[98118]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:34 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6e6e8633-133c-4240-b893-6565a9f06239 tempest-SnapshotsActionsTest-1585549037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.48790f5b-53f9-406d-ab8a-fc6d7cb48f3f" returned: 0 in 0.924s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:34 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-6e6e8633-133c-4240-b893-6565a9f06239 tempest-SnapshotsActionsTest-1585549037 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f821731-481f-48bc-a117-d3b8845a782d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 06:50:34 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6e6e8633-133c-4240-b893-6565a9f06239 tempest-SnapshotsActionsTest-1585549037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.48790f5b-53f9-406d-ab8a-fc6d7cb48f3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.a465c9b2-fb4e-4703-8729-acb86612866d 1G {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:34 devstack sudo[98139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.48790f5b-53f9-406d-ab8a-fc6d7cb48f3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.a465c9b2-fb4e-4703-8729-acb86612866d 1G Sep 08 06:50:34 devstack sudo[98139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:34 devstack sudo[98139]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:34 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6e6e8633-133c-4240-b893-6565a9f06239 tempest-SnapshotsActionsTest-1585549037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.48790f5b-53f9-406d-ab8a-fc6d7cb48f3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.a465c9b2-fb4e-4703-8729-acb86612866d 1G" returned: 0 in 0.815s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:34 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6e6e8633-133c-4240-b893-6565a9f06239 tempest-SnapshotsActionsTest-1585549037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f821731-481f-48bc-a117-d3b8845a782d.48790f5b-53f9-406d-ab8a-fc6d7cb48f3f -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.a465c9b2-fb4e-4703-8729-acb86612866d {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:34 devstack sudo[98154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f821731-481f-48bc-a117-d3b8845a782d.48790f5b-53f9-406d-ab8a-fc6d7cb48f3f -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.a465c9b2-fb4e-4703-8729-acb86612866d Sep 08 06:50:34 devstack sudo[98154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:35 devstack sudo[98154]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6e6e8633-133c-4240-b893-6565a9f06239 tempest-SnapshotsActionsTest-1585549037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f821731-481f-48bc-a117-d3b8845a782d.48790f5b-53f9-406d-ab8a-fc6d7cb48f3f -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.a465c9b2-fb4e-4703-8729-acb86612866d" returned: 0 in 0.354s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:35 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-6e6e8633-133c-4240-b893-6565a9f06239 tempest-SnapshotsActionsTest-1585549037 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.a465c9b2-fb4e-4703-8729-acb86612866d is being set with open permissions: ugo+rw Sep 08 06:50:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6e6e8633-133c-4240-b893-6565a9f06239 tempest-SnapshotsActionsTest-1585549037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.a465c9b2-fb4e-4703-8729-acb86612866d {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:35 devstack sudo[98159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.a465c9b2-fb4e-4703-8729-acb86612866d Sep 08 06:50:35 devstack sudo[98159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:35 devstack sudo[98159]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6e6e8633-133c-4240-b893-6565a9f06239 tempest-SnapshotsActionsTest-1585549037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.a465c9b2-fb4e-4703-8729-acb86612866d" returned: 0 in 0.248s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-6e6e8633-133c-4240-b893-6565a9f06239 tempest-SnapshotsActionsTest-1585549037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.554s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:50:35 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-6e6e8633-133c-4240-b893-6565a9f06239 tempest-SnapshotsActionsTest-1585549037 None] Create snapshot completed successfully Sep 08 06:50:36 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-82e70530-dee8-4003-97ce-dfd1794bc9e6 tempest-SnapshotsActionsTest-1092359652 None] Acquiring lock "cinder-a465c9b2-fb4e-4703-8729-acb86612866d-delete_snapshot" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:50:36 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-82e70530-dee8-4003-97ce-dfd1794bc9e6 tempest-SnapshotsActionsTest-1092359652 None] Lock "cinder-a465c9b2-fb4e-4703-8729-acb86612866d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:50:36 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-82e70530-dee8-4003-97ce-dfd1794bc9e6 tempest-SnapshotsActionsTest-1092359652 None] Acquiring lock "cinder-quobyte-2f821731-481f-48bc-a117-d3b8845a782d" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:50:36 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-82e70530-dee8-4003-97ce-dfd1794bc9e6 tempest-SnapshotsActionsTest-1092359652 None] Lock "cinder-quobyte-2f821731-481f-48bc-a117-d3b8845a782d" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:50:36 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-82e70530-dee8-4003-97ce-dfd1794bc9e6 tempest-SnapshotsActionsTest-1092359652 None] Acquiring lock "cinder-quobyte-a465c9b2-fb4e-4703-8729-acb86612866d" by "_delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:50:36 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-82e70530-dee8-4003-97ce-dfd1794bc9e6 tempest-SnapshotsActionsTest-1092359652 None] Lock "cinder-quobyte-a465c9b2-fb4e-4703-8729-acb86612866d" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:50:36 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-82e70530-dee8-4003-97ce-dfd1794bc9e6 tempest-SnapshotsActionsTest-1092359652 None] Deleting offline snapshot a465c9b2-fb4e-4703-8729-acb86612866d of volume 2f821731-481f-48bc-a117-d3b8845a782d {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 06:50:36 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-82e70530-dee8-4003-97ce-dfd1794bc9e6 tempest-SnapshotsActionsTest-1092359652 None] snapshot_file for this snap is: volume-2f821731-481f-48bc-a117-d3b8845a782d.a465c9b2-fb4e-4703-8729-acb86612866d {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 06:50:36 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[70271803-4b1c-4c7b-9a98-4d52c2b51143]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:50:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-82e70530-dee8-4003-97ce-dfd1794bc9e6 tempest-SnapshotsActionsTest-1092359652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.a465c9b2-fb4e-4703-8729-acb86612866d {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:36 devstack sudo[98162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.a465c9b2-fb4e-4703-8729-acb86612866d Sep 08 06:50:36 devstack sudo[98162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:36 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-573da78f-b06d-4a3a-b6cb-1f4529951c4d tempest-VolumesActionsTest-1354945798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:50:36 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-573da78f-b06d-4a3a-b6cb-1f4529951c4d tempest-VolumesActionsTest-1354945798 None] Flow 'volume_create_manager' (a17cc62d-57ac-49d2-9357-ee3da497c98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:50:36 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-573da78f-b06d-4a3a-b6cb-1f4529951c4d tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d492abf-ea77-455d-8d06-06ce34229d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:50:36 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-573da78f-b06d-4a3a-b6cb-1f4529951c4d tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d492abf-ea77-455d-8d06-06ce34229d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:50:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-215847216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c70ceeab-c76e-4a9e-9840-cea19435bff7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5635d14e0683482894f5280c0d203e9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:50:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:50:37Z,use_quota=True,user_id='a317e65f2b914c89ba740783ea0eb437',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:50:36 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-573da78f-b06d-4a3a-b6cb-1f4529951c4d tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86ca2464-ec3d-46eb-95ac-b29058fa4449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:50:36 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-573da78f-b06d-4a3a-b6cb-1f4529951c4d tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86ca2464-ec3d-46eb-95ac-b29058fa4449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:50:36 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-573da78f-b06d-4a3a-b6cb-1f4529951c4d tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76dcab0d-02b8-4b7e-95d3-c69562b4386f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:50:36 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-573da78f-b06d-4a3a-b6cb-1f4529951c4d tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76dcab0d-02b8-4b7e-95d3-c69562b4386f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c70ceeab-c76e-4a9e-9840-cea19435bff7', 'volume_name': 'volume-c70ceeab-c76e-4a9e-9840-cea19435bff7', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:50:36 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-573da78f-b06d-4a3a-b6cb-1f4529951c4d tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aac6725a-94e5-47ca-9923-1325443e1d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:50:36 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-573da78f-b06d-4a3a-b6cb-1f4529951c4d tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aac6725a-94e5-47ca-9923-1325443e1d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:50:36 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-573da78f-b06d-4a3a-b6cb-1f4529951c4d tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7edb2f1-8672-42b4-8f86-f1ca1c1cadb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:50:36 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-573da78f-b06d-4a3a-b6cb-1f4529951c4d tempest-VolumesActionsTest-1354945798 None] Volume c70ceeab-c76e-4a9e-9840-cea19435bff7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c70ceeab-c76e-4a9e-9840-cea19435bff7', 'volume_size': 1} Sep 08 06:50:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-573da78f-b06d-4a3a-b6cb-1f4529951c4d tempest-VolumesActionsTest-1354945798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:50:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-573da78f-b06d-4a3a-b6cb-1f4529951c4d tempest-VolumesActionsTest-1354945798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:50:36 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-573da78f-b06d-4a3a-b6cb-1f4529951c4d tempest-VolumesActionsTest-1354945798 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:50:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-215847216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c70ceeab-c76e-4a9e-9840-cea19435bff7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5635d14e0683482894f5280c0d203e9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:50:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:50:37Z,use_quota=True,user_id='a317e65f2b914c89ba740783ea0eb437',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:50:36 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-573da78f-b06d-4a3a-b6cb-1f4529951c4d tempest-VolumesActionsTest-1354945798 None] Creating volume c70ceeab-c76e-4a9e-9840-cea19435bff7 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:50:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-573da78f-b06d-4a3a-b6cb-1f4529951c4d tempest-VolumesActionsTest-1354945798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:50:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-573da78f-b06d-4a3a-b6cb-1f4529951c4d tempest-VolumesActionsTest-1354945798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:50:36 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-573da78f-b06d-4a3a-b6cb-1f4529951c4d tempest-VolumesActionsTest-1354945798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:50:36 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-573da78f-b06d-4a3a-b6cb-1f4529951c4d tempest-VolumesActionsTest-1354945798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:50:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-573da78f-b06d-4a3a-b6cb-1f4529951c4d tempest-VolumesActionsTest-1354945798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:50:36 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-573da78f-b06d-4a3a-b6cb-1f4529951c4d tempest-VolumesActionsTest-1354945798 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:50:36 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-573da78f-b06d-4a3a-b6cb-1f4529951c4d tempest-VolumesActionsTest-1354945798 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:50:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-573da78f-b06d-4a3a-b6cb-1f4529951c4d tempest-VolumesActionsTest-1354945798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c70ceeab-c76e-4a9e-9840-cea19435bff7 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:37 devstack sudo[98167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c70ceeab-c76e-4a9e-9840-cea19435bff7 1073741824 Sep 08 06:50:37 devstack sudo[98167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:37 devstack sudo[98162]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-82e70530-dee8-4003-97ce-dfd1794bc9e6 tempest-SnapshotsActionsTest-1092359652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.a465c9b2-fb4e-4703-8729-acb86612866d" returned: 0 in 0.556s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:37 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-82e70530-dee8-4003-97ce-dfd1794bc9e6 tempest-SnapshotsActionsTest-1092359652 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f821731-481f-48bc-a117-d3b8845a782d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 06:50:37 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b6c4e63-7064-403f-8e62-1746951a37a8]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:50:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-82e70530-dee8-4003-97ce-dfd1794bc9e6 tempest-SnapshotsActionsTest-1092359652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.48790f5b-53f9-406d-ab8a-fc6d7cb48f3f {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:37 devstack sudo[98169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.48790f5b-53f9-406d-ab8a-fc6d7cb48f3f Sep 08 06:50:37 devstack sudo[98169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:37 devstack sudo[98169]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:37 devstack sudo[98167]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-82e70530-dee8-4003-97ce-dfd1794bc9e6 tempest-SnapshotsActionsTest-1092359652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.48790f5b-53f9-406d-ab8a-fc6d7cb48f3f" returned: 0 in 0.494s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:37 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-82e70530-dee8-4003-97ce-dfd1794bc9e6 tempest-SnapshotsActionsTest-1092359652 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f821731-481f-48bc-a117-d3b8845a782d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 06:50:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-82e70530-dee8-4003-97ce-dfd1794bc9e6 tempest-SnapshotsActionsTest-1092359652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.a465c9b2-fb4e-4703-8729-acb86612866d {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-573da78f-b06d-4a3a-b6cb-1f4529951c4d tempest-VolumesActionsTest-1354945798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c70ceeab-c76e-4a9e-9840-cea19435bff7 1073741824" returned: 0 in 0.619s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:37 devstack sudo[98179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.a465c9b2-fb4e-4703-8729-acb86612866d Sep 08 06:50:37 devstack sudo[98179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-573da78f-b06d-4a3a-b6cb-1f4529951c4d tempest-VolumesActionsTest-1354945798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c70ceeab-c76e-4a9e-9840-cea19435bff7 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:37 devstack sudo[98181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c70ceeab-c76e-4a9e-9840-cea19435bff7 Sep 08 06:50:37 devstack sudo[98181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:37 devstack sudo[98181]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-573da78f-b06d-4a3a-b6cb-1f4529951c4d tempest-VolumesActionsTest-1354945798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c70ceeab-c76e-4a9e-9840-cea19435bff7" returned: 0 in 0.355s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:37 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-573da78f-b06d-4a3a-b6cb-1f4529951c4d tempest-VolumesActionsTest-1354945798 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:50:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-573da78f-b06d-4a3a-b6cb-1f4529951c4d tempest-VolumesActionsTest-1354945798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:50:38 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-573da78f-b06d-4a3a-b6cb-1f4529951c4d tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7edb2f1-8672-42b4-8f86-f1ca1c1cadb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c70ceeab-c76e-4a9e-9840-cea19435bff7', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:50:38 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-573da78f-b06d-4a3a-b6cb-1f4529951c4d tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be6768e7-52c1-4dd6-9b90-390ffbffdac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:50:38 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-573da78f-b06d-4a3a-b6cb-1f4529951c4d tempest-VolumesActionsTest-1354945798 None] Volume volume-c70ceeab-c76e-4a9e-9840-cea19435bff7 (c70ceeab-c76e-4a9e-9840-cea19435bff7): created successfully Sep 08 06:50:38 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-573da78f-b06d-4a3a-b6cb-1f4529951c4d tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be6768e7-52c1-4dd6-9b90-390ffbffdac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:50:38 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-573da78f-b06d-4a3a-b6cb-1f4529951c4d tempest-VolumesActionsTest-1354945798 None] Flow 'volume_create_manager' (a17cc62d-57ac-49d2-9357-ee3da497c98d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:50:38 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-573da78f-b06d-4a3a-b6cb-1f4529951c4d tempest-VolumesActionsTest-1354945798 None] Created volume successfully. Sep 08 06:50:38 devstack sudo[98179]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-82e70530-dee8-4003-97ce-dfd1794bc9e6 tempest-SnapshotsActionsTest-1092359652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.a465c9b2-fb4e-4703-8729-acb86612866d" returned: 0 in 0.565s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-82e70530-dee8-4003-97ce-dfd1794bc9e6 tempest-SnapshotsActionsTest-1092359652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.a465c9b2-fb4e-4703-8729-acb86612866d {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:38 devstack sudo[98189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.a465c9b2-fb4e-4703-8729-acb86612866d Sep 08 06:50:38 devstack sudo[98189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:38 devstack sudo[98189]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-82e70530-dee8-4003-97ce-dfd1794bc9e6 tempest-SnapshotsActionsTest-1092359652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.a465c9b2-fb4e-4703-8729-acb86612866d" returned: 0 in 0.271s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:38 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-82e70530-dee8-4003-97ce-dfd1794bc9e6 tempest-SnapshotsActionsTest-1092359652 None] Lock "cinder-quobyte-a465c9b2-fb4e-4703-8729-acb86612866d" released by "_delete_snapshot" :: held 2.050s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:50:38 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-82e70530-dee8-4003-97ce-dfd1794bc9e6 tempest-SnapshotsActionsTest-1092359652 None] Lock "cinder-quobyte-2f821731-481f-48bc-a117-d3b8845a782d" released by "delete_snapshot" :: held 2.099s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:50:38 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-82e70530-dee8-4003-97ce-dfd1794bc9e6 tempest-SnapshotsActionsTest-1092359652 None] Created reservations ['2f9dd6a3-b530-4165-8196-5c678beff640', 'ca39d8cb-875c-41ac-8afa-d906f6078c6d', '24f5d70d-fb0c-442e-ac43-ce5baa9a2596', '5011d442-8d85-4a0f-880a-eedd54639e17'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:50:38 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-82e70530-dee8-4003-97ce-dfd1794bc9e6 tempest-SnapshotsActionsTest-1092359652 None] Delete snapshot completed successfully. Sep 08 06:50:38 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-82e70530-dee8-4003-97ce-dfd1794bc9e6 tempest-SnapshotsActionsTest-1092359652 None] Lock "cinder-a465c9b2-fb4e-4703-8729-acb86612866d-delete_snapshot" released by "delete_snapshot" :: held 2.256s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:50:38 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-6d51f398-7b84-4efb-ae0a-8a401ed79ee9 tempest-VolumesActionsTest-1354945798 None] Acquiring lock "cinder-c70ceeab-c76e-4a9e-9840-cea19435bff7" by "attach_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:50:38 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-6d51f398-7b84-4efb-ae0a-8a401ed79ee9 tempest-VolumesActionsTest-1354945798 None] Lock "cinder-c70ceeab-c76e-4a9e-9840-cea19435bff7" acquired by "attach_volume" :: waited 0.022s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:50:38 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-6d51f398-7b84-4efb-ae0a-8a401ed79ee9 tempest-VolumesActionsTest-1354945798 None] Attaching volume c70ceeab-c76e-4a9e-9840-cea19435bff7 to instance 48c604ba-6a12-422a-bb9b-d64cff3f2e88 at mountpoint /dev/vdb on host None. Sep 08 06:50:39 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-6d51f398-7b84-4efb-ae0a-8a401ed79ee9 tempest-VolumesActionsTest-1354945798 None] Attach volume completed successfully. Sep 08 06:50:39 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-6d51f398-7b84-4efb-ae0a-8a401ed79ee9 tempest-VolumesActionsTest-1354945798 None] Lock "cinder-c70ceeab-c76e-4a9e-9840-cea19435bff7" released by "attach_volume" :: held 0.104s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:50:39 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-e392c6f0-871f-422b-9601-191d078acd50 tempest-VolumesActionsTest-1384967596 None] Terminate volume connection completed successfully. Sep 08 06:50:39 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-e392c6f0-871f-422b-9601-191d078acd50 tempest-VolumesActionsTest-1384967596 None] Acquiring lock "cinder-c70ceeab-c76e-4a9e-9840-cea19435bff7-detach_volume" by "detach_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:50:39 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-e392c6f0-871f-422b-9601-191d078acd50 tempest-VolumesActionsTest-1384967596 None] Lock "cinder-c70ceeab-c76e-4a9e-9840-cea19435bff7-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:50:39 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-e392c6f0-871f-422b-9601-191d078acd50 tempest-VolumesActionsTest-1384967596 None] Detaching volume c70ceeab-c76e-4a9e-9840-cea19435bff7 from instance 48c604ba-6a12-422a-bb9b-d64cff3f2e88. Sep 08 06:50:39 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-e392c6f0-871f-422b-9601-191d078acd50 tempest-VolumesActionsTest-1384967596 None] Detach volume completed successfully. Sep 08 06:50:39 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-e392c6f0-871f-422b-9601-191d078acd50 tempest-VolumesActionsTest-1384967596 None] Lock "cinder-c70ceeab-c76e-4a9e-9840-cea19435bff7-detach_volume" released by "detach_volume" :: held 0.110s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:50:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-974ac784-e26c-4e92-ba0b-b6fa08d8c785 tempest-SnapshotsActionsTest-1585549037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:50:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-974ac784-e26c-4e92-ba0b-b6fa08d8c785 tempest-SnapshotsActionsTest-1585549037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:50:40 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-974ac784-e26c-4e92-ba0b-b6fa08d8c785 tempest-SnapshotsActionsTest-1585549037 None] Creating offline snapshot cdb8bc6d-549f-4f29-84d6-2d0ed6cd8002 of volume 2f821731-481f-48bc-a117-d3b8845a782d {{(pid=87507) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 06:50:40 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-08506793-f3b1-4bc5-80c1-54b80ab098d9 tempest-VolumesActionsTest-1354945798 None] Acquiring lock "cinder-c70ceeab-c76e-4a9e-9840-cea19435bff7-detach_volume" by "detach_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:50:40 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[105e459b-1d7a-4a44-b4f1-97a277447635]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:50:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-974ac784-e26c-4e92-ba0b-b6fa08d8c785 tempest-SnapshotsActionsTest-1585549037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.48790f5b-53f9-406d-ab8a-fc6d7cb48f3f {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:40 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-08506793-f3b1-4bc5-80c1-54b80ab098d9 tempest-VolumesActionsTest-1354945798 None] Lock "cinder-c70ceeab-c76e-4a9e-9840-cea19435bff7-detach_volume" acquired by "detach_volume" :: waited 0.037s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:50:40 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-08506793-f3b1-4bc5-80c1-54b80ab098d9 tempest-VolumesActionsTest-1354945798 None] Volume detach called, but volume not attached. Sep 08 06:50:40 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-08506793-f3b1-4bc5-80c1-54b80ab098d9 tempest-VolumesActionsTest-1354945798 None] Lock "cinder-c70ceeab-c76e-4a9e-9840-cea19435bff7-detach_volume" released by "detach_volume" :: held 0.023s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:50:40 devstack sudo[98193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.48790f5b-53f9-406d-ab8a-fc6d7cb48f3f Sep 08 06:50:40 devstack sudo[98193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:40 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-347b87fd-7eca-4cd8-8577-2af84ab86e73 tempest-VolumesActionsTest-1354945798 None] Acquiring lock "cinder-c70ceeab-c76e-4a9e-9840-cea19435bff7-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:50:40 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-347b87fd-7eca-4cd8-8577-2af84ab86e73 tempest-VolumesActionsTest-1354945798 None] Lock "cinder-c70ceeab-c76e-4a9e-9840-cea19435bff7-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:50:40 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-347b87fd-7eca-4cd8-8577-2af84ab86e73 tempest-VolumesActionsTest-1354945798 None] Acquiring lock "cinder-quobyte-c70ceeab-c76e-4a9e-9840-cea19435bff7" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:50:40 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-347b87fd-7eca-4cd8-8577-2af84ab86e73 tempest-VolumesActionsTest-1354945798 None] Lock "cinder-quobyte-c70ceeab-c76e-4a9e-9840-cea19435bff7" acquired by "delete_volume" :: waited 0.026s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:50:40 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7ebe3c-dde5-4398-9e9c-9042ec93fc7e]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:50:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-347b87fd-7eca-4cd8-8577-2af84ab86e73 tempest-VolumesActionsTest-1354945798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c70ceeab-c76e-4a9e-9840-cea19435bff7 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:40 devstack sudo[98193]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-974ac784-e26c-4e92-ba0b-b6fa08d8c785 tempest-SnapshotsActionsTest-1585549037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.48790f5b-53f9-406d-ab8a-fc6d7cb48f3f" returned: 0 in 0.581s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:40 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-974ac784-e26c-4e92-ba0b-b6fa08d8c785 tempest-SnapshotsActionsTest-1585549037 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f821731-481f-48bc-a117-d3b8845a782d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 06:50:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-974ac784-e26c-4e92-ba0b-b6fa08d8c785 tempest-SnapshotsActionsTest-1585549037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.48790f5b-53f9-406d-ab8a-fc6d7cb48f3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.cdb8bc6d-549f-4f29-84d6-2d0ed6cd8002 1G {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:40 devstack sudo[98199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.48790f5b-53f9-406d-ab8a-fc6d7cb48f3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.cdb8bc6d-549f-4f29-84d6-2d0ed6cd8002 1G Sep 08 06:50:40 devstack sudo[98199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:40 devstack sudo[98198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c70ceeab-c76e-4a9e-9840-cea19435bff7 Sep 08 06:50:40 devstack sudo[98198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:41 devstack sudo[98198]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-347b87fd-7eca-4cd8-8577-2af84ab86e73 tempest-VolumesActionsTest-1354945798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c70ceeab-c76e-4a9e-9840-cea19435bff7" returned: 0 in 0.481s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-347b87fd-7eca-4cd8-8577-2af84ab86e73 tempest-VolumesActionsTest-1354945798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c70ceeab-c76e-4a9e-9840-cea19435bff7 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:41 devstack sudo[98209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c70ceeab-c76e-4a9e-9840-cea19435bff7 Sep 08 06:50:41 devstack sudo[98209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:41 devstack sudo[98199]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-974ac784-e26c-4e92-ba0b-b6fa08d8c785 tempest-SnapshotsActionsTest-1585549037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.48790f5b-53f9-406d-ab8a-fc6d7cb48f3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.cdb8bc6d-549f-4f29-84d6-2d0ed6cd8002 1G" returned: 0 in 0.560s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-974ac784-e26c-4e92-ba0b-b6fa08d8c785 tempest-SnapshotsActionsTest-1585549037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f821731-481f-48bc-a117-d3b8845a782d.48790f5b-53f9-406d-ab8a-fc6d7cb48f3f -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.cdb8bc6d-549f-4f29-84d6-2d0ed6cd8002 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:41 devstack sudo[98211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f821731-481f-48bc-a117-d3b8845a782d.48790f5b-53f9-406d-ab8a-fc6d7cb48f3f -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.cdb8bc6d-549f-4f29-84d6-2d0ed6cd8002 Sep 08 06:50:41 devstack sudo[98211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:41 devstack sudo[98209]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-347b87fd-7eca-4cd8-8577-2af84ab86e73 tempest-VolumesActionsTest-1354945798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c70ceeab-c76e-4a9e-9840-cea19435bff7" returned: 0 in 0.287s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:41 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-347b87fd-7eca-4cd8-8577-2af84ab86e73 tempest-VolumesActionsTest-1354945798 None] Lock "cinder-quobyte-c70ceeab-c76e-4a9e-9840-cea19435bff7" released by "delete_volume" :: held 0.820s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:50:41 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-347b87fd-7eca-4cd8-8577-2af84ab86e73 tempest-VolumesActionsTest-1354945798 None] Created reservations ['ec2f466a-c65a-45c7-a1a5-a394de636050', '79c55a41-0ceb-41ce-8fbd-cfcc8dac4609', 'efdb6024-ca2e-4251-babc-70c63a75059c', '701541ff-bfd9-4265-a4bc-06a878d89fa9'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:50:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-347b87fd-7eca-4cd8-8577-2af84ab86e73 tempest-VolumesActionsTest-1354945798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:50:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-347b87fd-7eca-4cd8-8577-2af84ab86e73 tempest-VolumesActionsTest-1354945798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:50:41 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-347b87fd-7eca-4cd8-8577-2af84ab86e73 tempest-VolumesActionsTest-1354945798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:50:41 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-347b87fd-7eca-4cd8-8577-2af84ab86e73 tempest-VolumesActionsTest-1354945798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:50:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-347b87fd-7eca-4cd8-8577-2af84ab86e73 tempest-VolumesActionsTest-1354945798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:50:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-347b87fd-7eca-4cd8-8577-2af84ab86e73 tempest-VolumesActionsTest-1354945798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:41 devstack sudo[98217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:50:41 devstack sudo[98217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:41 devstack sudo[98211]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-974ac784-e26c-4e92-ba0b-b6fa08d8c785 tempest-SnapshotsActionsTest-1585549037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f821731-481f-48bc-a117-d3b8845a782d.48790f5b-53f9-406d-ab8a-fc6d7cb48f3f -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.cdb8bc6d-549f-4f29-84d6-2d0ed6cd8002" returned: 0 in 0.549s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:41 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-974ac784-e26c-4e92-ba0b-b6fa08d8c785 tempest-SnapshotsActionsTest-1585549037 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.cdb8bc6d-549f-4f29-84d6-2d0ed6cd8002 is being set with open permissions: ugo+rw Sep 08 06:50:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-974ac784-e26c-4e92-ba0b-b6fa08d8c785 tempest-SnapshotsActionsTest-1585549037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.cdb8bc6d-549f-4f29-84d6-2d0ed6cd8002 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:41 devstack sudo[98220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.cdb8bc6d-549f-4f29-84d6-2d0ed6cd8002 Sep 08 06:50:41 devstack sudo[98220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:42 devstack sudo[98217]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-347b87fd-7eca-4cd8-8577-2af84ab86e73 tempest-VolumesActionsTest-1354945798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.314s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:42 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-347b87fd-7eca-4cd8-8577-2af84ab86e73 tempest-VolumesActionsTest-1354945798 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:50:42 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-347b87fd-7eca-4cd8-8577-2af84ab86e73 tempest-VolumesActionsTest-1354945798 None] Deleted volume successfully. Sep 08 06:50:42 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-347b87fd-7eca-4cd8-8577-2af84ab86e73 tempest-VolumesActionsTest-1354945798 None] Lock "cinder-c70ceeab-c76e-4a9e-9840-cea19435bff7-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:50:42 devstack sudo[98220]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-974ac784-e26c-4e92-ba0b-b6fa08d8c785 tempest-SnapshotsActionsTest-1585549037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.cdb8bc6d-549f-4f29-84d6-2d0ed6cd8002" returned: 0 in 0.491s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-974ac784-e26c-4e92-ba0b-b6fa08d8c785 tempest-SnapshotsActionsTest-1585549037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.302s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:50:42 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-974ac784-e26c-4e92-ba0b-b6fa08d8c785 tempest-SnapshotsActionsTest-1585549037 None] Create snapshot completed successfully Sep 08 06:50:43 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-a77ee77a-a505-440b-b579-ab09addd2db3 tempest-SnapshotsActionsTest-1092359652 None] Acquiring lock "cinder-cdb8bc6d-549f-4f29-84d6-2d0ed6cd8002-delete_snapshot" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:50:43 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-a77ee77a-a505-440b-b579-ab09addd2db3 tempest-SnapshotsActionsTest-1092359652 None] Lock "cinder-cdb8bc6d-549f-4f29-84d6-2d0ed6cd8002-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:50:43 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-a77ee77a-a505-440b-b579-ab09addd2db3 tempest-SnapshotsActionsTest-1092359652 None] Acquiring lock "cinder-quobyte-2f821731-481f-48bc-a117-d3b8845a782d" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:50:43 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-a77ee77a-a505-440b-b579-ab09addd2db3 tempest-SnapshotsActionsTest-1092359652 None] Lock "cinder-quobyte-2f821731-481f-48bc-a117-d3b8845a782d" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:50:43 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-a77ee77a-a505-440b-b579-ab09addd2db3 tempest-SnapshotsActionsTest-1092359652 None] Acquiring lock "cinder-quobyte-cdb8bc6d-549f-4f29-84d6-2d0ed6cd8002" by "_delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:50:43 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-a77ee77a-a505-440b-b579-ab09addd2db3 tempest-SnapshotsActionsTest-1092359652 None] Lock "cinder-quobyte-cdb8bc6d-549f-4f29-84d6-2d0ed6cd8002" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:50:43 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-a77ee77a-a505-440b-b579-ab09addd2db3 tempest-SnapshotsActionsTest-1092359652 None] Deleting offline snapshot cdb8bc6d-549f-4f29-84d6-2d0ed6cd8002 of volume 2f821731-481f-48bc-a117-d3b8845a782d {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 06:50:43 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-a77ee77a-a505-440b-b579-ab09addd2db3 tempest-SnapshotsActionsTest-1092359652 None] snapshot_file for this snap is: volume-2f821731-481f-48bc-a117-d3b8845a782d.cdb8bc6d-549f-4f29-84d6-2d0ed6cd8002 {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 06:50:43 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d759db18-bac0-4805-8516-ca6b3fc944f3]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:50:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a77ee77a-a505-440b-b579-ab09addd2db3 tempest-SnapshotsActionsTest-1092359652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.cdb8bc6d-549f-4f29-84d6-2d0ed6cd8002 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:43 devstack sudo[98276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.cdb8bc6d-549f-4f29-84d6-2d0ed6cd8002 Sep 08 06:50:43 devstack sudo[98276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:44 devstack sudo[98276]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a77ee77a-a505-440b-b579-ab09addd2db3 tempest-SnapshotsActionsTest-1092359652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.cdb8bc6d-549f-4f29-84d6-2d0ed6cd8002" returned: 0 in 0.569s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:44 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-a77ee77a-a505-440b-b579-ab09addd2db3 tempest-SnapshotsActionsTest-1092359652 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f821731-481f-48bc-a117-d3b8845a782d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 06:50:44 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3bd8eba-96dc-41bc-94e1-13175435c0d6]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:50:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a77ee77a-a505-440b-b579-ab09addd2db3 tempest-SnapshotsActionsTest-1092359652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.48790f5b-53f9-406d-ab8a-fc6d7cb48f3f {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:44 devstack sudo[98283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.48790f5b-53f9-406d-ab8a-fc6d7cb48f3f Sep 08 06:50:44 devstack sudo[98283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:44 devstack sudo[98283]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a77ee77a-a505-440b-b579-ab09addd2db3 tempest-SnapshotsActionsTest-1092359652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.48790f5b-53f9-406d-ab8a-fc6d7cb48f3f" returned: 0 in 0.446s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:44 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-a77ee77a-a505-440b-b579-ab09addd2db3 tempest-SnapshotsActionsTest-1092359652 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f821731-481f-48bc-a117-d3b8845a782d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 06:50:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a77ee77a-a505-440b-b579-ab09addd2db3 tempest-SnapshotsActionsTest-1092359652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.cdb8bc6d-549f-4f29-84d6-2d0ed6cd8002 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:44 devstack sudo[98288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.cdb8bc6d-549f-4f29-84d6-2d0ed6cd8002 Sep 08 06:50:44 devstack sudo[98288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:45 devstack sudo[98288]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a77ee77a-a505-440b-b579-ab09addd2db3 tempest-SnapshotsActionsTest-1092359652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.cdb8bc6d-549f-4f29-84d6-2d0ed6cd8002" returned: 0 in 0.455s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a77ee77a-a505-440b-b579-ab09addd2db3 tempest-SnapshotsActionsTest-1092359652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.cdb8bc6d-549f-4f29-84d6-2d0ed6cd8002 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:45 devstack sudo[98299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.cdb8bc6d-549f-4f29-84d6-2d0ed6cd8002 Sep 08 06:50:45 devstack sudo[98299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:45 devstack sudo[98299]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a77ee77a-a505-440b-b579-ab09addd2db3 tempest-SnapshotsActionsTest-1092359652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.cdb8bc6d-549f-4f29-84d6-2d0ed6cd8002" returned: 0 in 0.260s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:45 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-a77ee77a-a505-440b-b579-ab09addd2db3 tempest-SnapshotsActionsTest-1092359652 None] Lock "cinder-quobyte-cdb8bc6d-549f-4f29-84d6-2d0ed6cd8002" released by "_delete_snapshot" :: held 1.873s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:50:45 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-a77ee77a-a505-440b-b579-ab09addd2db3 tempest-SnapshotsActionsTest-1092359652 None] Lock "cinder-quobyte-2f821731-481f-48bc-a117-d3b8845a782d" released by "delete_snapshot" :: held 1.909s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:50:45 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-a77ee77a-a505-440b-b579-ab09addd2db3 tempest-SnapshotsActionsTest-1092359652 None] Created reservations ['3b806824-a756-4853-8c9d-b7d38593329e', '246274d6-2a34-421f-bd4f-439898908d52', '459fbcb3-06d9-43ba-b0b8-cd1147f60d6b', 'a940ac00-2d3b-4875-bcd1-910d43f8e6d8'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:50:45 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-a77ee77a-a505-440b-b579-ab09addd2db3 tempest-SnapshotsActionsTest-1092359652 None] Delete snapshot completed successfully. Sep 08 06:50:45 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-a77ee77a-a505-440b-b579-ab09addd2db3 tempest-SnapshotsActionsTest-1092359652 None] Lock "cinder-cdb8bc6d-549f-4f29-84d6-2d0ed6cd8002-delete_snapshot" released by "delete_snapshot" :: held 2.069s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:50:45 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b42c56c-5b5e-4bb1-b3e2-0c44a0dfaa97 tempest-VolumesActionsTest-1354945798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:50:45 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6b42c56c-5b5e-4bb1-b3e2-0c44a0dfaa97 tempest-VolumesActionsTest-1354945798 None] Flow 'volume_create_manager' (8cad9ea7-18fa-4199-8d4e-c053a03312cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:50:45 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6b42c56c-5b5e-4bb1-b3e2-0c44a0dfaa97 tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7749429c-df16-40a0-a7ab-f8d2c5dac461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:50:45 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6b42c56c-5b5e-4bb1-b3e2-0c44a0dfaa97 tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7749429c-df16-40a0-a7ab-f8d2c5dac461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:50:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1199225387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a21c2fc3-d6cf-4662-8191-2d713c537c1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5635d14e0683482894f5280c0d203e9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:50:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:50:46Z,use_quota=True,user_id='a317e65f2b914c89ba740783ea0eb437',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:50:45 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6b42c56c-5b5e-4bb1-b3e2-0c44a0dfaa97 tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0ee7ec5-1299-40b3-ae35-486455e711af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:50:45 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6b42c56c-5b5e-4bb1-b3e2-0c44a0dfaa97 tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0ee7ec5-1299-40b3-ae35-486455e711af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:50:45 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6b42c56c-5b5e-4bb1-b3e2-0c44a0dfaa97 tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0d9b3ed-ecee-4629-bbbd-70865e06fe41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:50:45 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6b42c56c-5b5e-4bb1-b3e2-0c44a0dfaa97 tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0d9b3ed-ecee-4629-bbbd-70865e06fe41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a21c2fc3-d6cf-4662-8191-2d713c537c1f', 'volume_name': 'volume-a21c2fc3-d6cf-4662-8191-2d713c537c1f', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:50:45 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6b42c56c-5b5e-4bb1-b3e2-0c44a0dfaa97 tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a25172e-1628-415e-8129-fbce62e56d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:50:45 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6b42c56c-5b5e-4bb1-b3e2-0c44a0dfaa97 tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a25172e-1628-415e-8129-fbce62e56d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:50:45 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6b42c56c-5b5e-4bb1-b3e2-0c44a0dfaa97 tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (322eaeb5-2a2e-4a0c-b28c-bc2a158214fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:50:45 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-6b42c56c-5b5e-4bb1-b3e2-0c44a0dfaa97 tempest-VolumesActionsTest-1354945798 None] Volume a21c2fc3-d6cf-4662-8191-2d713c537c1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a21c2fc3-d6cf-4662-8191-2d713c537c1f', 'volume_size': 1} Sep 08 06:50:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-6b42c56c-5b5e-4bb1-b3e2-0c44a0dfaa97 tempest-VolumesActionsTest-1354945798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:50:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-6b42c56c-5b5e-4bb1-b3e2-0c44a0dfaa97 tempest-VolumesActionsTest-1354945798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:50:45 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-6b42c56c-5b5e-4bb1-b3e2-0c44a0dfaa97 tempest-VolumesActionsTest-1354945798 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:50:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1199225387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a21c2fc3-d6cf-4662-8191-2d713c537c1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5635d14e0683482894f5280c0d203e9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:50:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:50:46Z,use_quota=True,user_id='a317e65f2b914c89ba740783ea0eb437',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:50:45 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-6b42c56c-5b5e-4bb1-b3e2-0c44a0dfaa97 tempest-VolumesActionsTest-1354945798 None] Creating volume a21c2fc3-d6cf-4662-8191-2d713c537c1f {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:50:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-6b42c56c-5b5e-4bb1-b3e2-0c44a0dfaa97 tempest-VolumesActionsTest-1354945798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:50:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-6b42c56c-5b5e-4bb1-b3e2-0c44a0dfaa97 tempest-VolumesActionsTest-1354945798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:50:45 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-6b42c56c-5b5e-4bb1-b3e2-0c44a0dfaa97 tempest-VolumesActionsTest-1354945798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:50:45 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-6b42c56c-5b5e-4bb1-b3e2-0c44a0dfaa97 tempest-VolumesActionsTest-1354945798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:50:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-6b42c56c-5b5e-4bb1-b3e2-0c44a0dfaa97 tempest-VolumesActionsTest-1354945798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:50:45 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-6b42c56c-5b5e-4bb1-b3e2-0c44a0dfaa97 tempest-VolumesActionsTest-1354945798 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:50:45 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-6b42c56c-5b5e-4bb1-b3e2-0c44a0dfaa97 tempest-VolumesActionsTest-1354945798 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:50:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6b42c56c-5b5e-4bb1-b3e2-0c44a0dfaa97 tempest-VolumesActionsTest-1354945798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a21c2fc3-d6cf-4662-8191-2d713c537c1f 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:45 devstack sudo[98302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a21c2fc3-d6cf-4662-8191-2d713c537c1f 1073741824 Sep 08 06:50:45 devstack sudo[98302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-f304f628-5f94-4e6f-acd7-2474fcecf809 tempest-SnapshotsActionsTest-1585549037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:50:46 devstack sudo[98302]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6b42c56c-5b5e-4bb1-b3e2-0c44a0dfaa97 tempest-VolumesActionsTest-1354945798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a21c2fc3-d6cf-4662-8191-2d713c537c1f 1073741824" returned: 0 in 0.436s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6b42c56c-5b5e-4bb1-b3e2-0c44a0dfaa97 tempest-VolumesActionsTest-1354945798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a21c2fc3-d6cf-4662-8191-2d713c537c1f {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:46 devstack sudo[98308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a21c2fc3-d6cf-4662-8191-2d713c537c1f Sep 08 06:50:46 devstack sudo[98308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:46 devstack sudo[98308]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6b42c56c-5b5e-4bb1-b3e2-0c44a0dfaa97 tempest-VolumesActionsTest-1354945798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a21c2fc3-d6cf-4662-8191-2d713c537c1f" returned: 0 in 0.244s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:46 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-6b42c56c-5b5e-4bb1-b3e2-0c44a0dfaa97 tempest-VolumesActionsTest-1354945798 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:50:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-6b42c56c-5b5e-4bb1-b3e2-0c44a0dfaa97 tempest-VolumesActionsTest-1354945798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:50:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-f304f628-5f94-4e6f-acd7-2474fcecf809 tempest-SnapshotsActionsTest-1585549037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.505s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:50:46 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6b42c56c-5b5e-4bb1-b3e2-0c44a0dfaa97 tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (322eaeb5-2a2e-4a0c-b28c-bc2a158214fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a21c2fc3-d6cf-4662-8191-2d713c537c1f', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:50:46 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6b42c56c-5b5e-4bb1-b3e2-0c44a0dfaa97 tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9da1a43f-4340-47f5-8ac7-8b6a357d733b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:50:46 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-f304f628-5f94-4e6f-acd7-2474fcecf809 tempest-SnapshotsActionsTest-1585549037 None] Creating offline snapshot 8a99d96a-622a-48db-88be-2e41e496de44 of volume 2f821731-481f-48bc-a117-d3b8845a782d {{(pid=87507) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 06:50:46 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-6b42c56c-5b5e-4bb1-b3e2-0c44a0dfaa97 tempest-VolumesActionsTest-1354945798 None] Volume volume-a21c2fc3-d6cf-4662-8191-2d713c537c1f (a21c2fc3-d6cf-4662-8191-2d713c537c1f): created successfully Sep 08 06:50:46 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6b42c56c-5b5e-4bb1-b3e2-0c44a0dfaa97 tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9da1a43f-4340-47f5-8ac7-8b6a357d733b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:50:46 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6b42c56c-5b5e-4bb1-b3e2-0c44a0dfaa97 tempest-VolumesActionsTest-1354945798 None] Flow 'volume_create_manager' (8cad9ea7-18fa-4199-8d4e-c053a03312cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:50:46 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e12f304-e09c-4c17-acb4-518c8381f009]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:50:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f304f628-5f94-4e6f-acd7-2474fcecf809 tempest-SnapshotsActionsTest-1585549037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.48790f5b-53f9-406d-ab8a-fc6d7cb48f3f {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:46 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-6b42c56c-5b5e-4bb1-b3e2-0c44a0dfaa97 tempest-VolumesActionsTest-1354945798 None] Created volume successfully. Sep 08 06:50:46 devstack sudo[98311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.48790f5b-53f9-406d-ab8a-fc6d7cb48f3f Sep 08 06:50:46 devstack sudo[98311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:46 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-6ad94587-556d-42c1-ae2c-5505deb3b3ee tempest-VolumesActionsTest-1384967596 None] Acquiring lock "cinder-a21c2fc3-d6cf-4662-8191-2d713c537c1f-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:50:46 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-6ad94587-556d-42c1-ae2c-5505deb3b3ee tempest-VolumesActionsTest-1384967596 None] Lock "cinder-a21c2fc3-d6cf-4662-8191-2d713c537c1f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:50:46 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-6ad94587-556d-42c1-ae2c-5505deb3b3ee tempest-VolumesActionsTest-1384967596 None] Acquiring lock "cinder-quobyte-a21c2fc3-d6cf-4662-8191-2d713c537c1f" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:50:46 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-6ad94587-556d-42c1-ae2c-5505deb3b3ee tempest-VolumesActionsTest-1384967596 None] Lock "cinder-quobyte-a21c2fc3-d6cf-4662-8191-2d713c537c1f" acquired by "delete_volume" :: waited 0.018s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:50:46 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0842c408-51cf-4812-aec1-f3093bf09a29]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:50:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6ad94587-556d-42c1-ae2c-5505deb3b3ee tempest-VolumesActionsTest-1384967596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a21c2fc3-d6cf-4662-8191-2d713c537c1f {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:46 devstack sudo[98311]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f304f628-5f94-4e6f-acd7-2474fcecf809 tempest-SnapshotsActionsTest-1585549037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.48790f5b-53f9-406d-ab8a-fc6d7cb48f3f" returned: 0 in 0.390s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:46 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-f304f628-5f94-4e6f-acd7-2474fcecf809 tempest-SnapshotsActionsTest-1585549037 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f821731-481f-48bc-a117-d3b8845a782d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 06:50:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f304f628-5f94-4e6f-acd7-2474fcecf809 tempest-SnapshotsActionsTest-1585549037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.48790f5b-53f9-406d-ab8a-fc6d7cb48f3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.8a99d96a-622a-48db-88be-2e41e496de44 1G {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:46 devstack sudo[98318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.48790f5b-53f9-406d-ab8a-fc6d7cb48f3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.8a99d96a-622a-48db-88be-2e41e496de44 1G Sep 08 06:50:46 devstack sudo[98318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:46 devstack sudo[98317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a21c2fc3-d6cf-4662-8191-2d713c537c1f Sep 08 06:50:46 devstack sudo[98317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:47 devstack sudo[98317]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6ad94587-556d-42c1-ae2c-5505deb3b3ee tempest-VolumesActionsTest-1384967596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a21c2fc3-d6cf-4662-8191-2d713c537c1f" returned: 0 in 0.370s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6ad94587-556d-42c1-ae2c-5505deb3b3ee tempest-VolumesActionsTest-1384967596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a21c2fc3-d6cf-4662-8191-2d713c537c1f {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:47 devstack sudo[98327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a21c2fc3-d6cf-4662-8191-2d713c537c1f Sep 08 06:50:47 devstack sudo[98327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:47 devstack sudo[98318]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f304f628-5f94-4e6f-acd7-2474fcecf809 tempest-SnapshotsActionsTest-1585549037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.48790f5b-53f9-406d-ab8a-fc6d7cb48f3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.8a99d96a-622a-48db-88be-2e41e496de44 1G" returned: 0 in 0.441s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f304f628-5f94-4e6f-acd7-2474fcecf809 tempest-SnapshotsActionsTest-1585549037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f821731-481f-48bc-a117-d3b8845a782d.48790f5b-53f9-406d-ab8a-fc6d7cb48f3f -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.8a99d96a-622a-48db-88be-2e41e496de44 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:47 devstack sudo[98329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f821731-481f-48bc-a117-d3b8845a782d.48790f5b-53f9-406d-ab8a-fc6d7cb48f3f -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.8a99d96a-622a-48db-88be-2e41e496de44 Sep 08 06:50:47 devstack sudo[98329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:47 devstack sudo[98327]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6ad94587-556d-42c1-ae2c-5505deb3b3ee tempest-VolumesActionsTest-1384967596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a21c2fc3-d6cf-4662-8191-2d713c537c1f" returned: 0 in 0.250s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:47 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-6ad94587-556d-42c1-ae2c-5505deb3b3ee tempest-VolumesActionsTest-1384967596 None] Lock "cinder-quobyte-a21c2fc3-d6cf-4662-8191-2d713c537c1f" released by "delete_volume" :: held 0.671s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:50:47 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-6ad94587-556d-42c1-ae2c-5505deb3b3ee tempest-VolumesActionsTest-1384967596 None] Created reservations ['4604d5bb-f3a9-4dcc-b917-6c5cc1c407ca', '715ae35c-cda0-4eb7-a7bb-b32215c952cc', '83508d31-82ab-486b-8643-e5f3e553ee3a', '464d3e79-d875-4d13-a9cd-4d82884c1320'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:50:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-6ad94587-556d-42c1-ae2c-5505deb3b3ee tempest-VolumesActionsTest-1384967596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:50:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-6ad94587-556d-42c1-ae2c-5505deb3b3ee tempest-VolumesActionsTest-1384967596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:50:47 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-6ad94587-556d-42c1-ae2c-5505deb3b3ee tempest-VolumesActionsTest-1384967596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:50:47 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-6ad94587-556d-42c1-ae2c-5505deb3b3ee tempest-VolumesActionsTest-1384967596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:50:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-6ad94587-556d-42c1-ae2c-5505deb3b3ee tempest-VolumesActionsTest-1384967596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:50:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6ad94587-556d-42c1-ae2c-5505deb3b3ee tempest-VolumesActionsTest-1384967596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:47 devstack sudo[98329]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f304f628-5f94-4e6f-acd7-2474fcecf809 tempest-SnapshotsActionsTest-1585549037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f821731-481f-48bc-a117-d3b8845a782d.48790f5b-53f9-406d-ab8a-fc6d7cb48f3f -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.8a99d96a-622a-48db-88be-2e41e496de44" returned: 0 in 0.305s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:47 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-f304f628-5f94-4e6f-acd7-2474fcecf809 tempest-SnapshotsActionsTest-1585549037 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.8a99d96a-622a-48db-88be-2e41e496de44 is being set with open permissions: ugo+rw Sep 08 06:50:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f304f628-5f94-4e6f-acd7-2474fcecf809 tempest-SnapshotsActionsTest-1585549037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.8a99d96a-622a-48db-88be-2e41e496de44 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:47 devstack sudo[98335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:50:47 devstack sudo[98335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:47 devstack sudo[98336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.8a99d96a-622a-48db-88be-2e41e496de44 Sep 08 06:50:47 devstack sudo[98336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:47 devstack sudo[98335]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6ad94587-556d-42c1-ae2c-5505deb3b3ee tempest-VolumesActionsTest-1384967596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.245s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:47 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-6ad94587-556d-42c1-ae2c-5505deb3b3ee tempest-VolumesActionsTest-1384967596 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:50:47 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-6ad94587-556d-42c1-ae2c-5505deb3b3ee tempest-VolumesActionsTest-1384967596 None] Deleted volume successfully. Sep 08 06:50:47 devstack sudo[98336]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f304f628-5f94-4e6f-acd7-2474fcecf809 tempest-SnapshotsActionsTest-1585549037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.8a99d96a-622a-48db-88be-2e41e496de44" returned: 0 in 0.255s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:47 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-6ad94587-556d-42c1-ae2c-5505deb3b3ee tempest-VolumesActionsTest-1384967596 None] Lock "cinder-a21c2fc3-d6cf-4662-8191-2d713c537c1f-delete_volume" released by "delete_volume" :: held 1.137s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:50:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-f304f628-5f94-4e6f-acd7-2474fcecf809 tempest-SnapshotsActionsTest-1585549037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.530s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:50:47 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-f304f628-5f94-4e6f-acd7-2474fcecf809 tempest-SnapshotsActionsTest-1585549037 None] Create snapshot completed successfully Sep 08 06:50:48 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-671362d1-d728-4825-a7bb-140c07f96d43 tempest-VolumesActionsTest-1354945798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:50:48 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-671362d1-d728-4825-a7bb-140c07f96d43 tempest-VolumesActionsTest-1354945798 None] Flow 'volume_create_manager' (f619de96-fc05-492e-b57a-29fc9289cc4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:50:48 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-671362d1-d728-4825-a7bb-140c07f96d43 tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42de89ab-9117-451b-a4ca-5fadc49f836b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:50:48 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-671362d1-d728-4825-a7bb-140c07f96d43 tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42de89ab-9117-451b-a4ca-5fadc49f836b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:50:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-710758091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21c432ae-09b9-49eb-9c75-cad9a96a7b25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5635d14e0683482894f5280c0d203e9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:50:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:50:48Z,use_quota=True,user_id='a317e65f2b914c89ba740783ea0eb437',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:50:48 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-671362d1-d728-4825-a7bb-140c07f96d43 tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b4f2a3a-1452-4ed5-8428-b42379253580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:50:48 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-671362d1-d728-4825-a7bb-140c07f96d43 tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b4f2a3a-1452-4ed5-8428-b42379253580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:50:48 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-671362d1-d728-4825-a7bb-140c07f96d43 tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa39d463-9e29-4ff9-bf84-a98d455d34a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:50:48 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-671362d1-d728-4825-a7bb-140c07f96d43 tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa39d463-9e29-4ff9-bf84-a98d455d34a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21c432ae-09b9-49eb-9c75-cad9a96a7b25', 'volume_name': 'volume-21c432ae-09b9-49eb-9c75-cad9a96a7b25', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:50:48 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-671362d1-d728-4825-a7bb-140c07f96d43 tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17fad729-dec4-4f58-95d6-eb4f19988d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:50:48 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-671362d1-d728-4825-a7bb-140c07f96d43 tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17fad729-dec4-4f58-95d6-eb4f19988d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:50:48 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-671362d1-d728-4825-a7bb-140c07f96d43 tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03304e28-64b3-4bd3-801d-cb108576ee4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:50:48 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-671362d1-d728-4825-a7bb-140c07f96d43 tempest-VolumesActionsTest-1354945798 None] Volume 21c432ae-09b9-49eb-9c75-cad9a96a7b25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21c432ae-09b9-49eb-9c75-cad9a96a7b25', 'volume_size': 1} Sep 08 06:50:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-671362d1-d728-4825-a7bb-140c07f96d43 tempest-VolumesActionsTest-1354945798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:50:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-671362d1-d728-4825-a7bb-140c07f96d43 tempest-VolumesActionsTest-1354945798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:50:48 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-671362d1-d728-4825-a7bb-140c07f96d43 tempest-VolumesActionsTest-1354945798 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:50:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-710758091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21c432ae-09b9-49eb-9c75-cad9a96a7b25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5635d14e0683482894f5280c0d203e9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:50:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:50:48Z,use_quota=True,user_id='a317e65f2b914c89ba740783ea0eb437',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:50:48 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-671362d1-d728-4825-a7bb-140c07f96d43 tempest-VolumesActionsTest-1354945798 None] Creating volume 21c432ae-09b9-49eb-9c75-cad9a96a7b25 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:50:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-671362d1-d728-4825-a7bb-140c07f96d43 tempest-VolumesActionsTest-1354945798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:50:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-671362d1-d728-4825-a7bb-140c07f96d43 tempest-VolumesActionsTest-1354945798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:50:48 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-671362d1-d728-4825-a7bb-140c07f96d43 tempest-VolumesActionsTest-1354945798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:50:48 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-671362d1-d728-4825-a7bb-140c07f96d43 tempest-VolumesActionsTest-1354945798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:50:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-671362d1-d728-4825-a7bb-140c07f96d43 tempest-VolumesActionsTest-1354945798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:50:48 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-671362d1-d728-4825-a7bb-140c07f96d43 tempest-VolumesActionsTest-1354945798 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:50:48 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-671362d1-d728-4825-a7bb-140c07f96d43 tempest-VolumesActionsTest-1354945798 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:50:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-671362d1-d728-4825-a7bb-140c07f96d43 tempest-VolumesActionsTest-1354945798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-21c432ae-09b9-49eb-9c75-cad9a96a7b25 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:48 devstack sudo[98341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-21c432ae-09b9-49eb-9c75-cad9a96a7b25 1073741824 Sep 08 06:50:48 devstack sudo[98341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:48 devstack sudo[98341]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-671362d1-d728-4825-a7bb-140c07f96d43 tempest-VolumesActionsTest-1354945798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-21c432ae-09b9-49eb-9c75-cad9a96a7b25 1073741824" returned: 0 in 0.398s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-671362d1-d728-4825-a7bb-140c07f96d43 tempest-VolumesActionsTest-1354945798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-21c432ae-09b9-49eb-9c75-cad9a96a7b25 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:48 devstack sudo[98348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-21c432ae-09b9-49eb-9c75-cad9a96a7b25 Sep 08 06:50:48 devstack sudo[98348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:49 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-cb2cb417-5fcb-4193-86bc-29052145e936 tempest-SnapshotsActionsTest-1092359652 None] Acquiring lock "cinder-8a99d96a-622a-48db-88be-2e41e496de44-delete_snapshot" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:50:49 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-cb2cb417-5fcb-4193-86bc-29052145e936 tempest-SnapshotsActionsTest-1092359652 None] Lock "cinder-8a99d96a-622a-48db-88be-2e41e496de44-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:50:49 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-cb2cb417-5fcb-4193-86bc-29052145e936 tempest-SnapshotsActionsTest-1092359652 None] Acquiring lock "cinder-quobyte-2f821731-481f-48bc-a117-d3b8845a782d" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:50:49 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-cb2cb417-5fcb-4193-86bc-29052145e936 tempest-SnapshotsActionsTest-1092359652 None] Lock "cinder-quobyte-2f821731-481f-48bc-a117-d3b8845a782d" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:50:49 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-cb2cb417-5fcb-4193-86bc-29052145e936 tempest-SnapshotsActionsTest-1092359652 None] Acquiring lock "cinder-quobyte-8a99d96a-622a-48db-88be-2e41e496de44" by "_delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:50:49 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-cb2cb417-5fcb-4193-86bc-29052145e936 tempest-SnapshotsActionsTest-1092359652 None] Lock "cinder-quobyte-8a99d96a-622a-48db-88be-2e41e496de44" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:50:49 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-cb2cb417-5fcb-4193-86bc-29052145e936 tempest-SnapshotsActionsTest-1092359652 None] Deleting offline snapshot 8a99d96a-622a-48db-88be-2e41e496de44 of volume 2f821731-481f-48bc-a117-d3b8845a782d {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 06:50:49 devstack sudo[98348]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:49 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-cb2cb417-5fcb-4193-86bc-29052145e936 tempest-SnapshotsActionsTest-1092359652 None] snapshot_file for this snap is: volume-2f821731-481f-48bc-a117-d3b8845a782d.8a99d96a-622a-48db-88be-2e41e496de44 {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 06:50:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-671362d1-d728-4825-a7bb-140c07f96d43 tempest-VolumesActionsTest-1354945798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-21c432ae-09b9-49eb-9c75-cad9a96a7b25" returned: 0 in 0.264s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:49 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-671362d1-d728-4825-a7bb-140c07f96d43 tempest-VolumesActionsTest-1354945798 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:50:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-671362d1-d728-4825-a7bb-140c07f96d43 tempest-VolumesActionsTest-1354945798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:50:49 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[353fb05f-3cca-4cb0-8e82-df2282873dca]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:50:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-cb2cb417-5fcb-4193-86bc-29052145e936 tempest-SnapshotsActionsTest-1092359652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.8a99d96a-622a-48db-88be-2e41e496de44 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:49 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-671362d1-d728-4825-a7bb-140c07f96d43 tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03304e28-64b3-4bd3-801d-cb108576ee4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21c432ae-09b9-49eb-9c75-cad9a96a7b25', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:50:49 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-671362d1-d728-4825-a7bb-140c07f96d43 tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaaadc71-86ce-4734-934f-66a77052cea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:50:49 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-671362d1-d728-4825-a7bb-140c07f96d43 tempest-VolumesActionsTest-1354945798 None] Volume volume-21c432ae-09b9-49eb-9c75-cad9a96a7b25 (21c432ae-09b9-49eb-9c75-cad9a96a7b25): created successfully Sep 08 06:50:49 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-671362d1-d728-4825-a7bb-140c07f96d43 tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaaadc71-86ce-4734-934f-66a77052cea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:50:49 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-671362d1-d728-4825-a7bb-140c07f96d43 tempest-VolumesActionsTest-1354945798 None] Flow 'volume_create_manager' (f619de96-fc05-492e-b57a-29fc9289cc4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:50:49 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-671362d1-d728-4825-a7bb-140c07f96d43 tempest-VolumesActionsTest-1354945798 None] Created volume successfully. Sep 08 06:50:49 devstack sudo[98351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.8a99d96a-622a-48db-88be-2e41e496de44 Sep 08 06:50:49 devstack sudo[98351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:49 devstack sudo[98351]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-cb2cb417-5fcb-4193-86bc-29052145e936 tempest-SnapshotsActionsTest-1092359652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.8a99d96a-622a-48db-88be-2e41e496de44" returned: 0 in 0.400s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:49 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-cb2cb417-5fcb-4193-86bc-29052145e936 tempest-SnapshotsActionsTest-1092359652 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f821731-481f-48bc-a117-d3b8845a782d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 06:50:49 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-ea5d66d2-8bc8-4572-8f6a-adbc4e5507c3 tempest-VolumesActionsTest-1384967596 None] Acquiring lock "cinder-21c432ae-09b9-49eb-9c75-cad9a96a7b25-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:50:49 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f09e50-2a50-4b71-8cb3-bb713692b346]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:50:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-cb2cb417-5fcb-4193-86bc-29052145e936 tempest-SnapshotsActionsTest-1092359652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.48790f5b-53f9-406d-ab8a-fc6d7cb48f3f {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:49 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-ea5d66d2-8bc8-4572-8f6a-adbc4e5507c3 tempest-VolumesActionsTest-1384967596 None] Lock "cinder-21c432ae-09b9-49eb-9c75-cad9a96a7b25-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:50:49 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-ea5d66d2-8bc8-4572-8f6a-adbc4e5507c3 tempest-VolumesActionsTest-1384967596 None] Acquiring lock "cinder-quobyte-21c432ae-09b9-49eb-9c75-cad9a96a7b25" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:50:49 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-ea5d66d2-8bc8-4572-8f6a-adbc4e5507c3 tempest-VolumesActionsTest-1384967596 None] Lock "cinder-quobyte-21c432ae-09b9-49eb-9c75-cad9a96a7b25" acquired by "delete_volume" :: waited 0.016s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:50:49 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd5ee51-d395-4e73-88a4-16230c0e9f12]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:50:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ea5d66d2-8bc8-4572-8f6a-adbc4e5507c3 tempest-VolumesActionsTest-1384967596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-21c432ae-09b9-49eb-9c75-cad9a96a7b25 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:49 devstack sudo[98356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.48790f5b-53f9-406d-ab8a-fc6d7cb48f3f Sep 08 06:50:49 devstack sudo[98356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:49 devstack sudo[98357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-21c432ae-09b9-49eb-9c75-cad9a96a7b25 Sep 08 06:50:49 devstack sudo[98357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:49 devstack sudo[98356]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-cb2cb417-5fcb-4193-86bc-29052145e936 tempest-SnapshotsActionsTest-1092359652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.48790f5b-53f9-406d-ab8a-fc6d7cb48f3f" returned: 0 in 0.370s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:49 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-cb2cb417-5fcb-4193-86bc-29052145e936 tempest-SnapshotsActionsTest-1092359652 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f821731-481f-48bc-a117-d3b8845a782d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 06:50:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-cb2cb417-5fcb-4193-86bc-29052145e936 tempest-SnapshotsActionsTest-1092359652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.8a99d96a-622a-48db-88be-2e41e496de44 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:49 devstack sudo[98363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.8a99d96a-622a-48db-88be-2e41e496de44 Sep 08 06:50:49 devstack sudo[98363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:50 devstack sudo[98357]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ea5d66d2-8bc8-4572-8f6a-adbc4e5507c3 tempest-VolumesActionsTest-1384967596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-21c432ae-09b9-49eb-9c75-cad9a96a7b25" returned: 0 in 0.379s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ea5d66d2-8bc8-4572-8f6a-adbc4e5507c3 tempest-VolumesActionsTest-1384967596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-21c432ae-09b9-49eb-9c75-cad9a96a7b25 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:50 devstack sudo[98368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-21c432ae-09b9-49eb-9c75-cad9a96a7b25 Sep 08 06:50:50 devstack sudo[98368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:50 devstack sudo[98368]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ea5d66d2-8bc8-4572-8f6a-adbc4e5507c3 tempest-VolumesActionsTest-1384967596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-21c432ae-09b9-49eb-9c75-cad9a96a7b25" returned: 0 in 0.258s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:50 devstack sudo[98363]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-cb2cb417-5fcb-4193-86bc-29052145e936 tempest-SnapshotsActionsTest-1092359652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.8a99d96a-622a-48db-88be-2e41e496de44" returned: 0 in 0.375s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-cb2cb417-5fcb-4193-86bc-29052145e936 tempest-SnapshotsActionsTest-1092359652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.8a99d96a-622a-48db-88be-2e41e496de44 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:50 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-ea5d66d2-8bc8-4572-8f6a-adbc4e5507c3 tempest-VolumesActionsTest-1384967596 None] Lock "cinder-quobyte-21c432ae-09b9-49eb-9c75-cad9a96a7b25" released by "delete_volume" :: held 0.680s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:50:50 devstack sudo[98374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.8a99d96a-622a-48db-88be-2e41e496de44 Sep 08 06:50:50 devstack sudo[98374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:50 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-ea5d66d2-8bc8-4572-8f6a-adbc4e5507c3 tempest-VolumesActionsTest-1384967596 None] Created reservations ['ee6bcc59-d036-4c85-9278-3bdae096ae98', 'a7c6954d-9803-41fb-b1bf-780117d93aaf', '6a4da5f4-8186-46d6-9a13-536a1ecac947', 'c89ab703-9d5b-44e2-9cdb-e60d33413285'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:50:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-ea5d66d2-8bc8-4572-8f6a-adbc4e5507c3 tempest-VolumesActionsTest-1384967596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:50:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-ea5d66d2-8bc8-4572-8f6a-adbc4e5507c3 tempest-VolumesActionsTest-1384967596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:50:50 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-ea5d66d2-8bc8-4572-8f6a-adbc4e5507c3 tempest-VolumesActionsTest-1384967596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:50:50 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-ea5d66d2-8bc8-4572-8f6a-adbc4e5507c3 tempest-VolumesActionsTest-1384967596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:50:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-ea5d66d2-8bc8-4572-8f6a-adbc4e5507c3 tempest-VolumesActionsTest-1384967596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:50:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ea5d66d2-8bc8-4572-8f6a-adbc4e5507c3 tempest-VolumesActionsTest-1384967596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:50 devstack sudo[98376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:50:50 devstack sudo[98376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:50 devstack sudo[98374]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-cb2cb417-5fcb-4193-86bc-29052145e936 tempest-SnapshotsActionsTest-1092359652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.8a99d96a-622a-48db-88be-2e41e496de44" returned: 0 in 0.259s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:50 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-cb2cb417-5fcb-4193-86bc-29052145e936 tempest-SnapshotsActionsTest-1092359652 None] Lock "cinder-quobyte-8a99d96a-622a-48db-88be-2e41e496de44" released by "_delete_snapshot" :: held 1.511s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:50:50 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-cb2cb417-5fcb-4193-86bc-29052145e936 tempest-SnapshotsActionsTest-1092359652 None] Lock "cinder-quobyte-2f821731-481f-48bc-a117-d3b8845a782d" released by "delete_snapshot" :: held 1.537s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:50:50 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-cb2cb417-5fcb-4193-86bc-29052145e936 tempest-SnapshotsActionsTest-1092359652 None] Created reservations ['09b2f1c4-3a14-4cf5-8ab0-a663601ccc16', '9a3a5918-a9e3-40ae-911a-341ea5752c82', '74071d54-18d9-4aee-8e3a-0cdcfb74662b', 'f6e92cb3-1e52-42ad-80aa-56a6d4e694a4'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:50:50 devstack sudo[98376]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ea5d66d2-8bc8-4572-8f6a-adbc4e5507c3 tempest-VolumesActionsTest-1384967596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.285s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:50 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-ea5d66d2-8bc8-4572-8f6a-adbc4e5507c3 tempest-VolumesActionsTest-1384967596 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:50:50 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-ea5d66d2-8bc8-4572-8f6a-adbc4e5507c3 tempest-VolumesActionsTest-1384967596 None] Deleted volume successfully. Sep 08 06:50:50 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-ea5d66d2-8bc8-4572-8f6a-adbc4e5507c3 tempest-VolumesActionsTest-1384967596 None] Lock "cinder-21c432ae-09b9-49eb-9c75-cad9a96a7b25-delete_volume" released by "delete_volume" :: held 1.176s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:50:50 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-cb2cb417-5fcb-4193-86bc-29052145e936 tempest-SnapshotsActionsTest-1092359652 None] Delete snapshot completed successfully. Sep 08 06:50:50 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-cb2cb417-5fcb-4193-86bc-29052145e936 tempest-SnapshotsActionsTest-1092359652 None] Lock "cinder-8a99d96a-622a-48db-88be-2e41e496de44-delete_snapshot" released by "delete_snapshot" :: held 1.769s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:50:51 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a04a039-6acc-4714-bee2-0789897c1eb4 tempest-VolumesActionsTest-1354945798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:50:51 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6a04a039-6acc-4714-bee2-0789897c1eb4 tempest-VolumesActionsTest-1354945798 None] Flow 'volume_create_manager' (77addf31-5f12-449a-aae3-0a7bc566f9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:50:51 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6a04a039-6acc-4714-bee2-0789897c1eb4 tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2d6a6ec-ce24-4a5c-876c-465e10b054fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:50:51 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6a04a039-6acc-4714-bee2-0789897c1eb4 tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2d6a6ec-ce24-4a5c-876c-465e10b054fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:50:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1504204992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8ee3319-7f31-40fd-8634-400376e3048e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5635d14e0683482894f5280c0d203e9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:50:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:50:51Z,use_quota=True,user_id='a317e65f2b914c89ba740783ea0eb437',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:50:51 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6a04a039-6acc-4714-bee2-0789897c1eb4 tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c222b22-c956-4064-9dc0-916ca462ec2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:50:51 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6a04a039-6acc-4714-bee2-0789897c1eb4 tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c222b22-c956-4064-9dc0-916ca462ec2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:50:51 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6a04a039-6acc-4714-bee2-0789897c1eb4 tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b15a74d-37a5-447e-968d-bd1887cb0375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:50:51 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6a04a039-6acc-4714-bee2-0789897c1eb4 tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b15a74d-37a5-447e-968d-bd1887cb0375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8ee3319-7f31-40fd-8634-400376e3048e', 'volume_name': 'volume-e8ee3319-7f31-40fd-8634-400376e3048e', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:50:51 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6a04a039-6acc-4714-bee2-0789897c1eb4 tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (478dcbb6-92f8-4335-884c-2d3c0c9aeab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:50:51 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6a04a039-6acc-4714-bee2-0789897c1eb4 tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (478dcbb6-92f8-4335-884c-2d3c0c9aeab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:50:51 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6a04a039-6acc-4714-bee2-0789897c1eb4 tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (507ac622-e7cd-4139-84cf-cbd7a85fae05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:50:51 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-6a04a039-6acc-4714-bee2-0789897c1eb4 tempest-VolumesActionsTest-1354945798 None] Volume e8ee3319-7f31-40fd-8634-400376e3048e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8ee3319-7f31-40fd-8634-400376e3048e', 'volume_size': 1} Sep 08 06:50:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-6a04a039-6acc-4714-bee2-0789897c1eb4 tempest-VolumesActionsTest-1354945798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:50:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-6a04a039-6acc-4714-bee2-0789897c1eb4 tempest-VolumesActionsTest-1354945798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:50:51 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-6a04a039-6acc-4714-bee2-0789897c1eb4 tempest-VolumesActionsTest-1354945798 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:50:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1504204992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8ee3319-7f31-40fd-8634-400376e3048e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5635d14e0683482894f5280c0d203e9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:50:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:50:51Z,use_quota=True,user_id='a317e65f2b914c89ba740783ea0eb437',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:50:51 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-6a04a039-6acc-4714-bee2-0789897c1eb4 tempest-VolumesActionsTest-1354945798 None] Creating volume e8ee3319-7f31-40fd-8634-400376e3048e {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:50:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-6a04a039-6acc-4714-bee2-0789897c1eb4 tempest-VolumesActionsTest-1354945798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:50:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-6a04a039-6acc-4714-bee2-0789897c1eb4 tempest-VolumesActionsTest-1354945798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:50:51 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-6a04a039-6acc-4714-bee2-0789897c1eb4 tempest-VolumesActionsTest-1354945798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:50:51 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-6a04a039-6acc-4714-bee2-0789897c1eb4 tempest-VolumesActionsTest-1354945798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:50:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-6a04a039-6acc-4714-bee2-0789897c1eb4 tempest-VolumesActionsTest-1354945798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:50:51 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-6a04a039-6acc-4714-bee2-0789897c1eb4 tempest-VolumesActionsTest-1354945798 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:50:51 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-6a04a039-6acc-4714-bee2-0789897c1eb4 tempest-VolumesActionsTest-1354945798 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:50:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6a04a039-6acc-4714-bee2-0789897c1eb4 tempest-VolumesActionsTest-1354945798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e8ee3319-7f31-40fd-8634-400376e3048e 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:51 devstack sudo[98380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e8ee3319-7f31-40fd-8634-400376e3048e 1073741824 Sep 08 06:50:51 devstack sudo[98380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:51 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-b3823bee-a980-4f9a-98b7-964fe17dc0e9 tempest-SnapshotsActionsTest-1585549037 None] Acquiring lock "cinder-48790f5b-53f9-406d-ab8a-fc6d7cb48f3f-delete_snapshot" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:50:51 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-b3823bee-a980-4f9a-98b7-964fe17dc0e9 tempest-SnapshotsActionsTest-1585549037 None] Lock "cinder-48790f5b-53f9-406d-ab8a-fc6d7cb48f3f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:50:51 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-b3823bee-a980-4f9a-98b7-964fe17dc0e9 tempest-SnapshotsActionsTest-1585549037 None] Acquiring lock "cinder-quobyte-2f821731-481f-48bc-a117-d3b8845a782d" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:50:51 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-b3823bee-a980-4f9a-98b7-964fe17dc0e9 tempest-SnapshotsActionsTest-1585549037 None] Lock "cinder-quobyte-2f821731-481f-48bc-a117-d3b8845a782d" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:50:51 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-b3823bee-a980-4f9a-98b7-964fe17dc0e9 tempest-SnapshotsActionsTest-1585549037 None] Acquiring lock "cinder-quobyte-48790f5b-53f9-406d-ab8a-fc6d7cb48f3f" by "_delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:50:51 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-b3823bee-a980-4f9a-98b7-964fe17dc0e9 tempest-SnapshotsActionsTest-1585549037 None] Lock "cinder-quobyte-48790f5b-53f9-406d-ab8a-fc6d7cb48f3f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:50:51 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-b3823bee-a980-4f9a-98b7-964fe17dc0e9 tempest-SnapshotsActionsTest-1585549037 None] Deleting offline snapshot 48790f5b-53f9-406d-ab8a-fc6d7cb48f3f of volume 2f821731-481f-48bc-a117-d3b8845a782d {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 06:50:51 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-b3823bee-a980-4f9a-98b7-964fe17dc0e9 tempest-SnapshotsActionsTest-1585549037 None] snapshot_file for this snap is: volume-2f821731-481f-48bc-a117-d3b8845a782d.48790f5b-53f9-406d-ab8a-fc6d7cb48f3f {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 06:50:51 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[733c69f9-f727-4580-a179-f0a9659f3763]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:50:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b3823bee-a980-4f9a-98b7-964fe17dc0e9 tempest-SnapshotsActionsTest-1585549037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.48790f5b-53f9-406d-ab8a-fc6d7cb48f3f {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:51 devstack sudo[98385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.48790f5b-53f9-406d-ab8a-fc6d7cb48f3f Sep 08 06:50:51 devstack sudo[98385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:52 devstack sudo[98380]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6a04a039-6acc-4714-bee2-0789897c1eb4 tempest-VolumesActionsTest-1354945798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e8ee3319-7f31-40fd-8634-400376e3048e 1073741824" returned: 0 in 0.546s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6a04a039-6acc-4714-bee2-0789897c1eb4 tempest-VolumesActionsTest-1354945798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e8ee3319-7f31-40fd-8634-400376e3048e {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:52 devstack sudo[98388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e8ee3319-7f31-40fd-8634-400376e3048e Sep 08 06:50:52 devstack sudo[98388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:52 devstack sudo[98385]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b3823bee-a980-4f9a-98b7-964fe17dc0e9 tempest-SnapshotsActionsTest-1585549037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.48790f5b-53f9-406d-ab8a-fc6d7cb48f3f" returned: 0 in 0.465s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:52 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-b3823bee-a980-4f9a-98b7-964fe17dc0e9 tempest-SnapshotsActionsTest-1585549037 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f821731-481f-48bc-a117-d3b8845a782d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 06:50:52 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b71ab7a-148f-4eb8-a550-8fe23491b555]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:50:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b3823bee-a980-4f9a-98b7-964fe17dc0e9 tempest-SnapshotsActionsTest-1585549037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:52 devstack sudo[98388]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6a04a039-6acc-4714-bee2-0789897c1eb4 tempest-VolumesActionsTest-1354945798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e8ee3319-7f31-40fd-8634-400376e3048e" returned: 0 in 0.295s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:52 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-6a04a039-6acc-4714-bee2-0789897c1eb4 tempest-VolumesActionsTest-1354945798 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:50:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-6a04a039-6acc-4714-bee2-0789897c1eb4 tempest-VolumesActionsTest-1354945798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:50:52 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6a04a039-6acc-4714-bee2-0789897c1eb4 tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (507ac622-e7cd-4139-84cf-cbd7a85fae05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8ee3319-7f31-40fd-8634-400376e3048e', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:50:52 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6a04a039-6acc-4714-bee2-0789897c1eb4 tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d887726f-3941-4023-b982-34bbdf02be83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:50:52 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-6a04a039-6acc-4714-bee2-0789897c1eb4 tempest-VolumesActionsTest-1354945798 None] Volume volume-e8ee3319-7f31-40fd-8634-400376e3048e (e8ee3319-7f31-40fd-8634-400376e3048e): created successfully Sep 08 06:50:52 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6a04a039-6acc-4714-bee2-0789897c1eb4 tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d887726f-3941-4023-b982-34bbdf02be83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:50:52 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6a04a039-6acc-4714-bee2-0789897c1eb4 tempest-VolumesActionsTest-1354945798 None] Flow 'volume_create_manager' (77addf31-5f12-449a-aae3-0a7bc566f9e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:50:52 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-6a04a039-6acc-4714-bee2-0789897c1eb4 tempest-VolumesActionsTest-1354945798 None] Created volume successfully. Sep 08 06:50:52 devstack sudo[98394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d Sep 08 06:50:52 devstack sudo[98394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:52 devstack sudo[98394]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b3823bee-a980-4f9a-98b7-964fe17dc0e9 tempest-SnapshotsActionsTest-1585549037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d" returned: 0 in 0.366s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b3823bee-a980-4f9a-98b7-964fe17dc0e9 tempest-SnapshotsActionsTest-1585549037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.48790f5b-53f9-406d-ab8a-fc6d7cb48f3f {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:52 devstack sudo[98406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.48790f5b-53f9-406d-ab8a-fc6d7cb48f3f Sep 08 06:50:52 devstack sudo[98406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:53 devstack sudo[98406]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b3823bee-a980-4f9a-98b7-964fe17dc0e9 tempest-SnapshotsActionsTest-1585549037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.48790f5b-53f9-406d-ab8a-fc6d7cb48f3f" returned: 0 in 0.373s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b3823bee-a980-4f9a-98b7-964fe17dc0e9 tempest-SnapshotsActionsTest-1585549037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.48790f5b-53f9-406d-ab8a-fc6d7cb48f3f {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:53 devstack sudo[98417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.48790f5b-53f9-406d-ab8a-fc6d7cb48f3f Sep 08 06:50:53 devstack sudo[98417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:53 devstack sudo[98417]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b3823bee-a980-4f9a-98b7-964fe17dc0e9 tempest-SnapshotsActionsTest-1585549037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d.48790f5b-53f9-406d-ab8a-fc6d7cb48f3f" returned: 0 in 0.254s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:53 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-b3823bee-a980-4f9a-98b7-964fe17dc0e9 tempest-SnapshotsActionsTest-1585549037 None] Lock "cinder-quobyte-48790f5b-53f9-406d-ab8a-fc6d7cb48f3f" released by "_delete_snapshot" :: held 1.573s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:50:53 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-b3823bee-a980-4f9a-98b7-964fe17dc0e9 tempest-SnapshotsActionsTest-1585549037 None] Lock "cinder-quobyte-2f821731-481f-48bc-a117-d3b8845a782d" released by "delete_snapshot" :: held 1.595s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:50:53 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-b3823bee-a980-4f9a-98b7-964fe17dc0e9 tempest-SnapshotsActionsTest-1585549037 None] Created reservations ['a26d258d-2c25-4f4b-9e53-73a7be595fcc', 'e052cfa0-e147-45d4-8722-a57e9cf6a73b', 'a3868b14-8bb8-42cb-bddd-6f665a99d4b7', '4c880498-f2fe-46db-8992-56f4009c2d5f'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:50:53 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-b3823bee-a980-4f9a-98b7-964fe17dc0e9 tempest-SnapshotsActionsTest-1585549037 None] Delete snapshot completed successfully. Sep 08 06:50:53 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-b3823bee-a980-4f9a-98b7-964fe17dc0e9 tempest-SnapshotsActionsTest-1585549037 None] Lock "cinder-48790f5b-53f9-406d-ab8a-fc6d7cb48f3f-delete_snapshot" released by "delete_snapshot" :: held 1.755s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:50:53 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-0624a477-5bbe-478e-8216-e5842a29d989 tempest-VolumesActionsTest-1384967596 None] Acquiring lock "cinder-e8ee3319-7f31-40fd-8634-400376e3048e-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:50:53 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-0624a477-5bbe-478e-8216-e5842a29d989 tempest-VolumesActionsTest-1384967596 None] Lock "cinder-e8ee3319-7f31-40fd-8634-400376e3048e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:50:53 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-0624a477-5bbe-478e-8216-e5842a29d989 tempest-VolumesActionsTest-1384967596 None] Acquiring lock "cinder-quobyte-e8ee3319-7f31-40fd-8634-400376e3048e" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:50:53 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-0624a477-5bbe-478e-8216-e5842a29d989 tempest-VolumesActionsTest-1384967596 None] Lock "cinder-quobyte-e8ee3319-7f31-40fd-8634-400376e3048e" acquired by "delete_volume" :: waited 0.014s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:50:53 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d95d9a5-79c9-42b4-bc88-211196484d15]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:50:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0624a477-5bbe-478e-8216-e5842a29d989 tempest-VolumesActionsTest-1384967596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e8ee3319-7f31-40fd-8634-400376e3048e {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:53 devstack sudo[98420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e8ee3319-7f31-40fd-8634-400376e3048e Sep 08 06:50:53 devstack sudo[98420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:53 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-19a2d54b-188a-4442-bfce-421119c1c1c3 tempest-SnapshotsActionsTest-1585549037 None] Acquiring lock "cinder-2f821731-481f-48bc-a117-d3b8845a782d-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:50:53 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-19a2d54b-188a-4442-bfce-421119c1c1c3 tempest-SnapshotsActionsTest-1585549037 None] Lock "cinder-2f821731-481f-48bc-a117-d3b8845a782d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:50:54 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-19a2d54b-188a-4442-bfce-421119c1c1c3 tempest-SnapshotsActionsTest-1585549037 None] Acquiring lock "cinder-quobyte-2f821731-481f-48bc-a117-d3b8845a782d" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:50:54 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-19a2d54b-188a-4442-bfce-421119c1c1c3 tempest-SnapshotsActionsTest-1585549037 None] Lock "cinder-quobyte-2f821731-481f-48bc-a117-d3b8845a782d" acquired by "delete_volume" :: waited 0.026s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:50:54 devstack sudo[98420]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0624a477-5bbe-478e-8216-e5842a29d989 tempest-VolumesActionsTest-1384967596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e8ee3319-7f31-40fd-8634-400376e3048e" returned: 0 in 0.413s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0624a477-5bbe-478e-8216-e5842a29d989 tempest-VolumesActionsTest-1384967596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e8ee3319-7f31-40fd-8634-400376e3048e {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:54 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1efeec-e28c-4fbe-80f0-d928ce4283a0]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:50:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-19a2d54b-188a-4442-bfce-421119c1c1c3 tempest-SnapshotsActionsTest-1585549037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:54 devstack sudo[98427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e8ee3319-7f31-40fd-8634-400376e3048e Sep 08 06:50:54 devstack sudo[98427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:54 devstack sudo[98430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d Sep 08 06:50:54 devstack sudo[98430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:54 devstack sudo[98427]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0624a477-5bbe-478e-8216-e5842a29d989 tempest-VolumesActionsTest-1384967596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e8ee3319-7f31-40fd-8634-400376e3048e" returned: 0 in 0.265s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:54 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-0624a477-5bbe-478e-8216-e5842a29d989 tempest-VolumesActionsTest-1384967596 None] Lock "cinder-quobyte-e8ee3319-7f31-40fd-8634-400376e3048e" released by "delete_volume" :: held 0.716s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:50:54 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-0624a477-5bbe-478e-8216-e5842a29d989 tempest-VolumesActionsTest-1384967596 None] Created reservations ['3b621d31-1fb2-4e0e-a467-3c5b810a6094', '818e9726-708c-40c1-a840-48c873631c98', 'afed292b-aba1-4c71-900b-819175c3cc77', '0f67a62d-1804-44f7-946f-4a8b522e14dd'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:50:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-0624a477-5bbe-478e-8216-e5842a29d989 tempest-VolumesActionsTest-1384967596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:50:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-0624a477-5bbe-478e-8216-e5842a29d989 tempest-VolumesActionsTest-1384967596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:50:54 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-0624a477-5bbe-478e-8216-e5842a29d989 tempest-VolumesActionsTest-1384967596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:50:54 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-0624a477-5bbe-478e-8216-e5842a29d989 tempest-VolumesActionsTest-1384967596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:50:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-0624a477-5bbe-478e-8216-e5842a29d989 tempest-VolumesActionsTest-1384967596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:50:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0624a477-5bbe-478e-8216-e5842a29d989 tempest-VolumesActionsTest-1384967596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:54 devstack sudo[98439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:50:54 devstack sudo[98439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:54 devstack sudo[98430]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-19a2d54b-188a-4442-bfce-421119c1c1c3 tempest-SnapshotsActionsTest-1585549037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d" returned: 0 in 0.443s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-19a2d54b-188a-4442-bfce-421119c1c1c3 tempest-SnapshotsActionsTest-1585549037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:54 devstack sudo[98441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d Sep 08 06:50:54 devstack sudo[98441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:54 devstack sudo[98439]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0624a477-5bbe-478e-8216-e5842a29d989 tempest-VolumesActionsTest-1384967596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.385s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:54 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-0624a477-5bbe-478e-8216-e5842a29d989 tempest-VolumesActionsTest-1384967596 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:50:54 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-0624a477-5bbe-478e-8216-e5842a29d989 tempest-VolumesActionsTest-1384967596 None] Deleted volume successfully. Sep 08 06:50:54 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-0624a477-5bbe-478e-8216-e5842a29d989 tempest-VolumesActionsTest-1384967596 None] Lock "cinder-e8ee3319-7f31-40fd-8634-400376e3048e-delete_volume" released by "delete_volume" :: held 1.324s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:50:54 devstack sudo[98441]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-19a2d54b-188a-4442-bfce-421119c1c1c3 tempest-SnapshotsActionsTest-1585549037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2f821731-481f-48bc-a117-d3b8845a782d" returned: 0 in 0.395s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:54 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-19a2d54b-188a-4442-bfce-421119c1c1c3 tempest-SnapshotsActionsTest-1585549037 None] Lock "cinder-quobyte-2f821731-481f-48bc-a117-d3b8845a782d" released by "delete_volume" :: held 0.911s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:50:55 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-19a2d54b-188a-4442-bfce-421119c1c1c3 tempest-SnapshotsActionsTest-1585549037 None] Created reservations ['288e1c39-b141-4be4-8243-6caafff1831f', 'e6f66b6f-1d42-4a25-907d-fed47f41ca05', '8f028f82-071a-4c19-826b-6e8108b0c6ce', 'a91dadc3-33d7-4b89-83a1-f2eb068944a4'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:50:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-19a2d54b-188a-4442-bfce-421119c1c1c3 tempest-SnapshotsActionsTest-1585549037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:50:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-19a2d54b-188a-4442-bfce-421119c1c1c3 tempest-SnapshotsActionsTest-1585549037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:50:55 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-19a2d54b-188a-4442-bfce-421119c1c1c3 tempest-SnapshotsActionsTest-1585549037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:50:55 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-19a2d54b-188a-4442-bfce-421119c1c1c3 tempest-SnapshotsActionsTest-1585549037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:50:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-19a2d54b-188a-4442-bfce-421119c1c1c3 tempest-SnapshotsActionsTest-1585549037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:50:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-19a2d54b-188a-4442-bfce-421119c1c1c3 tempest-SnapshotsActionsTest-1585549037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:55 devstack sudo[98449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:50:55 devstack sudo[98449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:55 devstack sudo[98449]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-19a2d54b-188a-4442-bfce-421119c1c1c3 tempest-SnapshotsActionsTest-1585549037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.336s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:55 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-19a2d54b-188a-4442-bfce-421119c1c1c3 tempest-SnapshotsActionsTest-1585549037 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:50:55 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-51af388f-c5ad-45c6-815f-8e3c81070c33 tempest-VolumesActionsTest-1354945798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:50:55 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-51af388f-c5ad-45c6-815f-8e3c81070c33 tempest-VolumesActionsTest-1354945798 None] Flow 'volume_create_manager' (7e0a2f32-7d96-475a-8568-56c91786b48f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:50:55 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-51af388f-c5ad-45c6-815f-8e3c81070c33 tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e93e875-5fd8-47b8-94d7-fde969c1c9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:50:55 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-19a2d54b-188a-4442-bfce-421119c1c1c3 tempest-SnapshotsActionsTest-1585549037 None] Deleted volume successfully. Sep 08 06:50:55 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-51af388f-c5ad-45c6-815f-8e3c81070c33 tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e93e875-5fd8-47b8-94d7-fde969c1c9cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:50:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-175610880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f13f225e-87e2-4601-b43c-8d54b70d662b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5635d14e0683482894f5280c0d203e9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:50:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:50:55Z,use_quota=True,user_id='a317e65f2b914c89ba740783ea0eb437',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:50:55 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-51af388f-c5ad-45c6-815f-8e3c81070c33 tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9898f666-b134-4d01-a260-744d6f4a6bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:50:55 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-51af388f-c5ad-45c6-815f-8e3c81070c33 tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9898f666-b134-4d01-a260-744d6f4a6bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:50:55 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-51af388f-c5ad-45c6-815f-8e3c81070c33 tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (874d5ffe-639c-4932-9770-691990fca245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:50:55 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-51af388f-c5ad-45c6-815f-8e3c81070c33 tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (874d5ffe-639c-4932-9770-691990fca245) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f13f225e-87e2-4601-b43c-8d54b70d662b', 'volume_name': 'volume-f13f225e-87e2-4601-b43c-8d54b70d662b', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:50:55 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-51af388f-c5ad-45c6-815f-8e3c81070c33 tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46dd4854-807c-4bfa-9fc3-31d7d1788290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:50:55 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-51af388f-c5ad-45c6-815f-8e3c81070c33 tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46dd4854-807c-4bfa-9fc3-31d7d1788290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:50:55 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-51af388f-c5ad-45c6-815f-8e3c81070c33 tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03c17628-417b-4204-9391-e6d8ea79fac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:50:55 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-51af388f-c5ad-45c6-815f-8e3c81070c33 tempest-VolumesActionsTest-1354945798 None] Volume f13f225e-87e2-4601-b43c-8d54b70d662b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f13f225e-87e2-4601-b43c-8d54b70d662b', 'volume_size': 1} Sep 08 06:50:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-51af388f-c5ad-45c6-815f-8e3c81070c33 tempest-VolumesActionsTest-1354945798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:50:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-51af388f-c5ad-45c6-815f-8e3c81070c33 tempest-VolumesActionsTest-1354945798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:50:55 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-51af388f-c5ad-45c6-815f-8e3c81070c33 tempest-VolumesActionsTest-1354945798 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:50:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-175610880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f13f225e-87e2-4601-b43c-8d54b70d662b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5635d14e0683482894f5280c0d203e9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:50:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:50:55Z,use_quota=True,user_id='a317e65f2b914c89ba740783ea0eb437',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:50:55 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-51af388f-c5ad-45c6-815f-8e3c81070c33 tempest-VolumesActionsTest-1354945798 None] Creating volume f13f225e-87e2-4601-b43c-8d54b70d662b {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:50:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-51af388f-c5ad-45c6-815f-8e3c81070c33 tempest-VolumesActionsTest-1354945798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:50:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-51af388f-c5ad-45c6-815f-8e3c81070c33 tempest-VolumesActionsTest-1354945798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:50:55 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-51af388f-c5ad-45c6-815f-8e3c81070c33 tempest-VolumesActionsTest-1354945798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:50:55 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-51af388f-c5ad-45c6-815f-8e3c81070c33 tempest-VolumesActionsTest-1354945798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:50:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-51af388f-c5ad-45c6-815f-8e3c81070c33 tempest-VolumesActionsTest-1354945798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:50:55 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-51af388f-c5ad-45c6-815f-8e3c81070c33 tempest-VolumesActionsTest-1354945798 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:50:55 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-51af388f-c5ad-45c6-815f-8e3c81070c33 tempest-VolumesActionsTest-1354945798 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:50:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-51af388f-c5ad-45c6-815f-8e3c81070c33 tempest-VolumesActionsTest-1354945798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f13f225e-87e2-4601-b43c-8d54b70d662b 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:55 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-19a2d54b-188a-4442-bfce-421119c1c1c3 tempest-SnapshotsActionsTest-1585549037 None] Lock "cinder-2f821731-481f-48bc-a117-d3b8845a782d-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:50:55 devstack sudo[98453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f13f225e-87e2-4601-b43c-8d54b70d662b 1073741824 Sep 08 06:50:55 devstack sudo[98453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:56 devstack sudo[98453]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-51af388f-c5ad-45c6-815f-8e3c81070c33 tempest-VolumesActionsTest-1354945798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f13f225e-87e2-4601-b43c-8d54b70d662b 1073741824" returned: 0 in 0.516s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-51af388f-c5ad-45c6-815f-8e3c81070c33 tempest-VolumesActionsTest-1354945798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f13f225e-87e2-4601-b43c-8d54b70d662b {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:56 devstack sudo[98459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f13f225e-87e2-4601-b43c-8d54b70d662b Sep 08 06:50:56 devstack sudo[98459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:56 devstack sudo[98459]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-51af388f-c5ad-45c6-815f-8e3c81070c33 tempest-VolumesActionsTest-1354945798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f13f225e-87e2-4601-b43c-8d54b70d662b" returned: 0 in 0.334s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:56 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-51af388f-c5ad-45c6-815f-8e3c81070c33 tempest-VolumesActionsTest-1354945798 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:50:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-51af388f-c5ad-45c6-815f-8e3c81070c33 tempest-VolumesActionsTest-1354945798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:50:56 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-51af388f-c5ad-45c6-815f-8e3c81070c33 tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03c17628-417b-4204-9391-e6d8ea79fac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f13f225e-87e2-4601-b43c-8d54b70d662b', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:50:56 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-51af388f-c5ad-45c6-815f-8e3c81070c33 tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6328c81-030a-47cf-ae05-5c1816290ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:50:56 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-51af388f-c5ad-45c6-815f-8e3c81070c33 tempest-VolumesActionsTest-1354945798 None] Volume volume-f13f225e-87e2-4601-b43c-8d54b70d662b (f13f225e-87e2-4601-b43c-8d54b70d662b): created successfully Sep 08 06:50:56 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-51af388f-c5ad-45c6-815f-8e3c81070c33 tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6328c81-030a-47cf-ae05-5c1816290ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:50:56 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-51af388f-c5ad-45c6-815f-8e3c81070c33 tempest-VolumesActionsTest-1354945798 None] Flow 'volume_create_manager' (7e0a2f32-7d96-475a-8568-56c91786b48f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:50:56 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-51af388f-c5ad-45c6-815f-8e3c81070c33 tempest-VolumesActionsTest-1354945798 None] Created volume successfully. Sep 08 06:50:57 devstack cinder-volume[87507]: INFO cinder.volume.manager [req-7378f914-fc09-4b92-8477-6bf7ee703645 req-0cfddec6-5508-49a0-8f61-d05589ebb682 tempest-TestShelveInstance-1110004772 None] Terminate volume connection completed successfully. Sep 08 06:50:57 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-7378f914-fc09-4b92-8477-6bf7ee703645 req-0cfddec6-5508-49a0-8f61-d05589ebb682 tempest-TestShelveInstance-1110004772 None] Deleting attachment 1495bc21-cfb3-4d7c-9059-ee0830fa7288. {{(pid=87507) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 06:50:57 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-1adb21ec-37cc-45a8-831e-9aecc3d1af0f tempest-VolumesActionsTest-1384967596 None] Acquiring lock "cinder-f13f225e-87e2-4601-b43c-8d54b70d662b-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:50:57 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-1adb21ec-37cc-45a8-831e-9aecc3d1af0f tempest-VolumesActionsTest-1384967596 None] Lock "cinder-f13f225e-87e2-4601-b43c-8d54b70d662b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:50:57 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-1adb21ec-37cc-45a8-831e-9aecc3d1af0f tempest-VolumesActionsTest-1384967596 None] Acquiring lock "cinder-quobyte-f13f225e-87e2-4601-b43c-8d54b70d662b" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:50:57 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-1adb21ec-37cc-45a8-831e-9aecc3d1af0f tempest-VolumesActionsTest-1384967596 None] Lock "cinder-quobyte-f13f225e-87e2-4601-b43c-8d54b70d662b" acquired by "delete_volume" :: waited 0.028s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:50:57 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[95bbf309-de60-413f-a251-3a3a99387479]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:50:57 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1adb21ec-37cc-45a8-831e-9aecc3d1af0f tempest-VolumesActionsTest-1384967596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f13f225e-87e2-4601-b43c-8d54b70d662b {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:58 devstack sudo[98508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f13f225e-87e2-4601-b43c-8d54b70d662b Sep 08 06:50:58 devstack sudo[98508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:58 devstack sudo[98508]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:58 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1adb21ec-37cc-45a8-831e-9aecc3d1af0f tempest-VolumesActionsTest-1384967596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f13f225e-87e2-4601-b43c-8d54b70d662b" returned: 0 in 0.430s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:58 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1adb21ec-37cc-45a8-831e-9aecc3d1af0f tempest-VolumesActionsTest-1384967596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f13f225e-87e2-4601-b43c-8d54b70d662b {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:58 devstack sudo[98527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f13f225e-87e2-4601-b43c-8d54b70d662b Sep 08 06:50:58 devstack sudo[98527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:58 devstack sudo[98527]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:58 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1adb21ec-37cc-45a8-831e-9aecc3d1af0f tempest-VolumesActionsTest-1384967596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f13f225e-87e2-4601-b43c-8d54b70d662b" returned: 0 in 0.279s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:58 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-1adb21ec-37cc-45a8-831e-9aecc3d1af0f tempest-VolumesActionsTest-1384967596 None] Lock "cinder-quobyte-f13f225e-87e2-4601-b43c-8d54b70d662b" released by "delete_volume" :: held 0.763s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:50:58 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-1adb21ec-37cc-45a8-831e-9aecc3d1af0f tempest-VolumesActionsTest-1384967596 None] Created reservations ['403f6884-3c1d-46a4-8c40-d7806d2fca0a', '75145cad-b12b-46de-b359-61611e88fa72', 'a6ca17b3-346a-4933-ac1d-5a8110ec8ff1', '1e4bc3d2-c3be-4043-98b6-bb9f13e738d7'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:50:58 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-1adb21ec-37cc-45a8-831e-9aecc3d1af0f tempest-VolumesActionsTest-1384967596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:50:58 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-1adb21ec-37cc-45a8-831e-9aecc3d1af0f tempest-VolumesActionsTest-1384967596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:50:58 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-1adb21ec-37cc-45a8-831e-9aecc3d1af0f tempest-VolumesActionsTest-1384967596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:50:58 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-1adb21ec-37cc-45a8-831e-9aecc3d1af0f tempest-VolumesActionsTest-1384967596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:50:58 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-1adb21ec-37cc-45a8-831e-9aecc3d1af0f tempest-VolumesActionsTest-1384967596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:50:58 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1adb21ec-37cc-45a8-831e-9aecc3d1af0f tempest-VolumesActionsTest-1384967596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:58 devstack sudo[98546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:50:58 devstack sudo[98546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:50:59 devstack sudo[98546]: pam_unix(sudo:session): session closed for user root Sep 08 06:50:59 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1adb21ec-37cc-45a8-831e-9aecc3d1af0f tempest-VolumesActionsTest-1384967596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.358s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:50:59 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-1adb21ec-37cc-45a8-831e-9aecc3d1af0f tempest-VolumesActionsTest-1384967596 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:50:59 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-1adb21ec-37cc-45a8-831e-9aecc3d1af0f tempest-VolumesActionsTest-1384967596 None] Deleted volume successfully. Sep 08 06:50:59 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-1adb21ec-37cc-45a8-831e-9aecc3d1af0f tempest-VolumesActionsTest-1384967596 None] Lock "cinder-f13f225e-87e2-4601-b43c-8d54b70d662b-delete_volume" released by "delete_volume" :: held 1.383s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:50:59 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-19cbc050-cc48-4291-99cc-296e5323b045 tempest-VolumesActionsTest-1354945798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:50:59 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-19cbc050-cc48-4291-99cc-296e5323b045 tempest-VolumesActionsTest-1354945798 None] Flow 'volume_create_manager' (ca477d65-0506-47ac-9f25-206328ce7a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:50:59 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-19cbc050-cc48-4291-99cc-296e5323b045 tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05069025-33c3-4343-9964-5678ee15a139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:50:59 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-19cbc050-cc48-4291-99cc-296e5323b045 tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05069025-33c3-4343-9964-5678ee15a139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:50:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-776792260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38e0336b-40d5-4b78-99dd-f6899e709a0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5635d14e0683482894f5280c0d203e9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:51:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:51:00Z,use_quota=True,user_id='a317e65f2b914c89ba740783ea0eb437',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:50:59 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-19cbc050-cc48-4291-99cc-296e5323b045 tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (380d0657-1bee-47e0-9b37-0986dd66e815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:50:59 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-19cbc050-cc48-4291-99cc-296e5323b045 tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (380d0657-1bee-47e0-9b37-0986dd66e815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:50:59 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-19cbc050-cc48-4291-99cc-296e5323b045 tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (babc5f6c-db0d-4d6a-8b7d-bcccb341a71b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:50:59 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-19cbc050-cc48-4291-99cc-296e5323b045 tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (babc5f6c-db0d-4d6a-8b7d-bcccb341a71b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38e0336b-40d5-4b78-99dd-f6899e709a0c', 'volume_name': 'volume-38e0336b-40d5-4b78-99dd-f6899e709a0c', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:50:59 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-19cbc050-cc48-4291-99cc-296e5323b045 tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b25eed7b-9f08-4c8a-ae3c-1289aa8e17bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:50:59 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-19cbc050-cc48-4291-99cc-296e5323b045 tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b25eed7b-9f08-4c8a-ae3c-1289aa8e17bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:50:59 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-19cbc050-cc48-4291-99cc-296e5323b045 tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e5bbfaa-676c-4887-929b-553fcf897213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:50:59 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-19cbc050-cc48-4291-99cc-296e5323b045 tempest-VolumesActionsTest-1354945798 None] Volume 38e0336b-40d5-4b78-99dd-f6899e709a0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38e0336b-40d5-4b78-99dd-f6899e709a0c', 'volume_size': 1} Sep 08 06:50:59 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-19cbc050-cc48-4291-99cc-296e5323b045 tempest-VolumesActionsTest-1354945798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:50:59 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-19cbc050-cc48-4291-99cc-296e5323b045 tempest-VolumesActionsTest-1354945798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:50:59 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-19cbc050-cc48-4291-99cc-296e5323b045 tempest-VolumesActionsTest-1354945798 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:50:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-776792260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38e0336b-40d5-4b78-99dd-f6899e709a0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5635d14e0683482894f5280c0d203e9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:51:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:51:00Z,use_quota=True,user_id='a317e65f2b914c89ba740783ea0eb437',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:50:59 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-19cbc050-cc48-4291-99cc-296e5323b045 tempest-VolumesActionsTest-1354945798 None] Creating volume 38e0336b-40d5-4b78-99dd-f6899e709a0c {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:50:59 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-19cbc050-cc48-4291-99cc-296e5323b045 tempest-VolumesActionsTest-1354945798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:50:59 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-19cbc050-cc48-4291-99cc-296e5323b045 tempest-VolumesActionsTest-1354945798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:50:59 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-19cbc050-cc48-4291-99cc-296e5323b045 tempest-VolumesActionsTest-1354945798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:50:59 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-19cbc050-cc48-4291-99cc-296e5323b045 tempest-VolumesActionsTest-1354945798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:50:59 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-19cbc050-cc48-4291-99cc-296e5323b045 tempest-VolumesActionsTest-1354945798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:50:59 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-19cbc050-cc48-4291-99cc-296e5323b045 tempest-VolumesActionsTest-1354945798 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:50:59 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-19cbc050-cc48-4291-99cc-296e5323b045 tempest-VolumesActionsTest-1354945798 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:50:59 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-19cbc050-cc48-4291-99cc-296e5323b045 tempest-VolumesActionsTest-1354945798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-38e0336b-40d5-4b78-99dd-f6899e709a0c 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:50:59 devstack sudo[98580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-38e0336b-40d5-4b78-99dd-f6899e709a0c 1073741824 Sep 08 06:50:59 devstack sudo[98580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:51:00 devstack sudo[98580]: pam_unix(sudo:session): session closed for user root Sep 08 06:51:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-19cbc050-cc48-4291-99cc-296e5323b045 tempest-VolumesActionsTest-1354945798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-38e0336b-40d5-4b78-99dd-f6899e709a0c 1073741824" returned: 0 in 0.531s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:51:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-19cbc050-cc48-4291-99cc-296e5323b045 tempest-VolumesActionsTest-1354945798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-38e0336b-40d5-4b78-99dd-f6899e709a0c {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:51:00 devstack sudo[98606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-38e0336b-40d5-4b78-99dd-f6899e709a0c Sep 08 06:51:00 devstack sudo[98606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:51:00 devstack sudo[98606]: pam_unix(sudo:session): session closed for user root Sep 08 06:51:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-19cbc050-cc48-4291-99cc-296e5323b045 tempest-VolumesActionsTest-1354945798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-38e0336b-40d5-4b78-99dd-f6899e709a0c" returned: 0 in 0.313s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:51:00 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-19cbc050-cc48-4291-99cc-296e5323b045 tempest-VolumesActionsTest-1354945798 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:51:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-19cbc050-cc48-4291-99cc-296e5323b045 tempest-VolumesActionsTest-1354945798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:51:00 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-19cbc050-cc48-4291-99cc-296e5323b045 tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e5bbfaa-676c-4887-929b-553fcf897213) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38e0336b-40d5-4b78-99dd-f6899e709a0c', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:51:00 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-19cbc050-cc48-4291-99cc-296e5323b045 tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b44844e4-3b48-4cf8-85a6-b25bdbc95eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:51:00 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-19cbc050-cc48-4291-99cc-296e5323b045 tempest-VolumesActionsTest-1354945798 None] Volume volume-38e0336b-40d5-4b78-99dd-f6899e709a0c (38e0336b-40d5-4b78-99dd-f6899e709a0c): created successfully Sep 08 06:51:00 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-19cbc050-cc48-4291-99cc-296e5323b045 tempest-VolumesActionsTest-1354945798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b44844e4-3b48-4cf8-85a6-b25bdbc95eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:51:00 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-19cbc050-cc48-4291-99cc-296e5323b045 tempest-VolumesActionsTest-1354945798 None] Flow 'volume_create_manager' (ca477d65-0506-47ac-9f25-206328ce7a22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:51:00 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-19cbc050-cc48-4291-99cc-296e5323b045 tempest-VolumesActionsTest-1354945798 None] Created volume successfully. Sep 08 06:51:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-bfb85141-a195-4bbf-8d41-0ee4893956d8 req-0b436c3a-f01f-458c-809f-2cd0e46946ad tempest-TestShelveInstance-1110004772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:51:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-bfb85141-a195-4bbf-8d41-0ee4893956d8 req-0b436c3a-f01f-458c-809f-2cd0e46946ad tempest-TestShelveInstance-1110004772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:51:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-bfb85141-a195-4bbf-8d41-0ee4893956d8 req-0b436c3a-f01f-458c-809f-2cd0e46946ad tempest-TestShelveInstance-1110004772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:51:01 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-bfb85141-a195-4bbf-8d41-0ee4893956d8 req-0b436c3a-f01f-458c-809f-2cd0e46946ad tempest-TestShelveInstance-1110004772 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d', 'name': 'volume-1565e55f-2dc7-43fa-84fb-cade2f0551ed', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'eff2152a-5168-4e46-9219-b882524d405e', 'enforce_multipath': True} {{(pid=87507) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 06:51:01 devstack cinder-volume[87507]: INFO cinder.volume.manager [req-bfb85141-a195-4bbf-8d41-0ee4893956d8 req-0b436c3a-f01f-458c-809f-2cd0e46946ad tempest-TestShelveInstance-1110004772 None] attachment_update completed successfully. Sep 08 06:51:02 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-37b5fbe2-6ca3-4945-8a0e-3def9472181d tempest-VolumesActionsTest-1354945798 None] Acquiring lock "cinder-38e0336b-40d5-4b78-99dd-f6899e709a0c-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:51:02 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-37b5fbe2-6ca3-4945-8a0e-3def9472181d tempest-VolumesActionsTest-1354945798 None] Lock "cinder-38e0336b-40d5-4b78-99dd-f6899e709a0c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:51:02 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-37b5fbe2-6ca3-4945-8a0e-3def9472181d tempest-VolumesActionsTest-1354945798 None] Acquiring lock "cinder-quobyte-38e0336b-40d5-4b78-99dd-f6899e709a0c" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:51:02 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-37b5fbe2-6ca3-4945-8a0e-3def9472181d tempest-VolumesActionsTest-1354945798 None] Lock "cinder-quobyte-38e0336b-40d5-4b78-99dd-f6899e709a0c" acquired by "delete_volume" :: waited 0.022s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:51:02 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[22846a47-8674-4ff6-95c4-7d51e3522f30]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:51:02 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-37b5fbe2-6ca3-4945-8a0e-3def9472181d tempest-VolumesActionsTest-1354945798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-38e0336b-40d5-4b78-99dd-f6899e709a0c {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:51:02 devstack sudo[98686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-38e0336b-40d5-4b78-99dd-f6899e709a0c Sep 08 06:51:02 devstack sudo[98686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:51:03 devstack sudo[98686]: pam_unix(sudo:session): session closed for user root Sep 08 06:51:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-37b5fbe2-6ca3-4945-8a0e-3def9472181d tempest-VolumesActionsTest-1354945798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-38e0336b-40d5-4b78-99dd-f6899e709a0c" returned: 0 in 0.416s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:51:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-37b5fbe2-6ca3-4945-8a0e-3def9472181d tempest-VolumesActionsTest-1354945798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-38e0336b-40d5-4b78-99dd-f6899e709a0c {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:51:03 devstack sudo[98704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-38e0336b-40d5-4b78-99dd-f6899e709a0c Sep 08 06:51:03 devstack sudo[98704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:51:03 devstack sudo[98704]: pam_unix(sudo:session): session closed for user root Sep 08 06:51:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-37b5fbe2-6ca3-4945-8a0e-3def9472181d tempest-VolumesActionsTest-1354945798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-38e0336b-40d5-4b78-99dd-f6899e709a0c" returned: 0 in 0.299s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:51:03 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-37b5fbe2-6ca3-4945-8a0e-3def9472181d tempest-VolumesActionsTest-1354945798 None] Lock "cinder-quobyte-38e0336b-40d5-4b78-99dd-f6899e709a0c" released by "delete_volume" :: held 0.763s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:51:03 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-37b5fbe2-6ca3-4945-8a0e-3def9472181d tempest-VolumesActionsTest-1354945798 None] Created reservations ['91afa6e0-a78e-48fd-a644-519c381b6d0a', '7f55bb3b-1bca-44eb-b432-7cd7969e0559', '38e54157-cfa5-44e3-af8f-670143f8fea9', 'eb42d48a-4fef-4add-a7b9-01c37957d61b'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:51:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-37b5fbe2-6ca3-4945-8a0e-3def9472181d tempest-VolumesActionsTest-1354945798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:51:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-37b5fbe2-6ca3-4945-8a0e-3def9472181d tempest-VolumesActionsTest-1354945798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:51:03 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-37b5fbe2-6ca3-4945-8a0e-3def9472181d tempest-VolumesActionsTest-1354945798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:51:03 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-37b5fbe2-6ca3-4945-8a0e-3def9472181d tempest-VolumesActionsTest-1354945798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:51:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-37b5fbe2-6ca3-4945-8a0e-3def9472181d tempest-VolumesActionsTest-1354945798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:51:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-37b5fbe2-6ca3-4945-8a0e-3def9472181d tempest-VolumesActionsTest-1354945798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:51:03 devstack sudo[98720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:51:03 devstack sudo[98720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:51:03 devstack sudo[98720]: pam_unix(sudo:session): session closed for user root Sep 08 06:51:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-37b5fbe2-6ca3-4945-8a0e-3def9472181d tempest-VolumesActionsTest-1354945798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.319s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:51:03 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-37b5fbe2-6ca3-4945-8a0e-3def9472181d tempest-VolumesActionsTest-1354945798 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:51:03 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-37b5fbe2-6ca3-4945-8a0e-3def9472181d tempest-VolumesActionsTest-1354945798 None] Deleted volume successfully. Sep 08 06:51:03 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-37b5fbe2-6ca3-4945-8a0e-3def9472181d tempest-VolumesActionsTest-1354945798 None] Lock "cinder-38e0336b-40d5-4b78-99dd-f6899e709a0c-delete_volume" released by "delete_volume" :: held 1.319s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:51:13 devstack cinder-volume[87507]: DEBUG dbcounter [-] [87507] Writing DB stats cinder:SELECT=130,cinder:INSERT=37,cinder:UPDATE=120,cinder:DELETE=7 {{(pid=87507) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 06:51:13 devstack cinder-volume[87507]: DEBUG dbcounter [-] [87507] Writing DB stats cinder:SELECT=104,cinder:UPDATE=122,cinder:INSERT=35,cinder:DELETE=13 {{(pid=87507) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 06:51:20 devstack cinder-volume[87507]: DEBUG oslo_service.periodic_task [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87507) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 06:51:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:51:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:51:20 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:51:20 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:51:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:51:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:51:20 devstack sudo[99716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:51:20 devstack sudo[99716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:51:20 devstack sudo[99716]: pam_unix(sudo:session): session closed for user root Sep 08 06:51:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.322s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:51:20 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:51:20 devstack cinder-volume[87507]: DEBUG oslo_service.periodic_task [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Running periodic task VolumeManager._thread_info {{(pid=87507) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 06:51:20 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] thread count: 29 {{(pid=87507) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 06:51:20 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] thread info: [<_MainThread(MainThread, started 127913129345152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87507) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 06:51:22 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-134f8cef-52ac-4c0a-a142-47d09a9aadd5 tempest-VolumeQuotasNegativeTestJSON-494160584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:51:22 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-134f8cef-52ac-4c0a-a142-47d09a9aadd5 tempest-VolumeQuotasNegativeTestJSON-494160584 None] Flow 'volume_create_manager' (e07ade6e-23e0-435d-931f-dd5b6e58ffa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:51:22 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-134f8cef-52ac-4c0a-a142-47d09a9aadd5 tempest-VolumeQuotasNegativeTestJSON-494160584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1480ea2f-0bc7-4fc4-a295-31e0dffed700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:51:22 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-134f8cef-52ac-4c0a-a142-47d09a9aadd5 tempest-VolumeQuotasNegativeTestJSON-494160584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1480ea2f-0bc7-4fc4-a295-31e0dffed700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:51:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-152084573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=732ce845-aebf-4c95-aba3-bbb14f451a7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7c048d061dc48998c8ee56e80a0f400',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:51:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:51:22Z,use_quota=True,user_id='d48c1d01a01b416fbb828168a4374238',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:51:22 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-134f8cef-52ac-4c0a-a142-47d09a9aadd5 tempest-VolumeQuotasNegativeTestJSON-494160584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (590f7ec1-82df-46f6-a787-672849f6cdf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:51:22 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-134f8cef-52ac-4c0a-a142-47d09a9aadd5 tempest-VolumeQuotasNegativeTestJSON-494160584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (590f7ec1-82df-46f6-a787-672849f6cdf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:51:22 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-134f8cef-52ac-4c0a-a142-47d09a9aadd5 tempest-VolumeQuotasNegativeTestJSON-494160584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d39d4350-8baf-4347-ab93-f2e50a5d41d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:51:22 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-134f8cef-52ac-4c0a-a142-47d09a9aadd5 tempest-VolumeQuotasNegativeTestJSON-494160584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d39d4350-8baf-4347-ab93-f2e50a5d41d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '732ce845-aebf-4c95-aba3-bbb14f451a7c', 'volume_name': 'volume-732ce845-aebf-4c95-aba3-bbb14f451a7c', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:51:22 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-134f8cef-52ac-4c0a-a142-47d09a9aadd5 tempest-VolumeQuotasNegativeTestJSON-494160584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa7a6d06-cd86-4b9b-8105-1f1b56f99eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:51:22 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-134f8cef-52ac-4c0a-a142-47d09a9aadd5 tempest-VolumeQuotasNegativeTestJSON-494160584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa7a6d06-cd86-4b9b-8105-1f1b56f99eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:51:22 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-134f8cef-52ac-4c0a-a142-47d09a9aadd5 tempest-VolumeQuotasNegativeTestJSON-494160584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8389b05-c73d-4185-8104-d15974e077b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:51:22 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-134f8cef-52ac-4c0a-a142-47d09a9aadd5 tempest-VolumeQuotasNegativeTestJSON-494160584 None] Volume 732ce845-aebf-4c95-aba3-bbb14f451a7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-732ce845-aebf-4c95-aba3-bbb14f451a7c', 'volume_size': 1} Sep 08 06:51:22 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-134f8cef-52ac-4c0a-a142-47d09a9aadd5 tempest-VolumeQuotasNegativeTestJSON-494160584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:51:22 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-134f8cef-52ac-4c0a-a142-47d09a9aadd5 tempest-VolumeQuotasNegativeTestJSON-494160584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:51:22 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-134f8cef-52ac-4c0a-a142-47d09a9aadd5 tempest-VolumeQuotasNegativeTestJSON-494160584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:51:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-152084573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=732ce845-aebf-4c95-aba3-bbb14f451a7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7c048d061dc48998c8ee56e80a0f400',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:51:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:51:22Z,use_quota=True,user_id='d48c1d01a01b416fbb828168a4374238',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:51:22 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-134f8cef-52ac-4c0a-a142-47d09a9aadd5 tempest-VolumeQuotasNegativeTestJSON-494160584 None] Creating volume 732ce845-aebf-4c95-aba3-bbb14f451a7c {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:51:22 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-134f8cef-52ac-4c0a-a142-47d09a9aadd5 tempest-VolumeQuotasNegativeTestJSON-494160584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:51:22 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-134f8cef-52ac-4c0a-a142-47d09a9aadd5 tempest-VolumeQuotasNegativeTestJSON-494160584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:51:22 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-134f8cef-52ac-4c0a-a142-47d09a9aadd5 tempest-VolumeQuotasNegativeTestJSON-494160584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:51:22 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-134f8cef-52ac-4c0a-a142-47d09a9aadd5 tempest-VolumeQuotasNegativeTestJSON-494160584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:51:22 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-134f8cef-52ac-4c0a-a142-47d09a9aadd5 tempest-VolumeQuotasNegativeTestJSON-494160584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:51:22 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-134f8cef-52ac-4c0a-a142-47d09a9aadd5 tempest-VolumeQuotasNegativeTestJSON-494160584 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:51:22 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-134f8cef-52ac-4c0a-a142-47d09a9aadd5 tempest-VolumeQuotasNegativeTestJSON-494160584 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:51:22 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-134f8cef-52ac-4c0a-a142-47d09a9aadd5 tempest-VolumeQuotasNegativeTestJSON-494160584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-732ce845-aebf-4c95-aba3-bbb14f451a7c 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:51:22 devstack sudo[99801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-732ce845-aebf-4c95-aba3-bbb14f451a7c 1073741824 Sep 08 06:51:22 devstack sudo[99801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:51:22 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-86731a55-4eda-4ce7-95f3-f93fa9822c08 tempest-VolumesTransfersTest-1419890243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:51:22 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-86731a55-4eda-4ce7-95f3-f93fa9822c08 tempest-VolumesTransfersTest-1419890243 None] Flow 'volume_create_manager' (43aa70e4-70a3-4db3-a17f-6704315addaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:51:22 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-86731a55-4eda-4ce7-95f3-f93fa9822c08 tempest-VolumesTransfersTest-1419890243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd78134c-7922-4a10-a379-f9f41b6b17ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:51:22 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-86731a55-4eda-4ce7-95f3-f93fa9822c08 tempest-VolumesTransfersTest-1419890243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd78134c-7922-4a10-a379-f9f41b6b17ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:51:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1537241328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95dfffe7-3b03-4921-9f51-995721fc2765,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f98ce843890247c0b603817882fd4f3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:51:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:51:23Z,use_quota=True,user_id='017b65707de04c57bddf47e063c2b8c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:51:22 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-86731a55-4eda-4ce7-95f3-f93fa9822c08 tempest-VolumesTransfersTest-1419890243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7573af10-1d94-4724-b4a8-179c5d1dad91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:51:22 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-86731a55-4eda-4ce7-95f3-f93fa9822c08 tempest-VolumesTransfersTest-1419890243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7573af10-1d94-4724-b4a8-179c5d1dad91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:51:22 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-86731a55-4eda-4ce7-95f3-f93fa9822c08 tempest-VolumesTransfersTest-1419890243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9fdc0f1-9055-47e6-973a-fd6f6ce8503a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:51:22 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-86731a55-4eda-4ce7-95f3-f93fa9822c08 tempest-VolumesTransfersTest-1419890243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9fdc0f1-9055-47e6-973a-fd6f6ce8503a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95dfffe7-3b03-4921-9f51-995721fc2765', 'volume_name': 'volume-95dfffe7-3b03-4921-9f51-995721fc2765', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:51:22 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-86731a55-4eda-4ce7-95f3-f93fa9822c08 tempest-VolumesTransfersTest-1419890243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (984d1be0-37c9-46b5-9d24-94f7ffa81b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:51:22 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-86731a55-4eda-4ce7-95f3-f93fa9822c08 tempest-VolumesTransfersTest-1419890243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (984d1be0-37c9-46b5-9d24-94f7ffa81b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:51:22 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-86731a55-4eda-4ce7-95f3-f93fa9822c08 tempest-VolumesTransfersTest-1419890243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63d27981-3016-405d-845c-2a8b1985620e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:51:22 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-86731a55-4eda-4ce7-95f3-f93fa9822c08 tempest-VolumesTransfersTest-1419890243 None] Volume 95dfffe7-3b03-4921-9f51-995721fc2765: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95dfffe7-3b03-4921-9f51-995721fc2765', 'volume_size': 1} Sep 08 06:51:22 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-86731a55-4eda-4ce7-95f3-f93fa9822c08 tempest-VolumesTransfersTest-1419890243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:51:22 devstack sudo[99801]: pam_unix(sudo:session): session closed for user root Sep 08 06:51:22 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-134f8cef-52ac-4c0a-a142-47d09a9aadd5 tempest-VolumeQuotasNegativeTestJSON-494160584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-732ce845-aebf-4c95-aba3-bbb14f451a7c 1073741824" returned: 0 in 0.562s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:51:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-134f8cef-52ac-4c0a-a142-47d09a9aadd5 tempest-VolumeQuotasNegativeTestJSON-494160584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-732ce845-aebf-4c95-aba3-bbb14f451a7c {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:51:23 devstack sudo[99825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-732ce845-aebf-4c95-aba3-bbb14f451a7c Sep 08 06:51:23 devstack sudo[99825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:51:23 devstack sudo[99825]: pam_unix(sudo:session): session closed for user root Sep 08 06:51:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-134f8cef-52ac-4c0a-a142-47d09a9aadd5 tempest-VolumeQuotasNegativeTestJSON-494160584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-732ce845-aebf-4c95-aba3-bbb14f451a7c" returned: 0 in 0.249s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:51:23 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-134f8cef-52ac-4c0a-a142-47d09a9aadd5 tempest-VolumeQuotasNegativeTestJSON-494160584 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:51:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-134f8cef-52ac-4c0a-a142-47d09a9aadd5 tempest-VolumeQuotasNegativeTestJSON-494160584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:51:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-86731a55-4eda-4ce7-95f3-f93fa9822c08 tempest-VolumesTransfersTest-1419890243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.291s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:51:23 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-86731a55-4eda-4ce7-95f3-f93fa9822c08 tempest-VolumesTransfersTest-1419890243 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:51:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1537241328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95dfffe7-3b03-4921-9f51-995721fc2765,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f98ce843890247c0b603817882fd4f3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:51:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:51:23Z,use_quota=True,user_id='017b65707de04c57bddf47e063c2b8c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:51:23 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-86731a55-4eda-4ce7-95f3-f93fa9822c08 tempest-VolumesTransfersTest-1419890243 None] Creating volume 95dfffe7-3b03-4921-9f51-995721fc2765 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:51:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-86731a55-4eda-4ce7-95f3-f93fa9822c08 tempest-VolumesTransfersTest-1419890243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:51:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-86731a55-4eda-4ce7-95f3-f93fa9822c08 tempest-VolumesTransfersTest-1419890243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:51:23 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-86731a55-4eda-4ce7-95f3-f93fa9822c08 tempest-VolumesTransfersTest-1419890243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:51:23 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-86731a55-4eda-4ce7-95f3-f93fa9822c08 tempest-VolumesTransfersTest-1419890243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:51:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-86731a55-4eda-4ce7-95f3-f93fa9822c08 tempest-VolumesTransfersTest-1419890243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:51:23 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-86731a55-4eda-4ce7-95f3-f93fa9822c08 tempest-VolumesTransfersTest-1419890243 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:51:23 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-86731a55-4eda-4ce7-95f3-f93fa9822c08 tempest-VolumesTransfersTest-1419890243 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:51:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-86731a55-4eda-4ce7-95f3-f93fa9822c08 tempest-VolumesTransfersTest-1419890243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-95dfffe7-3b03-4921-9f51-995721fc2765 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:51:23 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-134f8cef-52ac-4c0a-a142-47d09a9aadd5 tempest-VolumeQuotasNegativeTestJSON-494160584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8389b05-c73d-4185-8104-d15974e077b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-732ce845-aebf-4c95-aba3-bbb14f451a7c', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:51:23 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-134f8cef-52ac-4c0a-a142-47d09a9aadd5 tempest-VolumeQuotasNegativeTestJSON-494160584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51ecf694-137d-4b72-ba06-ed2f92358aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:51:23 devstack sudo[99837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-95dfffe7-3b03-4921-9f51-995721fc2765 1073741824 Sep 08 06:51:23 devstack sudo[99837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:51:23 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-134f8cef-52ac-4c0a-a142-47d09a9aadd5 tempest-VolumeQuotasNegativeTestJSON-494160584 None] Volume volume-732ce845-aebf-4c95-aba3-bbb14f451a7c (732ce845-aebf-4c95-aba3-bbb14f451a7c): created successfully Sep 08 06:51:23 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-134f8cef-52ac-4c0a-a142-47d09a9aadd5 tempest-VolumeQuotasNegativeTestJSON-494160584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51ecf694-137d-4b72-ba06-ed2f92358aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:51:23 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-134f8cef-52ac-4c0a-a142-47d09a9aadd5 tempest-VolumeQuotasNegativeTestJSON-494160584 None] Flow 'volume_create_manager' (e07ade6e-23e0-435d-931f-dd5b6e58ffa5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:51:23 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-134f8cef-52ac-4c0a-a142-47d09a9aadd5 tempest-VolumeQuotasNegativeTestJSON-494160584 None] Created volume successfully. Sep 08 06:51:23 devstack sudo[99837]: pam_unix(sudo:session): session closed for user root Sep 08 06:51:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-86731a55-4eda-4ce7-95f3-f93fa9822c08 tempest-VolumesTransfersTest-1419890243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-95dfffe7-3b03-4921-9f51-995721fc2765 1073741824" returned: 0 in 0.430s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:51:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-86731a55-4eda-4ce7-95f3-f93fa9822c08 tempest-VolumesTransfersTest-1419890243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-95dfffe7-3b03-4921-9f51-995721fc2765 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:51:23 devstack sudo[99856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-95dfffe7-3b03-4921-9f51-995721fc2765 Sep 08 06:51:23 devstack sudo[99856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:51:24 devstack sudo[99856]: pam_unix(sudo:session): session closed for user root Sep 08 06:51:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-86731a55-4eda-4ce7-95f3-f93fa9822c08 tempest-VolumesTransfersTest-1419890243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-95dfffe7-3b03-4921-9f51-995721fc2765" returned: 0 in 0.252s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:51:24 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-86731a55-4eda-4ce7-95f3-f93fa9822c08 tempest-VolumesTransfersTest-1419890243 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:51:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-86731a55-4eda-4ce7-95f3-f93fa9822c08 tempest-VolumesTransfersTest-1419890243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:51:24 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-86731a55-4eda-4ce7-95f3-f93fa9822c08 tempest-VolumesTransfersTest-1419890243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63d27981-3016-405d-845c-2a8b1985620e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95dfffe7-3b03-4921-9f51-995721fc2765', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:51:24 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-86731a55-4eda-4ce7-95f3-f93fa9822c08 tempest-VolumesTransfersTest-1419890243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81178614-cb1d-4419-a963-fc7f3e79e107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:51:24 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-86731a55-4eda-4ce7-95f3-f93fa9822c08 tempest-VolumesTransfersTest-1419890243 None] Volume volume-95dfffe7-3b03-4921-9f51-995721fc2765 (95dfffe7-3b03-4921-9f51-995721fc2765): created successfully Sep 08 06:51:24 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-86731a55-4eda-4ce7-95f3-f93fa9822c08 tempest-VolumesTransfersTest-1419890243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81178614-cb1d-4419-a963-fc7f3e79e107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:51:24 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-86731a55-4eda-4ce7-95f3-f93fa9822c08 tempest-VolumesTransfersTest-1419890243 None] Flow 'volume_create_manager' (43aa70e4-70a3-4db3-a17f-6704315addaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:51:24 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-86731a55-4eda-4ce7-95f3-f93fa9822c08 tempest-VolumesTransfersTest-1419890243 None] Created volume successfully. Sep 08 06:51:25 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-8738e311-f3e3-4622-a6ab-96f9f8963452 tempest-VolumeQuotasNegativeTestJSON-494160584 None] Acquiring lock "cinder-732ce845-aebf-4c95-aba3-bbb14f451a7c-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:51:25 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-8738e311-f3e3-4622-a6ab-96f9f8963452 tempest-VolumeQuotasNegativeTestJSON-494160584 None] Lock "cinder-732ce845-aebf-4c95-aba3-bbb14f451a7c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:51:25 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-8738e311-f3e3-4622-a6ab-96f9f8963452 tempest-VolumeQuotasNegativeTestJSON-494160584 None] Acquiring lock "cinder-quobyte-732ce845-aebf-4c95-aba3-bbb14f451a7c" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:51:25 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-8738e311-f3e3-4622-a6ab-96f9f8963452 tempest-VolumeQuotasNegativeTestJSON-494160584 None] Lock "cinder-quobyte-732ce845-aebf-4c95-aba3-bbb14f451a7c" acquired by "delete_volume" :: waited 0.019s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:51:25 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75c8261-4e33-4393-9093-81f4ccf1e3ad]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:51:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8738e311-f3e3-4622-a6ab-96f9f8963452 tempest-VolumeQuotasNegativeTestJSON-494160584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-732ce845-aebf-4c95-aba3-bbb14f451a7c {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:51:25 devstack sudo[99932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-732ce845-aebf-4c95-aba3-bbb14f451a7c Sep 08 06:51:25 devstack sudo[99932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:51:25 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-f5a0c3f2-662b-45c9-974c-eaedd8e5a46b tempest-VolumesTransfersTest-1516514332 None] Transfer volume completed successfully. Sep 08 06:51:25 devstack sudo[99932]: pam_unix(sudo:session): session closed for user root Sep 08 06:51:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8738e311-f3e3-4622-a6ab-96f9f8963452 tempest-VolumeQuotasNegativeTestJSON-494160584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-732ce845-aebf-4c95-aba3-bbb14f451a7c" returned: 0 in 0.372s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:51:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8738e311-f3e3-4622-a6ab-96f9f8963452 tempest-VolumeQuotasNegativeTestJSON-494160584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-732ce845-aebf-4c95-aba3-bbb14f451a7c {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:51:25 devstack sudo[99949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-732ce845-aebf-4c95-aba3-bbb14f451a7c Sep 08 06:51:25 devstack sudo[99949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:51:26 devstack sudo[99949]: pam_unix(sudo:session): session closed for user root Sep 08 06:51:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8738e311-f3e3-4622-a6ab-96f9f8963452 tempest-VolumeQuotasNegativeTestJSON-494160584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-732ce845-aebf-4c95-aba3-bbb14f451a7c" returned: 0 in 0.271s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:51:26 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-8738e311-f3e3-4622-a6ab-96f9f8963452 tempest-VolumeQuotasNegativeTestJSON-494160584 None] Lock "cinder-quobyte-732ce845-aebf-4c95-aba3-bbb14f451a7c" released by "delete_volume" :: held 0.696s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:51:26 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-8738e311-f3e3-4622-a6ab-96f9f8963452 tempest-VolumeQuotasNegativeTestJSON-494160584 None] Created reservations ['3c7396eb-6415-4d7e-ba63-7d7194e2f4f5', '16a70bb2-83de-446e-9ffe-fc5edfcc8620', 'c3bf8d67-b67a-4c9b-92da-5505994c65a3', 'a6c5f1c4-3ef3-4ec7-9590-c42c7d1852f7'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:51:26 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-c6839f3a-12c8-4629-92f2-0924c9e36e1b tempest-VolumesTransfersTest-1540928287 None] Acquiring lock "cinder-95dfffe7-3b03-4921-9f51-995721fc2765-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:51:26 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-c6839f3a-12c8-4629-92f2-0924c9e36e1b tempest-VolumesTransfersTest-1540928287 None] Lock "cinder-95dfffe7-3b03-4921-9f51-995721fc2765-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:51:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8738e311-f3e3-4622-a6ab-96f9f8963452 tempest-VolumeQuotasNegativeTestJSON-494160584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:51:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8738e311-f3e3-4622-a6ab-96f9f8963452 tempest-VolumeQuotasNegativeTestJSON-494160584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:51:26 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8738e311-f3e3-4622-a6ab-96f9f8963452 tempest-VolumeQuotasNegativeTestJSON-494160584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:51:26 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8738e311-f3e3-4622-a6ab-96f9f8963452 tempest-VolumeQuotasNegativeTestJSON-494160584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:51:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8738e311-f3e3-4622-a6ab-96f9f8963452 tempest-VolumeQuotasNegativeTestJSON-494160584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:51:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8738e311-f3e3-4622-a6ab-96f9f8963452 tempest-VolumeQuotasNegativeTestJSON-494160584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:51:26 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-c6839f3a-12c8-4629-92f2-0924c9e36e1b tempest-VolumesTransfersTest-1540928287 None] Acquiring lock "cinder-quobyte-95dfffe7-3b03-4921-9f51-995721fc2765" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:51:26 devstack sudo[99964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:51:26 devstack sudo[99964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:51:26 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-c6839f3a-12c8-4629-92f2-0924c9e36e1b tempest-VolumesTransfersTest-1540928287 None] Lock "cinder-quobyte-95dfffe7-3b03-4921-9f51-995721fc2765" acquired by "delete_volume" :: waited 0.015s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:51:26 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8af733-6359-4ba6-8da2-0f0e4d8d57f8]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:51:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-c6839f3a-12c8-4629-92f2-0924c9e36e1b tempest-VolumesTransfersTest-1540928287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-95dfffe7-3b03-4921-9f51-995721fc2765 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:51:26 devstack sudo[99969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-95dfffe7-3b03-4921-9f51-995721fc2765 Sep 08 06:51:26 devstack sudo[99969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:51:26 devstack sudo[99964]: pam_unix(sudo:session): session closed for user root Sep 08 06:51:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8738e311-f3e3-4622-a6ab-96f9f8963452 tempest-VolumeQuotasNegativeTestJSON-494160584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.271s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:51:26 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-8738e311-f3e3-4622-a6ab-96f9f8963452 tempest-VolumeQuotasNegativeTestJSON-494160584 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:51:26 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-8738e311-f3e3-4622-a6ab-96f9f8963452 tempest-VolumeQuotasNegativeTestJSON-494160584 None] Deleted volume successfully. Sep 08 06:51:26 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-8738e311-f3e3-4622-a6ab-96f9f8963452 tempest-VolumeQuotasNegativeTestJSON-494160584 None] Lock "cinder-732ce845-aebf-4c95-aba3-bbb14f451a7c-delete_volume" released by "delete_volume" :: held 1.223s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:51:26 devstack sudo[99969]: pam_unix(sudo:session): session closed for user root Sep 08 06:51:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-c6839f3a-12c8-4629-92f2-0924c9e36e1b tempest-VolumesTransfersTest-1540928287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-95dfffe7-3b03-4921-9f51-995721fc2765" returned: 0 in 0.406s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:51:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-c6839f3a-12c8-4629-92f2-0924c9e36e1b tempest-VolumesTransfersTest-1540928287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-95dfffe7-3b03-4921-9f51-995721fc2765 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:51:26 devstack sudo[99987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-95dfffe7-3b03-4921-9f51-995721fc2765 Sep 08 06:51:26 devstack sudo[99987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:51:26 devstack sudo[99987]: pam_unix(sudo:session): session closed for user root Sep 08 06:51:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-c6839f3a-12c8-4629-92f2-0924c9e36e1b tempest-VolumesTransfersTest-1540928287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-95dfffe7-3b03-4921-9f51-995721fc2765" returned: 0 in 0.268s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:51:26 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-c6839f3a-12c8-4629-92f2-0924c9e36e1b tempest-VolumesTransfersTest-1540928287 None] Lock "cinder-quobyte-95dfffe7-3b03-4921-9f51-995721fc2765" released by "delete_volume" :: held 0.714s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:51:27 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-c6839f3a-12c8-4629-92f2-0924c9e36e1b tempest-VolumesTransfersTest-1540928287 None] Created reservations ['d77df58b-278a-491b-980b-eb9e1e7811d3', '90a44ff0-3ec7-4a16-b47d-209acf5e092a', '0eb84cac-d313-4e11-830d-4f31aaa65886', '69649058-031c-4f71-9e4c-b6200444b372'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:51:27 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-c6839f3a-12c8-4629-92f2-0924c9e36e1b tempest-VolumesTransfersTest-1540928287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:51:27 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-c6839f3a-12c8-4629-92f2-0924c9e36e1b tempest-VolumesTransfersTest-1540928287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:51:27 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-c6839f3a-12c8-4629-92f2-0924c9e36e1b tempest-VolumesTransfersTest-1540928287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:51:27 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-c6839f3a-12c8-4629-92f2-0924c9e36e1b tempest-VolumesTransfersTest-1540928287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:51:27 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-c6839f3a-12c8-4629-92f2-0924c9e36e1b tempest-VolumesTransfersTest-1540928287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:51:27 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-c6839f3a-12c8-4629-92f2-0924c9e36e1b tempest-VolumesTransfersTest-1540928287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:51:27 devstack sudo[100002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:51:27 devstack sudo[100002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:51:27 devstack sudo[100002]: pam_unix(sudo:session): session closed for user root Sep 08 06:51:27 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-c6839f3a-12c8-4629-92f2-0924c9e36e1b tempest-VolumesTransfersTest-1540928287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.259s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:51:27 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-c6839f3a-12c8-4629-92f2-0924c9e36e1b tempest-VolumesTransfersTest-1540928287 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:51:27 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-c6839f3a-12c8-4629-92f2-0924c9e36e1b tempest-VolumesTransfersTest-1540928287 None] Deleted volume successfully. Sep 08 06:51:27 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-c6839f3a-12c8-4629-92f2-0924c9e36e1b tempest-VolumesTransfersTest-1540928287 None] Lock "cinder-95dfffe7-3b03-4921-9f51-995721fc2765-delete_volume" released by "delete_volume" :: held 1.228s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:51:27 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0ef1f38-a545-45a7-8bd1-608b10e9e65e tempest-VolumesTransfersTest-1419890243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:51:27 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-d0ef1f38-a545-45a7-8bd1-608b10e9e65e tempest-VolumesTransfersTest-1419890243 None] Flow 'volume_create_manager' (79e705da-b2cd-4f39-a3c5-bbcd5f8e0c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:51:27 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-d0ef1f38-a545-45a7-8bd1-608b10e9e65e tempest-VolumesTransfersTest-1419890243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a50a41d-24ed-4bb4-98ba-81d6fb1bc44f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:51:27 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-d0ef1f38-a545-45a7-8bd1-608b10e9e65e tempest-VolumesTransfersTest-1419890243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a50a41d-24ed-4bb4-98ba-81d6fb1bc44f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1016009101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fa7202a-652e-4cfd-85ac-a26328a39e30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f98ce843890247c0b603817882fd4f3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:51:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:51:28Z,use_quota=True,user_id='017b65707de04c57bddf47e063c2b8c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:51:27 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-d0ef1f38-a545-45a7-8bd1-608b10e9e65e tempest-VolumesTransfersTest-1419890243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b0583a5-5a6e-4bc1-8490-a00414b4c184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:51:27 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-d0ef1f38-a545-45a7-8bd1-608b10e9e65e tempest-VolumesTransfersTest-1419890243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b0583a5-5a6e-4bc1-8490-a00414b4c184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:51:27 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-d0ef1f38-a545-45a7-8bd1-608b10e9e65e tempest-VolumesTransfersTest-1419890243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (497ea170-33e2-442e-8589-49cbb26696f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:51:27 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-d0ef1f38-a545-45a7-8bd1-608b10e9e65e tempest-VolumesTransfersTest-1419890243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (497ea170-33e2-442e-8589-49cbb26696f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fa7202a-652e-4cfd-85ac-a26328a39e30', 'volume_name': 'volume-5fa7202a-652e-4cfd-85ac-a26328a39e30', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:51:27 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-d0ef1f38-a545-45a7-8bd1-608b10e9e65e tempest-VolumesTransfersTest-1419890243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aba801c3-f067-4d73-8f11-57f672168536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:51:27 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-d0ef1f38-a545-45a7-8bd1-608b10e9e65e tempest-VolumesTransfersTest-1419890243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aba801c3-f067-4d73-8f11-57f672168536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:51:27 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-d0ef1f38-a545-45a7-8bd1-608b10e9e65e tempest-VolumesTransfersTest-1419890243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad00c11f-5fd9-472a-a4ee-64c5ae005a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:51:28 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-d0ef1f38-a545-45a7-8bd1-608b10e9e65e tempest-VolumesTransfersTest-1419890243 None] Volume 5fa7202a-652e-4cfd-85ac-a26328a39e30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fa7202a-652e-4cfd-85ac-a26328a39e30', 'volume_size': 1} Sep 08 06:51:28 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-d0ef1f38-a545-45a7-8bd1-608b10e9e65e tempest-VolumesTransfersTest-1419890243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:51:28 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-d0ef1f38-a545-45a7-8bd1-608b10e9e65e tempest-VolumesTransfersTest-1419890243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:51:28 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-d0ef1f38-a545-45a7-8bd1-608b10e9e65e tempest-VolumesTransfersTest-1419890243 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1016009101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fa7202a-652e-4cfd-85ac-a26328a39e30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f98ce843890247c0b603817882fd4f3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:51:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:51:28Z,use_quota=True,user_id='017b65707de04c57bddf47e063c2b8c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:51:28 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-d0ef1f38-a545-45a7-8bd1-608b10e9e65e tempest-VolumesTransfersTest-1419890243 None] Creating volume 5fa7202a-652e-4cfd-85ac-a26328a39e30 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:51:28 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-d0ef1f38-a545-45a7-8bd1-608b10e9e65e tempest-VolumesTransfersTest-1419890243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:51:28 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-d0ef1f38-a545-45a7-8bd1-608b10e9e65e tempest-VolumesTransfersTest-1419890243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:51:28 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-d0ef1f38-a545-45a7-8bd1-608b10e9e65e tempest-VolumesTransfersTest-1419890243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:51:28 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-d0ef1f38-a545-45a7-8bd1-608b10e9e65e tempest-VolumesTransfersTest-1419890243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:51:28 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-d0ef1f38-a545-45a7-8bd1-608b10e9e65e tempest-VolumesTransfersTest-1419890243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:51:28 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-d0ef1f38-a545-45a7-8bd1-608b10e9e65e tempest-VolumesTransfersTest-1419890243 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:51:28 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-d0ef1f38-a545-45a7-8bd1-608b10e9e65e tempest-VolumesTransfersTest-1419890243 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:51:28 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-d0ef1f38-a545-45a7-8bd1-608b10e9e65e tempest-VolumesTransfersTest-1419890243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5fa7202a-652e-4cfd-85ac-a26328a39e30 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:51:28 devstack sudo[100032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5fa7202a-652e-4cfd-85ac-a26328a39e30 1073741824 Sep 08 06:51:28 devstack sudo[100032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:51:28 devstack sudo[100032]: pam_unix(sudo:session): session closed for user root Sep 08 06:51:28 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-d0ef1f38-a545-45a7-8bd1-608b10e9e65e tempest-VolumesTransfersTest-1419890243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5fa7202a-652e-4cfd-85ac-a26328a39e30 1073741824" returned: 0 in 0.463s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:51:28 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-d0ef1f38-a545-45a7-8bd1-608b10e9e65e tempest-VolumesTransfersTest-1419890243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5fa7202a-652e-4cfd-85ac-a26328a39e30 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:51:28 devstack sudo[100053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5fa7202a-652e-4cfd-85ac-a26328a39e30 Sep 08 06:51:28 devstack sudo[100053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:51:28 devstack sudo[100053]: pam_unix(sudo:session): session closed for user root Sep 08 06:51:28 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-d0ef1f38-a545-45a7-8bd1-608b10e9e65e tempest-VolumesTransfersTest-1419890243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5fa7202a-652e-4cfd-85ac-a26328a39e30" returned: 0 in 0.253s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:51:28 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-d0ef1f38-a545-45a7-8bd1-608b10e9e65e tempest-VolumesTransfersTest-1419890243 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:51:28 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-d0ef1f38-a545-45a7-8bd1-608b10e9e65e tempest-VolumesTransfersTest-1419890243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:51:28 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-d0ef1f38-a545-45a7-8bd1-608b10e9e65e tempest-VolumesTransfersTest-1419890243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad00c11f-5fd9-472a-a4ee-64c5ae005a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fa7202a-652e-4cfd-85ac-a26328a39e30', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:51:28 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-d0ef1f38-a545-45a7-8bd1-608b10e9e65e tempest-VolumesTransfersTest-1419890243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f979629-d19f-4593-9a99-0d4a998a2eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:51:28 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-d0ef1f38-a545-45a7-8bd1-608b10e9e65e tempest-VolumesTransfersTest-1419890243 None] Volume volume-5fa7202a-652e-4cfd-85ac-a26328a39e30 (5fa7202a-652e-4cfd-85ac-a26328a39e30): created successfully Sep 08 06:51:28 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-d0ef1f38-a545-45a7-8bd1-608b10e9e65e tempest-VolumesTransfersTest-1419890243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f979629-d19f-4593-9a99-0d4a998a2eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:51:28 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-d0ef1f38-a545-45a7-8bd1-608b10e9e65e tempest-VolumesTransfersTest-1419890243 None] Flow 'volume_create_manager' (79e705da-b2cd-4f39-a3c5-bbcd5f8e0c33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:51:28 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-d0ef1f38-a545-45a7-8bd1-608b10e9e65e tempest-VolumesTransfersTest-1419890243 None] Created volume successfully. Sep 08 06:51:30 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-9c417734-2740-47ba-94b8-70af9193cd22 tempest-VolumesTransfersTest-1540928287 None] Acquiring lock "cinder-5fa7202a-652e-4cfd-85ac-a26328a39e30-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:51:30 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-9c417734-2740-47ba-94b8-70af9193cd22 tempest-VolumesTransfersTest-1540928287 None] Lock "cinder-5fa7202a-652e-4cfd-85ac-a26328a39e30-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:51:30 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-9c417734-2740-47ba-94b8-70af9193cd22 tempest-VolumesTransfersTest-1540928287 None] Acquiring lock "cinder-quobyte-5fa7202a-652e-4cfd-85ac-a26328a39e30" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:51:30 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-9c417734-2740-47ba-94b8-70af9193cd22 tempest-VolumesTransfersTest-1540928287 None] Lock "cinder-quobyte-5fa7202a-652e-4cfd-85ac-a26328a39e30" acquired by "delete_volume" :: waited 0.018s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:51:30 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac5a0b0-a897-4120-85ac-d5b719c07e01]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:51:30 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9c417734-2740-47ba-94b8-70af9193cd22 tempest-VolumesTransfersTest-1540928287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5fa7202a-652e-4cfd-85ac-a26328a39e30 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:51:30 devstack sudo[100114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5fa7202a-652e-4cfd-85ac-a26328a39e30 Sep 08 06:51:30 devstack sudo[100114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:51:30 devstack sudo[100114]: pam_unix(sudo:session): session closed for user root Sep 08 06:51:30 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9c417734-2740-47ba-94b8-70af9193cd22 tempest-VolumesTransfersTest-1540928287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5fa7202a-652e-4cfd-85ac-a26328a39e30" returned: 0 in 0.404s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:51:30 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9c417734-2740-47ba-94b8-70af9193cd22 tempest-VolumesTransfersTest-1540928287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5fa7202a-652e-4cfd-85ac-a26328a39e30 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:51:30 devstack sudo[100131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5fa7202a-652e-4cfd-85ac-a26328a39e30 Sep 08 06:51:30 devstack sudo[100131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:51:31 devstack sudo[100131]: pam_unix(sudo:session): session closed for user root Sep 08 06:51:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9c417734-2740-47ba-94b8-70af9193cd22 tempest-VolumesTransfersTest-1540928287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5fa7202a-652e-4cfd-85ac-a26328a39e30" returned: 0 in 0.300s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:51:31 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-9c417734-2740-47ba-94b8-70af9193cd22 tempest-VolumesTransfersTest-1540928287 None] Lock "cinder-quobyte-5fa7202a-652e-4cfd-85ac-a26328a39e30" released by "delete_volume" :: held 0.772s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:51:31 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-9c417734-2740-47ba-94b8-70af9193cd22 tempest-VolumesTransfersTest-1540928287 None] Created reservations ['4a037e11-1f9e-4794-baec-7d7626790135', '78d16702-7192-44c3-bfdf-2abddf69be76', '92540dc5-4660-4c21-9757-9edd2dd05085', '20e5f293-414f-4ece-8a74-fb6e28259363'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:51:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-9c417734-2740-47ba-94b8-70af9193cd22 tempest-VolumesTransfersTest-1540928287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:51:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-9c417734-2740-47ba-94b8-70af9193cd22 tempest-VolumesTransfersTest-1540928287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:51:31 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-9c417734-2740-47ba-94b8-70af9193cd22 tempest-VolumesTransfersTest-1540928287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:51:31 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-9c417734-2740-47ba-94b8-70af9193cd22 tempest-VolumesTransfersTest-1540928287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:51:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-9c417734-2740-47ba-94b8-70af9193cd22 tempest-VolumesTransfersTest-1540928287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:51:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9c417734-2740-47ba-94b8-70af9193cd22 tempest-VolumesTransfersTest-1540928287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:51:31 devstack sudo[100146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:51:31 devstack sudo[100146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:51:31 devstack sudo[100146]: pam_unix(sudo:session): session closed for user root Sep 08 06:51:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9c417734-2740-47ba-94b8-70af9193cd22 tempest-VolumesTransfersTest-1540928287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.343s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:51:31 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-9c417734-2740-47ba-94b8-70af9193cd22 tempest-VolumesTransfersTest-1540928287 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:51:31 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-9c417734-2740-47ba-94b8-70af9193cd22 tempest-VolumesTransfersTest-1540928287 None] Deleted volume successfully. Sep 08 06:51:31 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-9c417734-2740-47ba-94b8-70af9193cd22 tempest-VolumesTransfersTest-1540928287 None] Lock "cinder-5fa7202a-652e-4cfd-85ac-a26328a39e30-delete_volume" released by "delete_volume" :: held 1.361s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:51:33 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d602eb8-79c4-4e4b-8e69-a74640c69965 tempest-VolumesServicesTestJSON-609348908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:51:33 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7d602eb8-79c4-4e4b-8e69-a74640c69965 tempest-VolumesServicesTestJSON-609348908 None] Flow 'volume_create_manager' (7ac618b6-667b-4c4b-a317-a00d660921c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:51:33 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7d602eb8-79c4-4e4b-8e69-a74640c69965 tempest-VolumesServicesTestJSON-609348908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df3f3bd7-abb0-444c-942f-f8cfdfdfd772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:51:33 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7d602eb8-79c4-4e4b-8e69-a74640c69965 tempest-VolumesServicesTestJSON-609348908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df3f3bd7-abb0-444c-942f-f8cfdfdfd772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:51:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1689939304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a89146a-f356-48a3-a359-e6a20fb52c3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='526c67b6b4ef441298763078d0ee5256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:51:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:51:33Z,use_quota=True,user_id='de88a2a1e8e34ebab9190f11683ced50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:51:33 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7d602eb8-79c4-4e4b-8e69-a74640c69965 tempest-VolumesServicesTestJSON-609348908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd5ed5ae-a828-4851-96e9-2ff717ede402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:51:33 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7d602eb8-79c4-4e4b-8e69-a74640c69965 tempest-VolumesServicesTestJSON-609348908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd5ed5ae-a828-4851-96e9-2ff717ede402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:51:33 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7d602eb8-79c4-4e4b-8e69-a74640c69965 tempest-VolumesServicesTestJSON-609348908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e975c85-ba7e-449a-8afa-1639d975c74d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:51:33 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7d602eb8-79c4-4e4b-8e69-a74640c69965 tempest-VolumesServicesTestJSON-609348908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e975c85-ba7e-449a-8afa-1639d975c74d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a89146a-f356-48a3-a359-e6a20fb52c3a', 'volume_name': 'volume-2a89146a-f356-48a3-a359-e6a20fb52c3a', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:51:33 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7d602eb8-79c4-4e4b-8e69-a74640c69965 tempest-VolumesServicesTestJSON-609348908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80d6e2e5-c077-473d-8299-802b9f63b9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:51:33 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7d602eb8-79c4-4e4b-8e69-a74640c69965 tempest-VolumesServicesTestJSON-609348908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80d6e2e5-c077-473d-8299-802b9f63b9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:51:33 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7d602eb8-79c4-4e4b-8e69-a74640c69965 tempest-VolumesServicesTestJSON-609348908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0094f9ba-ec4a-4ae3-8a11-5ef0bc65db76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:51:33 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-7d602eb8-79c4-4e4b-8e69-a74640c69965 tempest-VolumesServicesTestJSON-609348908 None] Volume 2a89146a-f356-48a3-a359-e6a20fb52c3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a89146a-f356-48a3-a359-e6a20fb52c3a', 'volume_size': 1} Sep 08 06:51:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-7d602eb8-79c4-4e4b-8e69-a74640c69965 tempest-VolumesServicesTestJSON-609348908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:51:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-7d602eb8-79c4-4e4b-8e69-a74640c69965 tempest-VolumesServicesTestJSON-609348908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:51:33 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-7d602eb8-79c4-4e4b-8e69-a74640c69965 tempest-VolumesServicesTestJSON-609348908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:51:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1689939304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a89146a-f356-48a3-a359-e6a20fb52c3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='526c67b6b4ef441298763078d0ee5256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:51:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:51:33Z,use_quota=True,user_id='de88a2a1e8e34ebab9190f11683ced50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:51:33 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-7d602eb8-79c4-4e4b-8e69-a74640c69965 tempest-VolumesServicesTestJSON-609348908 None] Creating volume 2a89146a-f356-48a3-a359-e6a20fb52c3a {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:51:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-7d602eb8-79c4-4e4b-8e69-a74640c69965 tempest-VolumesServicesTestJSON-609348908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:51:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-7d602eb8-79c4-4e4b-8e69-a74640c69965 tempest-VolumesServicesTestJSON-609348908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:51:33 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-7d602eb8-79c4-4e4b-8e69-a74640c69965 tempest-VolumesServicesTestJSON-609348908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:51:33 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-7d602eb8-79c4-4e4b-8e69-a74640c69965 tempest-VolumesServicesTestJSON-609348908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:51:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-7d602eb8-79c4-4e4b-8e69-a74640c69965 tempest-VolumesServicesTestJSON-609348908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:51:33 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-7d602eb8-79c4-4e4b-8e69-a74640c69965 tempest-VolumesServicesTestJSON-609348908 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:51:33 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-7d602eb8-79c4-4e4b-8e69-a74640c69965 tempest-VolumesServicesTestJSON-609348908 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:51:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7d602eb8-79c4-4e4b-8e69-a74640c69965 tempest-VolumesServicesTestJSON-609348908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2a89146a-f356-48a3-a359-e6a20fb52c3a 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:51:33 devstack sudo[100216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2a89146a-f356-48a3-a359-e6a20fb52c3a 1073741824 Sep 08 06:51:33 devstack sudo[100216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:51:33 devstack sudo[100216]: pam_unix(sudo:session): session closed for user root Sep 08 06:51:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7d602eb8-79c4-4e4b-8e69-a74640c69965 tempest-VolumesServicesTestJSON-609348908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2a89146a-f356-48a3-a359-e6a20fb52c3a 1073741824" returned: 0 in 0.456s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:51:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7d602eb8-79c4-4e4b-8e69-a74640c69965 tempest-VolumesServicesTestJSON-609348908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2a89146a-f356-48a3-a359-e6a20fb52c3a {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:51:34 devstack sudo[100237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2a89146a-f356-48a3-a359-e6a20fb52c3a Sep 08 06:51:34 devstack sudo[100237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:51:34 devstack sudo[100237]: pam_unix(sudo:session): session closed for user root Sep 08 06:51:34 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7d602eb8-79c4-4e4b-8e69-a74640c69965 tempest-VolumesServicesTestJSON-609348908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2a89146a-f356-48a3-a359-e6a20fb52c3a" returned: 0 in 0.269s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:51:34 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-7d602eb8-79c4-4e4b-8e69-a74640c69965 tempest-VolumesServicesTestJSON-609348908 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:51:34 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-7d602eb8-79c4-4e4b-8e69-a74640c69965 tempest-VolumesServicesTestJSON-609348908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:51:34 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7d602eb8-79c4-4e4b-8e69-a74640c69965 tempest-VolumesServicesTestJSON-609348908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0094f9ba-ec4a-4ae3-8a11-5ef0bc65db76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a89146a-f356-48a3-a359-e6a20fb52c3a', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:51:34 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7d602eb8-79c4-4e4b-8e69-a74640c69965 tempest-VolumesServicesTestJSON-609348908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92ad6de7-3527-4b9a-8d28-a46601164fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:51:34 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-7d602eb8-79c4-4e4b-8e69-a74640c69965 tempest-VolumesServicesTestJSON-609348908 None] Volume volume-2a89146a-f356-48a3-a359-e6a20fb52c3a (2a89146a-f356-48a3-a359-e6a20fb52c3a): created successfully Sep 08 06:51:34 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7d602eb8-79c4-4e4b-8e69-a74640c69965 tempest-VolumesServicesTestJSON-609348908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92ad6de7-3527-4b9a-8d28-a46601164fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:51:34 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7d602eb8-79c4-4e4b-8e69-a74640c69965 tempest-VolumesServicesTestJSON-609348908 None] Flow 'volume_create_manager' (7ac618b6-667b-4c4b-a317-a00d660921c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:51:34 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-7d602eb8-79c4-4e4b-8e69-a74640c69965 tempest-VolumesServicesTestJSON-609348908 None] Created volume successfully. Sep 08 06:51:35 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-8c94a4b4-f590-412d-a08a-8a4314a6a4c2 tempest-VolumesServicesTestJSON-609348908 None] Acquiring lock "cinder-2a89146a-f356-48a3-a359-e6a20fb52c3a-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:51:35 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-8c94a4b4-f590-412d-a08a-8a4314a6a4c2 tempest-VolumesServicesTestJSON-609348908 None] Lock "cinder-2a89146a-f356-48a3-a359-e6a20fb52c3a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:51:35 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-8c94a4b4-f590-412d-a08a-8a4314a6a4c2 tempest-VolumesServicesTestJSON-609348908 None] Acquiring lock "cinder-quobyte-2a89146a-f356-48a3-a359-e6a20fb52c3a" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:51:35 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-8c94a4b4-f590-412d-a08a-8a4314a6a4c2 tempest-VolumesServicesTestJSON-609348908 None] Lock "cinder-quobyte-2a89146a-f356-48a3-a359-e6a20fb52c3a" acquired by "delete_volume" :: waited 0.019s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:51:35 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8202ccfb-3055-4a18-8eb3-47adabc647d3]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:51:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8c94a4b4-f590-412d-a08a-8a4314a6a4c2 tempest-VolumesServicesTestJSON-609348908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2a89146a-f356-48a3-a359-e6a20fb52c3a {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:51:35 devstack sudo[100298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2a89146a-f356-48a3-a359-e6a20fb52c3a Sep 08 06:51:35 devstack sudo[100298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:51:36 devstack sudo[100298]: pam_unix(sudo:session): session closed for user root Sep 08 06:51:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8c94a4b4-f590-412d-a08a-8a4314a6a4c2 tempest-VolumesServicesTestJSON-609348908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2a89146a-f356-48a3-a359-e6a20fb52c3a" returned: 0 in 0.397s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:51:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8c94a4b4-f590-412d-a08a-8a4314a6a4c2 tempest-VolumesServicesTestJSON-609348908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2a89146a-f356-48a3-a359-e6a20fb52c3a {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:51:36 devstack sudo[100314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2a89146a-f356-48a3-a359-e6a20fb52c3a Sep 08 06:51:36 devstack sudo[100314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:51:36 devstack sudo[100314]: pam_unix(sudo:session): session closed for user root Sep 08 06:51:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8c94a4b4-f590-412d-a08a-8a4314a6a4c2 tempest-VolumesServicesTestJSON-609348908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2a89146a-f356-48a3-a359-e6a20fb52c3a" returned: 0 in 0.257s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:51:36 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-8c94a4b4-f590-412d-a08a-8a4314a6a4c2 tempest-VolumesServicesTestJSON-609348908 None] Lock "cinder-quobyte-2a89146a-f356-48a3-a359-e6a20fb52c3a" released by "delete_volume" :: held 0.703s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:51:36 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-8c94a4b4-f590-412d-a08a-8a4314a6a4c2 tempest-VolumesServicesTestJSON-609348908 None] Created reservations ['5ac69ffd-a9b0-4839-8015-0a362447aad6', 'aa0ffb6e-1fc7-4cd9-9e3e-9dce0df37ead', '27217d93-0765-401e-92c5-b6df67fab1f0', 'b8760610-4e67-4e16-987f-78a96d1e5dfd'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:51:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8c94a4b4-f590-412d-a08a-8a4314a6a4c2 tempest-VolumesServicesTestJSON-609348908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:51:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8c94a4b4-f590-412d-a08a-8a4314a6a4c2 tempest-VolumesServicesTestJSON-609348908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:51:36 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8c94a4b4-f590-412d-a08a-8a4314a6a4c2 tempest-VolumesServicesTestJSON-609348908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:51:36 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8c94a4b4-f590-412d-a08a-8a4314a6a4c2 tempest-VolumesServicesTestJSON-609348908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:51:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8c94a4b4-f590-412d-a08a-8a4314a6a4c2 tempest-VolumesServicesTestJSON-609348908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:51:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8c94a4b4-f590-412d-a08a-8a4314a6a4c2 tempest-VolumesServicesTestJSON-609348908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:51:36 devstack sudo[100329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:51:36 devstack sudo[100329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:51:36 devstack sudo[100329]: pam_unix(sudo:session): session closed for user root Sep 08 06:51:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8c94a4b4-f590-412d-a08a-8a4314a6a4c2 tempest-VolumesServicesTestJSON-609348908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.281s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:51:36 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-8c94a4b4-f590-412d-a08a-8a4314a6a4c2 tempest-VolumesServicesTestJSON-609348908 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:51:36 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-8c94a4b4-f590-412d-a08a-8a4314a6a4c2 tempest-VolumesServicesTestJSON-609348908 None] Deleted volume successfully. Sep 08 06:51:36 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-8c94a4b4-f590-412d-a08a-8a4314a6a4c2 tempest-VolumesServicesTestJSON-609348908 None] Lock "cinder-2a89146a-f356-48a3-a359-e6a20fb52c3a-delete_volume" released by "delete_volume" :: held 1.227s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:51:46 devstack cinder-volume[87507]: DEBUG dbcounter [-] [87507] Writing DB stats cinder:UPDATE=45,cinder:SELECT=26,cinder:INSERT=10,cinder:DELETE=6 {{(pid=87507) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 06:51:46 devstack cinder-volume[87507]: DEBUG dbcounter [-] [87507] Writing DB stats cinder:SELECT=31,cinder:UPDATE=43,cinder:INSERT=10,cinder:DELETE=2 {{(pid=87507) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 06:51:47 devstack cinder-volume[87507]: INFO cinder.volume.manager [req-cdf87b2e-0e6d-4123-9f25-8c6b73c92954 req-a91c409d-9a38-4120-a50d-d66973b36df5 tempest-TestShelveInstance-1110004772 None] Terminate volume connection completed successfully. Sep 08 06:51:47 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-cdf87b2e-0e6d-4123-9f25-8c6b73c92954 req-a91c409d-9a38-4120-a50d-d66973b36df5 tempest-TestShelveInstance-1110004772 None] Deleting attachment eff2152a-5168-4e46-9219-b882524d405e. {{(pid=87507) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 06:51:47 devstack cinder-volume[87507]: DEBUG cinder.coordination [req-cdf87b2e-0e6d-4123-9f25-8c6b73c92954 req-ae3a2ab4-fad6-412b-8699-dd0363677904 tempest-TestShelveInstance-1110004772 None] Acquiring lock "cinder-1565e55f-2dc7-43fa-84fb-cade2f0551ed-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:51:47 devstack cinder-volume[87507]: DEBUG cinder.coordination [req-cdf87b2e-0e6d-4123-9f25-8c6b73c92954 req-ae3a2ab4-fad6-412b-8699-dd0363677904 tempest-TestShelveInstance-1110004772 None] Lock "cinder-1565e55f-2dc7-43fa-84fb-cade2f0551ed-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:51:48 devstack cinder-volume[87507]: DEBUG cinder.coordination [req-cdf87b2e-0e6d-4123-9f25-8c6b73c92954 req-ae3a2ab4-fad6-412b-8699-dd0363677904 tempest-TestShelveInstance-1110004772 None] Acquiring lock "cinder-quobyte-1565e55f-2dc7-43fa-84fb-cade2f0551ed" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:51:48 devstack cinder-volume[87507]: DEBUG cinder.coordination [req-cdf87b2e-0e6d-4123-9f25-8c6b73c92954 req-ae3a2ab4-fad6-412b-8699-dd0363677904 tempest-TestShelveInstance-1110004772 None] Lock "cinder-quobyte-1565e55f-2dc7-43fa-84fb-cade2f0551ed" acquired by "delete_volume" :: waited 0.019s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:51:48 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[274864b7-599e-4464-b726-bada47edf4f1]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:51:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [req-cdf87b2e-0e6d-4123-9f25-8c6b73c92954 req-ae3a2ab4-fad6-412b-8699-dd0363677904 tempest-TestShelveInstance-1110004772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1565e55f-2dc7-43fa-84fb-cade2f0551ed {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:51:48 devstack sudo[100703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1565e55f-2dc7-43fa-84fb-cade2f0551ed Sep 08 06:51:48 devstack sudo[100703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:51:48 devstack sudo[100703]: pam_unix(sudo:session): session closed for user root Sep 08 06:51:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [req-cdf87b2e-0e6d-4123-9f25-8c6b73c92954 req-ae3a2ab4-fad6-412b-8699-dd0363677904 tempest-TestShelveInstance-1110004772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1565e55f-2dc7-43fa-84fb-cade2f0551ed" returned: 0 in 0.548s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:51:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [req-cdf87b2e-0e6d-4123-9f25-8c6b73c92954 req-ae3a2ab4-fad6-412b-8699-dd0363677904 tempest-TestShelveInstance-1110004772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1565e55f-2dc7-43fa-84fb-cade2f0551ed {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:51:48 devstack sudo[100726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1565e55f-2dc7-43fa-84fb-cade2f0551ed Sep 08 06:51:48 devstack sudo[100726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:51:49 devstack sudo[100726]: pam_unix(sudo:session): session closed for user root Sep 08 06:51:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [req-cdf87b2e-0e6d-4123-9f25-8c6b73c92954 req-ae3a2ab4-fad6-412b-8699-dd0363677904 tempest-TestShelveInstance-1110004772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1565e55f-2dc7-43fa-84fb-cade2f0551ed" returned: 0 in 0.452s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:51:49 devstack cinder-volume[87507]: DEBUG cinder.coordination [req-cdf87b2e-0e6d-4123-9f25-8c6b73c92954 req-ae3a2ab4-fad6-412b-8699-dd0363677904 tempest-TestShelveInstance-1110004772 None] Lock "cinder-quobyte-1565e55f-2dc7-43fa-84fb-cade2f0551ed" released by "delete_volume" :: held 1.062s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:51:49 devstack cinder-volume[87507]: DEBUG cinder.quota [req-cdf87b2e-0e6d-4123-9f25-8c6b73c92954 req-ae3a2ab4-fad6-412b-8699-dd0363677904 tempest-TestShelveInstance-1110004772 None] Created reservations ['68b67f2d-9e84-4527-8225-4228d6774b8d', '544298dc-ebe2-4762-8070-951213fe5855', '75456730-4466-4abb-a75c-e344ef1940ed', '5555218f-7f62-4589-9534-1ee1826446e0'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:51:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-cdf87b2e-0e6d-4123-9f25-8c6b73c92954 req-ae3a2ab4-fad6-412b-8699-dd0363677904 tempest-TestShelveInstance-1110004772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:51:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-cdf87b2e-0e6d-4123-9f25-8c6b73c92954 req-ae3a2ab4-fad6-412b-8699-dd0363677904 tempest-TestShelveInstance-1110004772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:51:49 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [req-cdf87b2e-0e6d-4123-9f25-8c6b73c92954 req-ae3a2ab4-fad6-412b-8699-dd0363677904 tempest-TestShelveInstance-1110004772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:51:49 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [req-cdf87b2e-0e6d-4123-9f25-8c6b73c92954 req-ae3a2ab4-fad6-412b-8699-dd0363677904 tempest-TestShelveInstance-1110004772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:51:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-cdf87b2e-0e6d-4123-9f25-8c6b73c92954 req-ae3a2ab4-fad6-412b-8699-dd0363677904 tempest-TestShelveInstance-1110004772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:51:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [req-cdf87b2e-0e6d-4123-9f25-8c6b73c92954 req-ae3a2ab4-fad6-412b-8699-dd0363677904 tempest-TestShelveInstance-1110004772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:51:49 devstack sudo[100748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:51:49 devstack sudo[100748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:51:49 devstack sudo[100748]: pam_unix(sudo:session): session closed for user root Sep 08 06:51:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [req-cdf87b2e-0e6d-4123-9f25-8c6b73c92954 req-ae3a2ab4-fad6-412b-8699-dd0363677904 tempest-TestShelveInstance-1110004772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.343s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:51:49 devstack cinder-volume[87507]: DEBUG cinder.manager [req-cdf87b2e-0e6d-4123-9f25-8c6b73c92954 req-ae3a2ab4-fad6-412b-8699-dd0363677904 tempest-TestShelveInstance-1110004772 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:51:49 devstack cinder-volume[87507]: INFO cinder.volume.manager [req-cdf87b2e-0e6d-4123-9f25-8c6b73c92954 req-ae3a2ab4-fad6-412b-8699-dd0363677904 tempest-TestShelveInstance-1110004772 None] Deleted volume successfully. Sep 08 06:51:49 devstack cinder-volume[87507]: DEBUG cinder.coordination [req-cdf87b2e-0e6d-4123-9f25-8c6b73c92954 req-ae3a2ab4-fad6-412b-8699-dd0363677904 tempest-TestShelveInstance-1110004772 None] Lock "cinder-1565e55f-2dc7-43fa-84fb-cade2f0551ed-delete_volume" released by "delete_volume" :: held 1.721s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:51:52 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c027dc7-e10c-4b92-8a0c-38aa7ff15538 tempest-VolumesActionsTest-1238384040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:51:52 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5c027dc7-e10c-4b92-8a0c-38aa7ff15538 tempest-VolumesActionsTest-1238384040 None] Flow 'volume_create_manager' (5bd9007e-b434-4ef6-bd95-16129e55f4e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:51:52 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5c027dc7-e10c-4b92-8a0c-38aa7ff15538 tempest-VolumesActionsTest-1238384040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0eb45e5-22ce-4f03-a2fd-458afb13f1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:51:52 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5c027dc7-e10c-4b92-8a0c-38aa7ff15538 tempest-VolumesActionsTest-1238384040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0eb45e5-22ce-4f03-a2fd-458afb13f1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:51:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2050110494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa8a4571-b304-4037-8887-07da22bc357b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f6d864706f043a296becc83cc214c68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:51:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:51:52Z,use_quota=True,user_id='00868962673e4b959f04b21a2247ed50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:51:52 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5c027dc7-e10c-4b92-8a0c-38aa7ff15538 tempest-VolumesActionsTest-1238384040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d63ce18-e53b-41b2-8a40-e6615aafd0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:51:52 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5c027dc7-e10c-4b92-8a0c-38aa7ff15538 tempest-VolumesActionsTest-1238384040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d63ce18-e53b-41b2-8a40-e6615aafd0f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:51:52 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5c027dc7-e10c-4b92-8a0c-38aa7ff15538 tempest-VolumesActionsTest-1238384040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9472eb4-1879-4869-9610-5c0e307bf7d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:51:52 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5c027dc7-e10c-4b92-8a0c-38aa7ff15538 tempest-VolumesActionsTest-1238384040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9472eb4-1879-4869-9610-5c0e307bf7d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa8a4571-b304-4037-8887-07da22bc357b', 'volume_name': 'volume-aa8a4571-b304-4037-8887-07da22bc357b', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:51:52 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5c027dc7-e10c-4b92-8a0c-38aa7ff15538 tempest-VolumesActionsTest-1238384040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dec8af0-0353-4136-b69a-240644cc6088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:51:52 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5c027dc7-e10c-4b92-8a0c-38aa7ff15538 tempest-VolumesActionsTest-1238384040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dec8af0-0353-4136-b69a-240644cc6088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:51:52 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5c027dc7-e10c-4b92-8a0c-38aa7ff15538 tempest-VolumesActionsTest-1238384040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdaef1fe-313a-4afb-8392-5411a42791e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:51:52 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-5c027dc7-e10c-4b92-8a0c-38aa7ff15538 tempest-VolumesActionsTest-1238384040 None] Volume aa8a4571-b304-4037-8887-07da22bc357b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa8a4571-b304-4037-8887-07da22bc357b', 'volume_size': 1} Sep 08 06:51:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-5c027dc7-e10c-4b92-8a0c-38aa7ff15538 tempest-VolumesActionsTest-1238384040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:51:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-5c027dc7-e10c-4b92-8a0c-38aa7ff15538 tempest-VolumesActionsTest-1238384040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:51:52 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-5c027dc7-e10c-4b92-8a0c-38aa7ff15538 tempest-VolumesActionsTest-1238384040 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:51:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2050110494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa8a4571-b304-4037-8887-07da22bc357b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f6d864706f043a296becc83cc214c68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:51:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:51:52Z,use_quota=True,user_id='00868962673e4b959f04b21a2247ed50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:51:52 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-5c027dc7-e10c-4b92-8a0c-38aa7ff15538 tempest-VolumesActionsTest-1238384040 None] Creating volume aa8a4571-b304-4037-8887-07da22bc357b {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:51:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-5c027dc7-e10c-4b92-8a0c-38aa7ff15538 tempest-VolumesActionsTest-1238384040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:51:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-5c027dc7-e10c-4b92-8a0c-38aa7ff15538 tempest-VolumesActionsTest-1238384040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:51:52 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-5c027dc7-e10c-4b92-8a0c-38aa7ff15538 tempest-VolumesActionsTest-1238384040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:51:52 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-5c027dc7-e10c-4b92-8a0c-38aa7ff15538 tempest-VolumesActionsTest-1238384040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:51:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-5c027dc7-e10c-4b92-8a0c-38aa7ff15538 tempest-VolumesActionsTest-1238384040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:51:52 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-5c027dc7-e10c-4b92-8a0c-38aa7ff15538 tempest-VolumesActionsTest-1238384040 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:51:52 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-5c027dc7-e10c-4b92-8a0c-38aa7ff15538 tempest-VolumesActionsTest-1238384040 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:51:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5c027dc7-e10c-4b92-8a0c-38aa7ff15538 tempest-VolumesActionsTest-1238384040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-aa8a4571-b304-4037-8887-07da22bc357b 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:51:52 devstack sudo[100842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-aa8a4571-b304-4037-8887-07da22bc357b 1073741824 Sep 08 06:51:52 devstack sudo[100842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:51:52 devstack sudo[100842]: pam_unix(sudo:session): session closed for user root Sep 08 06:51:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5c027dc7-e10c-4b92-8a0c-38aa7ff15538 tempest-VolumesActionsTest-1238384040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-aa8a4571-b304-4037-8887-07da22bc357b 1073741824" returned: 0 in 0.542s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:51:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5c027dc7-e10c-4b92-8a0c-38aa7ff15538 tempest-VolumesActionsTest-1238384040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-aa8a4571-b304-4037-8887-07da22bc357b {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:51:52 devstack sudo[100867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-aa8a4571-b304-4037-8887-07da22bc357b Sep 08 06:51:52 devstack sudo[100867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:51:53 devstack sudo[100867]: pam_unix(sudo:session): session closed for user root Sep 08 06:51:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5c027dc7-e10c-4b92-8a0c-38aa7ff15538 tempest-VolumesActionsTest-1238384040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-aa8a4571-b304-4037-8887-07da22bc357b" returned: 0 in 0.346s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:51:53 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-5c027dc7-e10c-4b92-8a0c-38aa7ff15538 tempest-VolumesActionsTest-1238384040 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:51:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-5c027dc7-e10c-4b92-8a0c-38aa7ff15538 tempest-VolumesActionsTest-1238384040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:51:53 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5c027dc7-e10c-4b92-8a0c-38aa7ff15538 tempest-VolumesActionsTest-1238384040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdaef1fe-313a-4afb-8392-5411a42791e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa8a4571-b304-4037-8887-07da22bc357b', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:51:53 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5c027dc7-e10c-4b92-8a0c-38aa7ff15538 tempest-VolumesActionsTest-1238384040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f57fcc99-0287-49af-9598-61f707eb1513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:51:53 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-5c027dc7-e10c-4b92-8a0c-38aa7ff15538 tempest-VolumesActionsTest-1238384040 None] Volume volume-aa8a4571-b304-4037-8887-07da22bc357b (aa8a4571-b304-4037-8887-07da22bc357b): created successfully Sep 08 06:51:53 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5c027dc7-e10c-4b92-8a0c-38aa7ff15538 tempest-VolumesActionsTest-1238384040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f57fcc99-0287-49af-9598-61f707eb1513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:51:53 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5c027dc7-e10c-4b92-8a0c-38aa7ff15538 tempest-VolumesActionsTest-1238384040 None] Flow 'volume_create_manager' (5bd9007e-b434-4ef6-bd95-16129e55f4e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:51:53 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-5c027dc7-e10c-4b92-8a0c-38aa7ff15538 tempest-VolumesActionsTest-1238384040 None] Created volume successfully. Sep 08 06:52:00 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4377fd6-f98a-4cc2-89bd-5b962caf89be tempest-AbsoluteLimitsTests-1152150908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:52:00 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a4377fd6-f98a-4cc2-89bd-5b962caf89be tempest-AbsoluteLimitsTests-1152150908 None] Flow 'volume_create_manager' (42935f2c-dd3e-4c86-b5a6-714d07820802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:52:00 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a4377fd6-f98a-4cc2-89bd-5b962caf89be tempest-AbsoluteLimitsTests-1152150908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cc6b298-750f-4d6e-b939-285faf572752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:52:00 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a4377fd6-f98a-4cc2-89bd-5b962caf89be tempest-AbsoluteLimitsTests-1152150908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cc6b298-750f-4d6e-b939-285faf572752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:52:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2064103036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4527e479-3cfd-48d1-a3e3-0bf11e81df4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71c605cba4084ecc979205f969a215cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:52:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:52:01Z,use_quota=True,user_id='37abf31fcf8c4c789e99b105cef41395',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:52:00 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a4377fd6-f98a-4cc2-89bd-5b962caf89be tempest-AbsoluteLimitsTests-1152150908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7572984a-ab9e-455f-9bfd-533c4ddae9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:52:00 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a4377fd6-f98a-4cc2-89bd-5b962caf89be tempest-AbsoluteLimitsTests-1152150908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7572984a-ab9e-455f-9bfd-533c4ddae9cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:52:00 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a4377fd6-f98a-4cc2-89bd-5b962caf89be tempest-AbsoluteLimitsTests-1152150908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28a056fe-a2b9-4785-b962-abd4c2de26de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:52:00 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a4377fd6-f98a-4cc2-89bd-5b962caf89be tempest-AbsoluteLimitsTests-1152150908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28a056fe-a2b9-4785-b962-abd4c2de26de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4527e479-3cfd-48d1-a3e3-0bf11e81df4e', 'volume_name': 'volume-4527e479-3cfd-48d1-a3e3-0bf11e81df4e', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:52:00 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a4377fd6-f98a-4cc2-89bd-5b962caf89be tempest-AbsoluteLimitsTests-1152150908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbd64846-8b10-40a8-93eb-bf9a77214385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:52:00 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a4377fd6-f98a-4cc2-89bd-5b962caf89be tempest-AbsoluteLimitsTests-1152150908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbd64846-8b10-40a8-93eb-bf9a77214385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:52:00 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a4377fd6-f98a-4cc2-89bd-5b962caf89be tempest-AbsoluteLimitsTests-1152150908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aa025e8-a912-4bd2-9e25-3c2f6acdd093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:52:00 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-a4377fd6-f98a-4cc2-89bd-5b962caf89be tempest-AbsoluteLimitsTests-1152150908 None] Volume 4527e479-3cfd-48d1-a3e3-0bf11e81df4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4527e479-3cfd-48d1-a3e3-0bf11e81df4e', 'volume_size': 1} Sep 08 06:52:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a4377fd6-f98a-4cc2-89bd-5b962caf89be tempest-AbsoluteLimitsTests-1152150908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:52:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a4377fd6-f98a-4cc2-89bd-5b962caf89be tempest-AbsoluteLimitsTests-1152150908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:52:00 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-a4377fd6-f98a-4cc2-89bd-5b962caf89be tempest-AbsoluteLimitsTests-1152150908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:52:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2064103036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4527e479-3cfd-48d1-a3e3-0bf11e81df4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71c605cba4084ecc979205f969a215cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:52:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:52:01Z,use_quota=True,user_id='37abf31fcf8c4c789e99b105cef41395',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:52:00 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-a4377fd6-f98a-4cc2-89bd-5b962caf89be tempest-AbsoluteLimitsTests-1152150908 None] Creating volume 4527e479-3cfd-48d1-a3e3-0bf11e81df4e {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:52:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a4377fd6-f98a-4cc2-89bd-5b962caf89be tempest-AbsoluteLimitsTests-1152150908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:52:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a4377fd6-f98a-4cc2-89bd-5b962caf89be tempest-AbsoluteLimitsTests-1152150908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:52:00 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-a4377fd6-f98a-4cc2-89bd-5b962caf89be tempest-AbsoluteLimitsTests-1152150908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:52:00 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-a4377fd6-f98a-4cc2-89bd-5b962caf89be tempest-AbsoluteLimitsTests-1152150908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:52:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a4377fd6-f98a-4cc2-89bd-5b962caf89be tempest-AbsoluteLimitsTests-1152150908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:52:00 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-a4377fd6-f98a-4cc2-89bd-5b962caf89be tempest-AbsoluteLimitsTests-1152150908 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:52:00 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-a4377fd6-f98a-4cc2-89bd-5b962caf89be tempest-AbsoluteLimitsTests-1152150908 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:52:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a4377fd6-f98a-4cc2-89bd-5b962caf89be tempest-AbsoluteLimitsTests-1152150908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4527e479-3cfd-48d1-a3e3-0bf11e81df4e 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:52:00 devstack sudo[101131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4527e479-3cfd-48d1-a3e3-0bf11e81df4e 1073741824 Sep 08 06:52:00 devstack sudo[101131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:52:01 devstack sudo[101131]: pam_unix(sudo:session): session closed for user root Sep 08 06:52:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a4377fd6-f98a-4cc2-89bd-5b962caf89be tempest-AbsoluteLimitsTests-1152150908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4527e479-3cfd-48d1-a3e3-0bf11e81df4e 1073741824" returned: 0 in 0.565s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:52:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a4377fd6-f98a-4cc2-89bd-5b962caf89be tempest-AbsoluteLimitsTests-1152150908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4527e479-3cfd-48d1-a3e3-0bf11e81df4e {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:52:01 devstack sudo[101157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4527e479-3cfd-48d1-a3e3-0bf11e81df4e Sep 08 06:52:01 devstack sudo[101157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:52:01 devstack sudo[101157]: pam_unix(sudo:session): session closed for user root Sep 08 06:52:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a4377fd6-f98a-4cc2-89bd-5b962caf89be tempest-AbsoluteLimitsTests-1152150908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4527e479-3cfd-48d1-a3e3-0bf11e81df4e" returned: 0 in 0.319s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:52:01 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-a4377fd6-f98a-4cc2-89bd-5b962caf89be tempest-AbsoluteLimitsTests-1152150908 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:52:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a4377fd6-f98a-4cc2-89bd-5b962caf89be tempest-AbsoluteLimitsTests-1152150908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:52:01 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a4377fd6-f98a-4cc2-89bd-5b962caf89be tempest-AbsoluteLimitsTests-1152150908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aa025e8-a912-4bd2-9e25-3c2f6acdd093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4527e479-3cfd-48d1-a3e3-0bf11e81df4e', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:52:01 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a4377fd6-f98a-4cc2-89bd-5b962caf89be tempest-AbsoluteLimitsTests-1152150908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74799690-ffda-4e6a-8699-73d7b0043e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:52:01 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-a4377fd6-f98a-4cc2-89bd-5b962caf89be tempest-AbsoluteLimitsTests-1152150908 None] Volume volume-4527e479-3cfd-48d1-a3e3-0bf11e81df4e (4527e479-3cfd-48d1-a3e3-0bf11e81df4e): created successfully Sep 08 06:52:01 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a4377fd6-f98a-4cc2-89bd-5b962caf89be tempest-AbsoluteLimitsTests-1152150908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74799690-ffda-4e6a-8699-73d7b0043e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:52:01 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a4377fd6-f98a-4cc2-89bd-5b962caf89be tempest-AbsoluteLimitsTests-1152150908 None] Flow 'volume_create_manager' (42935f2c-dd3e-4c86-b5a6-714d07820802) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:52:01 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-a4377fd6-f98a-4cc2-89bd-5b962caf89be tempest-AbsoluteLimitsTests-1152150908 None] Created volume successfully. Sep 08 06:52:03 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-3d85bba1-b37b-4774-8a87-3a5065cf6b28 tempest-AbsoluteLimitsTests-1152150908 None] Acquiring lock "cinder-4527e479-3cfd-48d1-a3e3-0bf11e81df4e-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:52:03 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-3d85bba1-b37b-4774-8a87-3a5065cf6b28 tempest-AbsoluteLimitsTests-1152150908 None] Lock "cinder-4527e479-3cfd-48d1-a3e3-0bf11e81df4e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:52:03 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-3d85bba1-b37b-4774-8a87-3a5065cf6b28 tempest-AbsoluteLimitsTests-1152150908 None] Acquiring lock "cinder-quobyte-4527e479-3cfd-48d1-a3e3-0bf11e81df4e" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:52:03 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-3d85bba1-b37b-4774-8a87-3a5065cf6b28 tempest-AbsoluteLimitsTests-1152150908 None] Lock "cinder-quobyte-4527e479-3cfd-48d1-a3e3-0bf11e81df4e" acquired by "delete_volume" :: waited 0.026s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:52:03 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2d2f65-301d-46de-b501-d79a18f9ea18]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:52:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3d85bba1-b37b-4774-8a87-3a5065cf6b28 tempest-AbsoluteLimitsTests-1152150908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4527e479-3cfd-48d1-a3e3-0bf11e81df4e {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:52:03 devstack sudo[101295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4527e479-3cfd-48d1-a3e3-0bf11e81df4e Sep 08 06:52:03 devstack sudo[101295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:52:04 devstack sudo[101295]: pam_unix(sudo:session): session closed for user root Sep 08 06:52:04 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3d85bba1-b37b-4774-8a87-3a5065cf6b28 tempest-AbsoluteLimitsTests-1152150908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4527e479-3cfd-48d1-a3e3-0bf11e81df4e" returned: 0 in 0.633s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:52:04 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3d85bba1-b37b-4774-8a87-3a5065cf6b28 tempest-AbsoluteLimitsTests-1152150908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4527e479-3cfd-48d1-a3e3-0bf11e81df4e {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:52:04 devstack sudo[101320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4527e479-3cfd-48d1-a3e3-0bf11e81df4e Sep 08 06:52:04 devstack sudo[101320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:52:04 devstack sudo[101320]: pam_unix(sudo:session): session closed for user root Sep 08 06:52:04 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3d85bba1-b37b-4774-8a87-3a5065cf6b28 tempest-AbsoluteLimitsTests-1152150908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4527e479-3cfd-48d1-a3e3-0bf11e81df4e" returned: 0 in 0.410s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:52:04 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-3d85bba1-b37b-4774-8a87-3a5065cf6b28 tempest-AbsoluteLimitsTests-1152150908 None] Lock "cinder-quobyte-4527e479-3cfd-48d1-a3e3-0bf11e81df4e" released by "delete_volume" :: held 1.124s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:52:04 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-3d85bba1-b37b-4774-8a87-3a5065cf6b28 tempest-AbsoluteLimitsTests-1152150908 None] Created reservations ['609bad7a-e645-44bf-bc6a-10d9e4bad070', '92d2b45c-117b-4aaf-97c0-dc58bc505953', 'caf1f49b-d27e-4d25-a153-a95270e4136a', 'd5804f2c-db20-4871-a649-8890146c8ae0'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:52:04 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-3d85bba1-b37b-4774-8a87-3a5065cf6b28 tempest-AbsoluteLimitsTests-1152150908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:52:04 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-3d85bba1-b37b-4774-8a87-3a5065cf6b28 tempest-AbsoluteLimitsTests-1152150908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:52:04 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-3d85bba1-b37b-4774-8a87-3a5065cf6b28 tempest-AbsoluteLimitsTests-1152150908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:52:04 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-3d85bba1-b37b-4774-8a87-3a5065cf6b28 tempest-AbsoluteLimitsTests-1152150908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:52:04 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-3d85bba1-b37b-4774-8a87-3a5065cf6b28 tempest-AbsoluteLimitsTests-1152150908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:52:04 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3d85bba1-b37b-4774-8a87-3a5065cf6b28 tempest-AbsoluteLimitsTests-1152150908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:52:04 devstack sudo[101341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:52:04 devstack sudo[101341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:52:05 devstack sudo[101341]: pam_unix(sudo:session): session closed for user root Sep 08 06:52:05 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3d85bba1-b37b-4774-8a87-3a5065cf6b28 tempest-AbsoluteLimitsTests-1152150908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.273s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:52:05 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-3d85bba1-b37b-4774-8a87-3a5065cf6b28 tempest-AbsoluteLimitsTests-1152150908 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:52:05 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-3d85bba1-b37b-4774-8a87-3a5065cf6b28 tempest-AbsoluteLimitsTests-1152150908 None] Deleted volume successfully. Sep 08 06:52:05 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-3d85bba1-b37b-4774-8a87-3a5065cf6b28 tempest-AbsoluteLimitsTests-1152150908 None] Lock "cinder-4527e479-3cfd-48d1-a3e3-0bf11e81df4e-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:52:06 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-caae3086-4cd3-4f3f-bfa5-bace94fd0cec tempest-VolumesActionsTest-1238384040 None] Acquiring lock "cinder-aa8a4571-b304-4037-8887-07da22bc357b" by "attach_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:52:06 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-caae3086-4cd3-4f3f-bfa5-bace94fd0cec tempest-VolumesActionsTest-1238384040 None] Lock "cinder-aa8a4571-b304-4037-8887-07da22bc357b" acquired by "attach_volume" :: waited 0.028s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:52:06 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-caae3086-4cd3-4f3f-bfa5-bace94fd0cec tempest-VolumesActionsTest-1238384040 None] Attaching volume aa8a4571-b304-4037-8887-07da22bc357b to instance bb594caa-242f-4720-b6d2-56af2812b131 at mountpoint /dev/vdb on host None. Sep 08 06:52:06 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-caae3086-4cd3-4f3f-bfa5-bace94fd0cec tempest-VolumesActionsTest-1238384040 None] Attach volume completed successfully. Sep 08 06:52:06 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-caae3086-4cd3-4f3f-bfa5-bace94fd0cec tempest-VolumesActionsTest-1238384040 None] Lock "cinder-aa8a4571-b304-4037-8887-07da22bc357b" released by "attach_volume" :: held 0.118s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:52:06 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-dbe08aff-877f-444b-b30f-6c6b63f65720 tempest-VolumesActionsTest-1238384040 None] Acquiring lock "cinder-aa8a4571-b304-4037-8887-07da22bc357b-detach_volume" by "detach_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:52:06 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-dbe08aff-877f-444b-b30f-6c6b63f65720 tempest-VolumesActionsTest-1238384040 None] Lock "cinder-aa8a4571-b304-4037-8887-07da22bc357b-detach_volume" acquired by "detach_volume" :: waited 0.041s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:52:06 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-dbe08aff-877f-444b-b30f-6c6b63f65720 tempest-VolumesActionsTest-1238384040 None] Detaching volume aa8a4571-b304-4037-8887-07da22bc357b from instance bb594caa-242f-4720-b6d2-56af2812b131. Sep 08 06:52:06 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-dbe08aff-877f-444b-b30f-6c6b63f65720 tempest-VolumesActionsTest-1238384040 None] Detach volume completed successfully. Sep 08 06:52:06 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-dbe08aff-877f-444b-b30f-6c6b63f65720 tempest-VolumesActionsTest-1238384040 None] Lock "cinder-aa8a4571-b304-4037-8887-07da22bc357b-detach_volume" released by "detach_volume" :: held 0.095s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:52:07 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-c286ef8a-43cb-4844-b0c2-dcf326ff5b84 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:52:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-c286ef8a-43cb-4844-b0c2-dcf326ff5b84 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Flow 'volume_create_manager' (18463114-199f-4ff3-95b0-555455a82c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:52:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-c286ef8a-43cb-4844-b0c2-dcf326ff5b84 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4b4f752-c736-4d2e-85eb-00f470ebcb2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:52:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-c286ef8a-43cb-4844-b0c2-dcf326ff5b84 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4b4f752-c736-4d2e-85eb-00f470ebcb2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:52:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2028780952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a37e205e226f44668d16fcf1e7b8dd1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:52:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:52:07Z,use_quota=True,user_id='2b53c6cbd9754ae38c2e90b0a71a3c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:52:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-c286ef8a-43cb-4844-b0c2-dcf326ff5b84 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bbeec6f-2ffd-4906-a8de-23a724123a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:52:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-c286ef8a-43cb-4844-b0c2-dcf326ff5b84 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bbeec6f-2ffd-4906-a8de-23a724123a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:52:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-c286ef8a-43cb-4844-b0c2-dcf326ff5b84 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c605d99-463f-4864-93ec-9e2144df8f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:52:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-c286ef8a-43cb-4844-b0c2-dcf326ff5b84 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c605d99-463f-4864-93ec-9e2144df8f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4', 'volume_name': 'volume-8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:52:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-c286ef8a-43cb-4844-b0c2-dcf326ff5b84 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23b4992e-f1d9-4412-8c3e-f61e87d7aa1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:52:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-c286ef8a-43cb-4844-b0c2-dcf326ff5b84 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23b4992e-f1d9-4412-8c3e-f61e87d7aa1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:52:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-c286ef8a-43cb-4844-b0c2-dcf326ff5b84 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05173ab4-5835-4228-aeb3-e0144104bc0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:52:07 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-c286ef8a-43cb-4844-b0c2-dcf326ff5b84 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Volume 8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4', 'volume_size': 1} Sep 08 06:52:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-c286ef8a-43cb-4844-b0c2-dcf326ff5b84 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:52:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-c286ef8a-43cb-4844-b0c2-dcf326ff5b84 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:52:07 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-c286ef8a-43cb-4844-b0c2-dcf326ff5b84 tempest-CreateVolumesFromSnapshotTest-1179291947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:52:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2028780952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a37e205e226f44668d16fcf1e7b8dd1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:52:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:52:07Z,use_quota=True,user_id='2b53c6cbd9754ae38c2e90b0a71a3c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:52:07 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-c286ef8a-43cb-4844-b0c2-dcf326ff5b84 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Creating volume 8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:52:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-c286ef8a-43cb-4844-b0c2-dcf326ff5b84 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:52:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-c286ef8a-43cb-4844-b0c2-dcf326ff5b84 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:52:07 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-c286ef8a-43cb-4844-b0c2-dcf326ff5b84 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:52:07 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-c286ef8a-43cb-4844-b0c2-dcf326ff5b84 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:52:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-c286ef8a-43cb-4844-b0c2-dcf326ff5b84 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:52:07 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-c286ef8a-43cb-4844-b0c2-dcf326ff5b84 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:52:07 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-c286ef8a-43cb-4844-b0c2-dcf326ff5b84 tempest-CreateVolumesFromSnapshotTest-1179291947 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:52:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-c286ef8a-43cb-4844-b0c2-dcf326ff5b84 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:52:07 devstack sudo[101439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4 1073741824 Sep 08 06:52:07 devstack sudo[101439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:52:08 devstack sudo[101439]: pam_unix(sudo:session): session closed for user root Sep 08 06:52:08 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-c286ef8a-43cb-4844-b0c2-dcf326ff5b84 tempest-CreateVolumesFromSnapshotTest-1179291947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4 1073741824" returned: 0 in 0.590s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:52:08 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-c286ef8a-43cb-4844-b0c2-dcf326ff5b84 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:52:08 devstack sudo[101467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4 Sep 08 06:52:08 devstack sudo[101467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:52:08 devstack sudo[101467]: pam_unix(sudo:session): session closed for user root Sep 08 06:52:08 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-c286ef8a-43cb-4844-b0c2-dcf326ff5b84 tempest-CreateVolumesFromSnapshotTest-1179291947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4" returned: 0 in 0.290s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:52:08 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-c286ef8a-43cb-4844-b0c2-dcf326ff5b84 tempest-CreateVolumesFromSnapshotTest-1179291947 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:52:08 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-c286ef8a-43cb-4844-b0c2-dcf326ff5b84 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:52:08 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-c286ef8a-43cb-4844-b0c2-dcf326ff5b84 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05173ab4-5835-4228-aeb3-e0144104bc0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:52:08 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-c286ef8a-43cb-4844-b0c2-dcf326ff5b84 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e26d8f48-6f71-49fb-baa3-e5fc02b65433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:52:08 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-c286ef8a-43cb-4844-b0c2-dcf326ff5b84 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Volume volume-8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4 (8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4): created successfully Sep 08 06:52:08 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-c286ef8a-43cb-4844-b0c2-dcf326ff5b84 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e26d8f48-6f71-49fb-baa3-e5fc02b65433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:52:08 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-c286ef8a-43cb-4844-b0c2-dcf326ff5b84 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Flow 'volume_create_manager' (18463114-199f-4ff3-95b0-555455a82c3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:52:08 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-c286ef8a-43cb-4844-b0c2-dcf326ff5b84 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Created volume successfully. Sep 08 06:52:09 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a020502d-f51f-4dcb-a2b8-fcc49520d234 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:52:09 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a020502d-f51f-4dcb-a2b8-fcc49520d234 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:52:09 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-a020502d-f51f-4dcb-a2b8-fcc49520d234 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Creating offline snapshot 63d4a44a-7223-4d73-8a44-82d59831ed9c of volume 8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4 {{(pid=87507) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 06:52:09 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[efbcc1a0-909a-4c84-be9d-a2510c14b433]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:52:09 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a020502d-f51f-4dcb-a2b8-fcc49520d234 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:52:09 devstack sudo[101515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4 Sep 08 06:52:09 devstack sudo[101515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:52:10 devstack sudo[101515]: pam_unix(sudo:session): session closed for user root Sep 08 06:52:10 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a020502d-f51f-4dcb-a2b8-fcc49520d234 tempest-CreateVolumesFromSnapshotTest-1179291947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4" returned: 0 in 0.408s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:52:10 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a020502d-f51f-4dcb-a2b8-fcc49520d234 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4.63d4a44a-7223-4d73-8a44-82d59831ed9c 1G {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:52:10 devstack sudo[101534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4.63d4a44a-7223-4d73-8a44-82d59831ed9c 1G Sep 08 06:52:10 devstack sudo[101534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:52:10 devstack sudo[101534]: pam_unix(sudo:session): session closed for user root Sep 08 06:52:10 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a020502d-f51f-4dcb-a2b8-fcc49520d234 tempest-CreateVolumesFromSnapshotTest-1179291947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4.63d4a44a-7223-4d73-8a44-82d59831ed9c 1G" returned: 0 in 0.551s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:52:10 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a020502d-f51f-4dcb-a2b8-fcc49520d234 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4.63d4a44a-7223-4d73-8a44-82d59831ed9c {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:52:10 devstack sudo[101561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4.63d4a44a-7223-4d73-8a44-82d59831ed9c Sep 08 06:52:10 devstack sudo[101561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:52:11 devstack sudo[101561]: pam_unix(sudo:session): session closed for user root Sep 08 06:52:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a020502d-f51f-4dcb-a2b8-fcc49520d234 tempest-CreateVolumesFromSnapshotTest-1179291947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4.63d4a44a-7223-4d73-8a44-82d59831ed9c" returned: 0 in 0.423s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:52:11 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-a020502d-f51f-4dcb-a2b8-fcc49520d234 tempest-CreateVolumesFromSnapshotTest-1179291947 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4.63d4a44a-7223-4d73-8a44-82d59831ed9c is being set with open permissions: ugo+rw Sep 08 06:52:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a020502d-f51f-4dcb-a2b8-fcc49520d234 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4.63d4a44a-7223-4d73-8a44-82d59831ed9c {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:52:11 devstack sudo[101581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4.63d4a44a-7223-4d73-8a44-82d59831ed9c Sep 08 06:52:11 devstack sudo[101581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:52:11 devstack sudo[101581]: pam_unix(sudo:session): session closed for user root Sep 08 06:52:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a020502d-f51f-4dcb-a2b8-fcc49520d234 tempest-CreateVolumesFromSnapshotTest-1179291947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4.63d4a44a-7223-4d73-8a44-82d59831ed9c" returned: 0 in 0.335s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:52:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a020502d-f51f-4dcb-a2b8-fcc49520d234 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:52:11 devstack sudo[101599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4.info Sep 08 06:52:11 devstack sudo[101599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:52:11 devstack sudo[101599]: pam_unix(sudo:session): session closed for user root Sep 08 06:52:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a020502d-f51f-4dcb-a2b8-fcc49520d234 tempest-CreateVolumesFromSnapshotTest-1179291947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4.info" returned: 0 in 0.286s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:52:11 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-a020502d-f51f-4dcb-a2b8-fcc49520d234 tempest-CreateVolumesFromSnapshotTest-1179291947 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4.info is being set with open permissions: ugo+rw Sep 08 06:52:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a020502d-f51f-4dcb-a2b8-fcc49520d234 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:52:11 devstack sudo[101611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4.info Sep 08 06:52:11 devstack sudo[101611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:52:12 devstack sudo[101611]: pam_unix(sudo:session): session closed for user root Sep 08 06:52:12 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a020502d-f51f-4dcb-a2b8-fcc49520d234 tempest-CreateVolumesFromSnapshotTest-1179291947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4.info" returned: 0 in 0.302s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:52:12 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a020502d-f51f-4dcb-a2b8-fcc49520d234 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.429s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:52:12 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-a020502d-f51f-4dcb-a2b8-fcc49520d234 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Create snapshot completed successfully Sep 08 06:52:13 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-f510a5c3-a739-483f-8ebe-cb542ccaf850 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:52:13 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-f510a5c3-a739-483f-8ebe-cb542ccaf850 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Flow 'volume_create_manager' (15ec3905-c55f-4b7a-82b9-df2e6c4f419b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:52:13 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-f510a5c3-a739-483f-8ebe-cb542ccaf850 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c94802b-743d-4953-9ae0-eea178a36b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:52:13 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-f510a5c3-a739-483f-8ebe-cb542ccaf850 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c94802b-743d-4953-9ae0-eea178a36b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:52:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1240395053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cdd1477-3e56-40bd-8fe0-6ba154aec949,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a37e205e226f44668d16fcf1e7b8dd1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:52:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:52:14Z,use_quota=True,user_id='2b53c6cbd9754ae38c2e90b0a71a3c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:52:13 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-f510a5c3-a739-483f-8ebe-cb542ccaf850 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a9a712d-439b-45f8-b439-9342b4e4cd6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:52:13 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-f510a5c3-a739-483f-8ebe-cb542ccaf850 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a9a712d-439b-45f8-b439-9342b4e4cd6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:52:13 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-f510a5c3-a739-483f-8ebe-cb542ccaf850 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6e5677e-9773-496b-94eb-b7e05a05dc3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:52:13 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-f510a5c3-a739-483f-8ebe-cb542ccaf850 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6e5677e-9773-496b-94eb-b7e05a05dc3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cdd1477-3e56-40bd-8fe0-6ba154aec949', 'volume_name': 'volume-1cdd1477-3e56-40bd-8fe0-6ba154aec949', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:52:13 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-f510a5c3-a739-483f-8ebe-cb542ccaf850 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6a6aad2-5265-44e7-87a1-d3843ac8abb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:52:13 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-f510a5c3-a739-483f-8ebe-cb542ccaf850 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6a6aad2-5265-44e7-87a1-d3843ac8abb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:52:13 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-f510a5c3-a739-483f-8ebe-cb542ccaf850 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54331706-9e6d-4bff-b667-594abd076930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:52:13 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-f510a5c3-a739-483f-8ebe-cb542ccaf850 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Volume 1cdd1477-3e56-40bd-8fe0-6ba154aec949: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cdd1477-3e56-40bd-8fe0-6ba154aec949', 'volume_size': 1} Sep 08 06:52:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-f510a5c3-a739-483f-8ebe-cb542ccaf850 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:52:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-f510a5c3-a739-483f-8ebe-cb542ccaf850 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:52:13 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-f510a5c3-a739-483f-8ebe-cb542ccaf850 tempest-CreateVolumesFromSnapshotTest-1179291947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:52:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1240395053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cdd1477-3e56-40bd-8fe0-6ba154aec949,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a37e205e226f44668d16fcf1e7b8dd1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:52:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:52:14Z,use_quota=True,user_id='2b53c6cbd9754ae38c2e90b0a71a3c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:52:13 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-f510a5c3-a739-483f-8ebe-cb542ccaf850 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Creating volume 1cdd1477-3e56-40bd-8fe0-6ba154aec949 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:52:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-f510a5c3-a739-483f-8ebe-cb542ccaf850 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:52:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-f510a5c3-a739-483f-8ebe-cb542ccaf850 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:52:13 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-f510a5c3-a739-483f-8ebe-cb542ccaf850 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:52:13 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-f510a5c3-a739-483f-8ebe-cb542ccaf850 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:52:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-f510a5c3-a739-483f-8ebe-cb542ccaf850 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:52:13 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-f510a5c3-a739-483f-8ebe-cb542ccaf850 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:52:13 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-f510a5c3-a739-483f-8ebe-cb542ccaf850 tempest-CreateVolumesFromSnapshotTest-1179291947 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:52:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f510a5c3-a739-483f-8ebe-cb542ccaf850 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1cdd1477-3e56-40bd-8fe0-6ba154aec949 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:52:13 devstack sudo[101689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1cdd1477-3e56-40bd-8fe0-6ba154aec949 1073741824 Sep 08 06:52:13 devstack sudo[101689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:52:14 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-754dbf35-8b6a-4c02-87e9-d32079e96102 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:52:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-754dbf35-8b6a-4c02-87e9-d32079e96102 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Flow 'volume_create_manager' (038e7fb2-78de-4f40-b35d-c6a5c4df0bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:52:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-754dbf35-8b6a-4c02-87e9-d32079e96102 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7548f0f3-8e7b-4322-9593-2f78c81307f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:52:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-754dbf35-8b6a-4c02-87e9-d32079e96102 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7548f0f3-8e7b-4322-9593-2f78c81307f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-524003783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e39bb2a-d433-4d6e-bdb8-e830426649ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a37e205e226f44668d16fcf1e7b8dd1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:52:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:52:14Z,use_quota=True,user_id='2b53c6cbd9754ae38c2e90b0a71a3c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:52:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-754dbf35-8b6a-4c02-87e9-d32079e96102 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72911cfd-237c-4828-8c17-b459b2f2de31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:52:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-754dbf35-8b6a-4c02-87e9-d32079e96102 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72911cfd-237c-4828-8c17-b459b2f2de31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:52:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-754dbf35-8b6a-4c02-87e9-d32079e96102 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3df98c85-ede1-44fe-a41e-b6bbc82e6d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:52:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-754dbf35-8b6a-4c02-87e9-d32079e96102 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3df98c85-ede1-44fe-a41e-b6bbc82e6d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e39bb2a-d433-4d6e-bdb8-e830426649ed', 'volume_name': 'volume-5e39bb2a-d433-4d6e-bdb8-e830426649ed', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:52:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-754dbf35-8b6a-4c02-87e9-d32079e96102 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac588eb0-ac06-46b6-bf5f-20ed31b3fc03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:52:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-754dbf35-8b6a-4c02-87e9-d32079e96102 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac588eb0-ac06-46b6-bf5f-20ed31b3fc03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:52:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-754dbf35-8b6a-4c02-87e9-d32079e96102 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24d6a96a-d892-4d31-9b8d-ee468578f2a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:52:14 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-754dbf35-8b6a-4c02-87e9-d32079e96102 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Volume 5e39bb2a-d433-4d6e-bdb8-e830426649ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e39bb2a-d433-4d6e-bdb8-e830426649ed', 'volume_size': 1} Sep 08 06:52:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-754dbf35-8b6a-4c02-87e9-d32079e96102 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:52:14 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-b70cfa9f-9a41-4fce-a27e-ec03cf1eecce tempest-CreateVolumesFromSnapshotTest-1179291947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:52:14 devstack sudo[101689]: pam_unix(sudo:session): session closed for user root Sep 08 06:52:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b70cfa9f-9a41-4fce-a27e-ec03cf1eecce tempest-CreateVolumesFromSnapshotTest-1179291947 None] Flow 'volume_create_manager' (babacf58-e670-4923-94e0-34d67b3836cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:52:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b70cfa9f-9a41-4fce-a27e-ec03cf1eecce tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c1c8703-203e-4ce0-992c-4bf9203696bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:52:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f510a5c3-a739-483f-8ebe-cb542ccaf850 tempest-CreateVolumesFromSnapshotTest-1179291947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1cdd1477-3e56-40bd-8fe0-6ba154aec949 1073741824" returned: 0 in 0.899s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:52:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b70cfa9f-9a41-4fce-a27e-ec03cf1eecce tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c1c8703-203e-4ce0-992c-4bf9203696bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1629509384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9102b518-793f-416d-a206-f454b41f96f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a37e205e226f44668d16fcf1e7b8dd1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:52:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:52:15Z,use_quota=True,user_id='2b53c6cbd9754ae38c2e90b0a71a3c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:52:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b70cfa9f-9a41-4fce-a27e-ec03cf1eecce tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ee76ccf-10bb-49b6-8fc4-703ea67e469e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:52:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b70cfa9f-9a41-4fce-a27e-ec03cf1eecce tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ee76ccf-10bb-49b6-8fc4-703ea67e469e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:52:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b70cfa9f-9a41-4fce-a27e-ec03cf1eecce tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dda1ae9a-88ec-4eb3-bea5-099591adf1fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:52:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b70cfa9f-9a41-4fce-a27e-ec03cf1eecce tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dda1ae9a-88ec-4eb3-bea5-099591adf1fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9102b518-793f-416d-a206-f454b41f96f0', 'volume_name': 'volume-9102b518-793f-416d-a206-f454b41f96f0', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:52:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b70cfa9f-9a41-4fce-a27e-ec03cf1eecce tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11a774e4-33cf-4f8c-b408-a851adfb2e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:52:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b70cfa9f-9a41-4fce-a27e-ec03cf1eecce tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11a774e4-33cf-4f8c-b408-a851adfb2e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:52:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b70cfa9f-9a41-4fce-a27e-ec03cf1eecce tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6af6e92b-58ab-457b-9555-2e932ab25720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:52:14 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-b70cfa9f-9a41-4fce-a27e-ec03cf1eecce tempest-CreateVolumesFromSnapshotTest-1179291947 None] Volume 9102b518-793f-416d-a206-f454b41f96f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9102b518-793f-416d-a206-f454b41f96f0', 'volume_size': 1} Sep 08 06:52:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b70cfa9f-9a41-4fce-a27e-ec03cf1eecce tempest-CreateVolumesFromSnapshotTest-1179291947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:52:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f510a5c3-a739-483f-8ebe-cb542ccaf850 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1cdd1477-3e56-40bd-8fe0-6ba154aec949 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:52:14 devstack sudo[101725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1cdd1477-3e56-40bd-8fe0-6ba154aec949 Sep 08 06:52:14 devstack sudo[101725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:52:15 devstack sudo[101725]: pam_unix(sudo:session): session closed for user root Sep 08 06:52:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f510a5c3-a739-483f-8ebe-cb542ccaf850 tempest-CreateVolumesFromSnapshotTest-1179291947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1cdd1477-3e56-40bd-8fe0-6ba154aec949" returned: 0 in 0.382s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:52:15 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-f510a5c3-a739-483f-8ebe-cb542ccaf850 tempest-CreateVolumesFromSnapshotTest-1179291947 None] <== create_volume: return (1442ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:52:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-f510a5c3-a739-483f-8ebe-cb542ccaf850 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.447s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:52:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-754dbf35-8b6a-4c02-87e9-d32079e96102 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.767s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:52:15 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-754dbf35-8b6a-4c02-87e9-d32079e96102 tempest-CreateVolumesFromSnapshotTest-1179291947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-524003783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e39bb2a-d433-4d6e-bdb8-e830426649ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a37e205e226f44668d16fcf1e7b8dd1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:52:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:52:14Z,use_quota=True,user_id='2b53c6cbd9754ae38c2e90b0a71a3c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:52:15 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-754dbf35-8b6a-4c02-87e9-d32079e96102 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Creating volume 5e39bb2a-d433-4d6e-bdb8-e830426649ed {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:52:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-754dbf35-8b6a-4c02-87e9-d32079e96102 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:52:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-754dbf35-8b6a-4c02-87e9-d32079e96102 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:52:15 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-754dbf35-8b6a-4c02-87e9-d32079e96102 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:52:15 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-754dbf35-8b6a-4c02-87e9-d32079e96102 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:52:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-754dbf35-8b6a-4c02-87e9-d32079e96102 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:52:15 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-754dbf35-8b6a-4c02-87e9-d32079e96102 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:52:15 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-754dbf35-8b6a-4c02-87e9-d32079e96102 tempest-CreateVolumesFromSnapshotTest-1179291947 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:52:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-754dbf35-8b6a-4c02-87e9-d32079e96102 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5e39bb2a-d433-4d6e-bdb8-e830426649ed 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:52:15 devstack sudo[101740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5e39bb2a-d433-4d6e-bdb8-e830426649ed 1073741824 Sep 08 06:52:15 devstack sudo[101740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:52:15 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-f510a5c3-a739-483f-8ebe-cb542ccaf850 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54331706-9e6d-4bff-b667-594abd076930) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cdd1477-3e56-40bd-8fe0-6ba154aec949', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:52:15 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-f510a5c3-a739-483f-8ebe-cb542ccaf850 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ffa3c62-016f-4aed-968a-780de98d0821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:52:15 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-f510a5c3-a739-483f-8ebe-cb542ccaf850 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Volume volume-1cdd1477-3e56-40bd-8fe0-6ba154aec949 (1cdd1477-3e56-40bd-8fe0-6ba154aec949): created successfully Sep 08 06:52:15 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-f510a5c3-a739-483f-8ebe-cb542ccaf850 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ffa3c62-016f-4aed-968a-780de98d0821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:52:15 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-f510a5c3-a739-483f-8ebe-cb542ccaf850 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Flow 'volume_create_manager' (15ec3905-c55f-4b7a-82b9-df2e6c4f419b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:52:15 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-da2349c9-d76b-4f2b-97cc-faa339d64a34 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:52:15 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-da2349c9-d76b-4f2b-97cc-faa339d64a34 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Flow 'volume_create_manager' (fb24a74d-b5df-4d67-831d-bfd787e82899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:52:15 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-da2349c9-d76b-4f2b-97cc-faa339d64a34 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7be0d803-30d0-4c43-b09e-8a1ffedb80db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:52:15 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-f510a5c3-a739-483f-8ebe-cb542ccaf850 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Created volume successfully. Sep 08 06:52:15 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-da2349c9-d76b-4f2b-97cc-faa339d64a34 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7be0d803-30d0-4c43-b09e-8a1ffedb80db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:52:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1348190119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08a567aa-2655-40b2-a460-0c1a49f2b478,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a37e205e226f44668d16fcf1e7b8dd1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:52:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:52:15Z,use_quota=True,user_id='2b53c6cbd9754ae38c2e90b0a71a3c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:52:15 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-da2349c9-d76b-4f2b-97cc-faa339d64a34 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9be6b78-cc38-4dee-bbbb-bce7c99efa2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:52:15 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-da2349c9-d76b-4f2b-97cc-faa339d64a34 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9be6b78-cc38-4dee-bbbb-bce7c99efa2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:52:15 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-da2349c9-d76b-4f2b-97cc-faa339d64a34 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99971aac-863c-450e-a261-7d4b4b95db4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:52:15 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-da2349c9-d76b-4f2b-97cc-faa339d64a34 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99971aac-863c-450e-a261-7d4b4b95db4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08a567aa-2655-40b2-a460-0c1a49f2b478', 'volume_name': 'volume-08a567aa-2655-40b2-a460-0c1a49f2b478', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:52:15 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-da2349c9-d76b-4f2b-97cc-faa339d64a34 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5107ad7-998c-4e52-afa9-c89aed3dcc4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:52:15 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-da2349c9-d76b-4f2b-97cc-faa339d64a34 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5107ad7-998c-4e52-afa9-c89aed3dcc4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:52:15 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-da2349c9-d76b-4f2b-97cc-faa339d64a34 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eee80ee-077e-42e0-bfec-433f5470ce13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:52:15 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-da2349c9-d76b-4f2b-97cc-faa339d64a34 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Volume 08a567aa-2655-40b2-a460-0c1a49f2b478: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08a567aa-2655-40b2-a460-0c1a49f2b478', 'volume_size': 1} Sep 08 06:52:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-da2349c9-d76b-4f2b-97cc-faa339d64a34 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:52:16 devstack sudo[101740]: pam_unix(sudo:session): session closed for user root Sep 08 06:52:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-754dbf35-8b6a-4c02-87e9-d32079e96102 tempest-CreateVolumesFromSnapshotTest-1179291947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5e39bb2a-d433-4d6e-bdb8-e830426649ed 1073741824" returned: 0 in 0.778s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:52:16 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-0582dd46-923e-4ea0-99e7-54e8f35c5015 tempest-VolumesTransfersV355Test-1639754844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:52:16 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0582dd46-923e-4ea0-99e7-54e8f35c5015 tempest-VolumesTransfersV355Test-1639754844 None] Flow 'volume_create_manager' (82e73bbb-a9f4-4820-822b-3b3ccaa23a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:52:16 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0582dd46-923e-4ea0-99e7-54e8f35c5015 tempest-VolumesTransfersV355Test-1639754844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6057bc2d-1399-45f4-a19f-0a9857fa1fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:52:16 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0582dd46-923e-4ea0-99e7-54e8f35c5015 tempest-VolumesTransfersV355Test-1639754844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6057bc2d-1399-45f4-a19f-0a9857fa1fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:52:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-384484374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bc9a5ae-7021-4a6e-a732-36fd5ee7f596,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f929b2902a374001acddc9da4cc4453a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:52:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:52:16Z,use_quota=True,user_id='f37f4a3abcfc4aeeaf9cbd0c079cd7b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:52:16 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0582dd46-923e-4ea0-99e7-54e8f35c5015 tempest-VolumesTransfersV355Test-1639754844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e443a8e7-ebf7-44ba-ba7a-c21cb117a844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:52:16 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0582dd46-923e-4ea0-99e7-54e8f35c5015 tempest-VolumesTransfersV355Test-1639754844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e443a8e7-ebf7-44ba-ba7a-c21cb117a844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:52:16 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0582dd46-923e-4ea0-99e7-54e8f35c5015 tempest-VolumesTransfersV355Test-1639754844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (002129b0-5d76-413e-aed6-0901b691bd26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:52:16 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0582dd46-923e-4ea0-99e7-54e8f35c5015 tempest-VolumesTransfersV355Test-1639754844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (002129b0-5d76-413e-aed6-0901b691bd26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bc9a5ae-7021-4a6e-a732-36fd5ee7f596', 'volume_name': 'volume-8bc9a5ae-7021-4a6e-a732-36fd5ee7f596', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:52:16 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0582dd46-923e-4ea0-99e7-54e8f35c5015 tempest-VolumesTransfersV355Test-1639754844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78c980e4-4faf-4b72-911b-5c03990930b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:52:16 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0582dd46-923e-4ea0-99e7-54e8f35c5015 tempest-VolumesTransfersV355Test-1639754844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78c980e4-4faf-4b72-911b-5c03990930b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:52:16 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0582dd46-923e-4ea0-99e7-54e8f35c5015 tempest-VolumesTransfersV355Test-1639754844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddd168ef-d5dd-49e7-9cd3-44d484f5a69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:52:16 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-0582dd46-923e-4ea0-99e7-54e8f35c5015 tempest-VolumesTransfersV355Test-1639754844 None] Volume 8bc9a5ae-7021-4a6e-a732-36fd5ee7f596: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bc9a5ae-7021-4a6e-a732-36fd5ee7f596', 'volume_size': 1} Sep 08 06:52:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-0582dd46-923e-4ea0-99e7-54e8f35c5015 tempest-VolumesTransfersV355Test-1639754844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:52:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-754dbf35-8b6a-4c02-87e9-d32079e96102 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5e39bb2a-d433-4d6e-bdb8-e830426649ed {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:52:16 devstack sudo[101778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5e39bb2a-d433-4d6e-bdb8-e830426649ed Sep 08 06:52:16 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-209f51cf-48c0-414a-bc1c-2e059bbf08be tempest-CreateVolumesFromSnapshotTest-1179291947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:52:16 devstack sudo[101778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:52:16 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-209f51cf-48c0-414a-bc1c-2e059bbf08be tempest-CreateVolumesFromSnapshotTest-1179291947 None] Flow 'volume_create_manager' (91b94526-7bf7-44f5-b179-db15ce725766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:52:16 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-209f51cf-48c0-414a-bc1c-2e059bbf08be tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06086f78-37a5-46fe-900a-2db80000cc89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:52:16 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-209f51cf-48c0-414a-bc1c-2e059bbf08be tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06086f78-37a5-46fe-900a-2db80000cc89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:52:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1757172465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1b1aba8-48b5-4222-a811-677fa880d88f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a37e205e226f44668d16fcf1e7b8dd1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:52:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:52:16Z,use_quota=True,user_id='2b53c6cbd9754ae38c2e90b0a71a3c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:52:16 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-209f51cf-48c0-414a-bc1c-2e059bbf08be tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a62703b3-2269-400e-bb23-a446e5d4658b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:52:16 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-209f51cf-48c0-414a-bc1c-2e059bbf08be tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a62703b3-2269-400e-bb23-a446e5d4658b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:52:16 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-209f51cf-48c0-414a-bc1c-2e059bbf08be tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b71ba5f7-5027-4fb9-a984-9e25b5daa000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:52:16 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-209f51cf-48c0-414a-bc1c-2e059bbf08be tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b71ba5f7-5027-4fb9-a984-9e25b5daa000) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1b1aba8-48b5-4222-a811-677fa880d88f', 'volume_name': 'volume-d1b1aba8-48b5-4222-a811-677fa880d88f', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:52:16 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-209f51cf-48c0-414a-bc1c-2e059bbf08be tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90d37943-3718-41d8-a145-65498312a551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:52:16 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-209f51cf-48c0-414a-bc1c-2e059bbf08be tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90d37943-3718-41d8-a145-65498312a551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:52:16 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-209f51cf-48c0-414a-bc1c-2e059bbf08be tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e11349a4-cbe6-4f12-ad6d-ad2b1e2b0ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:52:16 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-209f51cf-48c0-414a-bc1c-2e059bbf08be tempest-CreateVolumesFromSnapshotTest-1179291947 None] Volume d1b1aba8-48b5-4222-a811-677fa880d88f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1b1aba8-48b5-4222-a811-677fa880d88f', 'volume_size': 1} Sep 08 06:52:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-209f51cf-48c0-414a-bc1c-2e059bbf08be tempest-CreateVolumesFromSnapshotTest-1179291947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:52:16 devstack sudo[101778]: pam_unix(sudo:session): session closed for user root Sep 08 06:52:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-754dbf35-8b6a-4c02-87e9-d32079e96102 tempest-CreateVolumesFromSnapshotTest-1179291947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5e39bb2a-d433-4d6e-bdb8-e830426649ed" returned: 0 in 0.257s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:52:16 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-754dbf35-8b6a-4c02-87e9-d32079e96102 tempest-CreateVolumesFromSnapshotTest-1179291947 None] <== create_volume: return (1225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:52:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-754dbf35-8b6a-4c02-87e9-d32079e96102 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.232s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:52:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b70cfa9f-9a41-4fce-a27e-ec03cf1eecce tempest-CreateVolumesFromSnapshotTest-1179291947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.661s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:52:16 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-b70cfa9f-9a41-4fce-a27e-ec03cf1eecce tempest-CreateVolumesFromSnapshotTest-1179291947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1629509384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9102b518-793f-416d-a206-f454b41f96f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a37e205e226f44668d16fcf1e7b8dd1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:52:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:52:15Z,use_quota=True,user_id='2b53c6cbd9754ae38c2e90b0a71a3c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:52:16 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-b70cfa9f-9a41-4fce-a27e-ec03cf1eecce tempest-CreateVolumesFromSnapshotTest-1179291947 None] Creating volume 9102b518-793f-416d-a206-f454b41f96f0 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:52:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b70cfa9f-9a41-4fce-a27e-ec03cf1eecce tempest-CreateVolumesFromSnapshotTest-1179291947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:52:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b70cfa9f-9a41-4fce-a27e-ec03cf1eecce tempest-CreateVolumesFromSnapshotTest-1179291947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:52:16 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-b70cfa9f-9a41-4fce-a27e-ec03cf1eecce tempest-CreateVolumesFromSnapshotTest-1179291947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:52:16 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-b70cfa9f-9a41-4fce-a27e-ec03cf1eecce tempest-CreateVolumesFromSnapshotTest-1179291947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:52:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b70cfa9f-9a41-4fce-a27e-ec03cf1eecce tempest-CreateVolumesFromSnapshotTest-1179291947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:52:16 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-b70cfa9f-9a41-4fce-a27e-ec03cf1eecce tempest-CreateVolumesFromSnapshotTest-1179291947 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:52:16 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-b70cfa9f-9a41-4fce-a27e-ec03cf1eecce tempest-CreateVolumesFromSnapshotTest-1179291947 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:52:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b70cfa9f-9a41-4fce-a27e-ec03cf1eecce tempest-CreateVolumesFromSnapshotTest-1179291947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9102b518-793f-416d-a206-f454b41f96f0 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:52:16 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-754dbf35-8b6a-4c02-87e9-d32079e96102 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24d6a96a-d892-4d31-9b8d-ee468578f2a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e39bb2a-d433-4d6e-bdb8-e830426649ed', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:52:16 devstack sudo[101787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9102b518-793f-416d-a206-f454b41f96f0 1073741824 Sep 08 06:52:16 devstack sudo[101787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:52:16 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-754dbf35-8b6a-4c02-87e9-d32079e96102 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (749d5b90-00c8-492a-99a2-ae29c4f83823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:52:16 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-754dbf35-8b6a-4c02-87e9-d32079e96102 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Volume volume-5e39bb2a-d433-4d6e-bdb8-e830426649ed (5e39bb2a-d433-4d6e-bdb8-e830426649ed): created successfully Sep 08 06:52:16 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-754dbf35-8b6a-4c02-87e9-d32079e96102 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (749d5b90-00c8-492a-99a2-ae29c4f83823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:52:16 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-754dbf35-8b6a-4c02-87e9-d32079e96102 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Flow 'volume_create_manager' (038e7fb2-78de-4f40-b35d-c6a5c4df0bfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:52:16 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-754dbf35-8b6a-4c02-87e9-d32079e96102 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Created volume successfully. Sep 08 06:52:17 devstack sudo[101787]: pam_unix(sudo:session): session closed for user root Sep 08 06:52:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b70cfa9f-9a41-4fce-a27e-ec03cf1eecce tempest-CreateVolumesFromSnapshotTest-1179291947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9102b518-793f-416d-a206-f454b41f96f0 1073741824" returned: 0 in 0.489s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:52:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b70cfa9f-9a41-4fce-a27e-ec03cf1eecce tempest-CreateVolumesFromSnapshotTest-1179291947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9102b518-793f-416d-a206-f454b41f96f0 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:52:17 devstack sudo[101811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9102b518-793f-416d-a206-f454b41f96f0 Sep 08 06:52:17 devstack sudo[101811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:52:17 devstack sudo[101811]: pam_unix(sudo:session): session closed for user root Sep 08 06:52:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b70cfa9f-9a41-4fce-a27e-ec03cf1eecce tempest-CreateVolumesFromSnapshotTest-1179291947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9102b518-793f-416d-a206-f454b41f96f0" returned: 0 in 0.454s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:52:17 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-b70cfa9f-9a41-4fce-a27e-ec03cf1eecce tempest-CreateVolumesFromSnapshotTest-1179291947 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:52:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b70cfa9f-9a41-4fce-a27e-ec03cf1eecce tempest-CreateVolumesFromSnapshotTest-1179291947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:52:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-da2349c9-d76b-4f2b-97cc-faa339d64a34 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.891s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:52:17 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-da2349c9-d76b-4f2b-97cc-faa339d64a34 tempest-CreateVolumesFromSnapshotTest-1179291947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:52:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1348190119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08a567aa-2655-40b2-a460-0c1a49f2b478,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a37e205e226f44668d16fcf1e7b8dd1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:52:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:52:15Z,use_quota=True,user_id='2b53c6cbd9754ae38c2e90b0a71a3c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:52:17 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-da2349c9-d76b-4f2b-97cc-faa339d64a34 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Creating volume 08a567aa-2655-40b2-a460-0c1a49f2b478 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:52:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-da2349c9-d76b-4f2b-97cc-faa339d64a34 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:52:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-da2349c9-d76b-4f2b-97cc-faa339d64a34 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:52:17 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-da2349c9-d76b-4f2b-97cc-faa339d64a34 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:52:17 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-da2349c9-d76b-4f2b-97cc-faa339d64a34 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:52:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-da2349c9-d76b-4f2b-97cc-faa339d64a34 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:52:17 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-da2349c9-d76b-4f2b-97cc-faa339d64a34 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:52:17 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-da2349c9-d76b-4f2b-97cc-faa339d64a34 tempest-CreateVolumesFromSnapshotTest-1179291947 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:52:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-da2349c9-d76b-4f2b-97cc-faa339d64a34 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-08a567aa-2655-40b2-a460-0c1a49f2b478 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:52:17 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b70cfa9f-9a41-4fce-a27e-ec03cf1eecce tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6af6e92b-58ab-457b-9555-2e932ab25720) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9102b518-793f-416d-a206-f454b41f96f0', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:52:17 devstack sudo[101866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-08a567aa-2655-40b2-a460-0c1a49f2b478 1073741824 Sep 08 06:52:17 devstack sudo[101866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:52:17 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b70cfa9f-9a41-4fce-a27e-ec03cf1eecce tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a277d785-7893-44ee-b2ad-15f3c045e225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:52:17 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-b70cfa9f-9a41-4fce-a27e-ec03cf1eecce tempest-CreateVolumesFromSnapshotTest-1179291947 None] Volume volume-9102b518-793f-416d-a206-f454b41f96f0 (9102b518-793f-416d-a206-f454b41f96f0): created successfully Sep 08 06:52:17 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b70cfa9f-9a41-4fce-a27e-ec03cf1eecce tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a277d785-7893-44ee-b2ad-15f3c045e225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:52:17 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b70cfa9f-9a41-4fce-a27e-ec03cf1eecce tempest-CreateVolumesFromSnapshotTest-1179291947 None] Flow 'volume_create_manager' (babacf58-e670-4923-94e0-34d67b3836cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:52:17 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-b70cfa9f-9a41-4fce-a27e-ec03cf1eecce tempest-CreateVolumesFromSnapshotTest-1179291947 None] Created volume successfully. Sep 08 06:52:18 devstack sudo[101866]: pam_unix(sudo:session): session closed for user root Sep 08 06:52:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-da2349c9-d76b-4f2b-97cc-faa339d64a34 tempest-CreateVolumesFromSnapshotTest-1179291947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-08a567aa-2655-40b2-a460-0c1a49f2b478 1073741824" returned: 0 in 0.903s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:52:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-da2349c9-d76b-4f2b-97cc-faa339d64a34 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-08a567aa-2655-40b2-a460-0c1a49f2b478 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:52:18 devstack sudo[101926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-08a567aa-2655-40b2-a460-0c1a49f2b478 Sep 08 06:52:18 devstack sudo[101926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:52:18 devstack sudo[101926]: pam_unix(sudo:session): session closed for user root Sep 08 06:52:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-da2349c9-d76b-4f2b-97cc-faa339d64a34 tempest-CreateVolumesFromSnapshotTest-1179291947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-08a567aa-2655-40b2-a460-0c1a49f2b478" returned: 0 in 0.257s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:52:18 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-da2349c9-d76b-4f2b-97cc-faa339d64a34 tempest-CreateVolumesFromSnapshotTest-1179291947 None] <== create_volume: return (1226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:52:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-da2349c9-d76b-4f2b-97cc-faa339d64a34 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.229s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:52:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-0582dd46-923e-4ea0-99e7-54e8f35c5015 tempest-VolumesTransfersV355Test-1639754844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.525s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:52:18 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-0582dd46-923e-4ea0-99e7-54e8f35c5015 tempest-VolumesTransfersV355Test-1639754844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:52:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-384484374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bc9a5ae-7021-4a6e-a732-36fd5ee7f596,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f929b2902a374001acddc9da4cc4453a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:52:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:52:16Z,use_quota=True,user_id='f37f4a3abcfc4aeeaf9cbd0c079cd7b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:52:18 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-0582dd46-923e-4ea0-99e7-54e8f35c5015 tempest-VolumesTransfersV355Test-1639754844 None] Creating volume 8bc9a5ae-7021-4a6e-a732-36fd5ee7f596 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:52:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-0582dd46-923e-4ea0-99e7-54e8f35c5015 tempest-VolumesTransfersV355Test-1639754844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:52:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-0582dd46-923e-4ea0-99e7-54e8f35c5015 tempest-VolumesTransfersV355Test-1639754844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:52:18 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-0582dd46-923e-4ea0-99e7-54e8f35c5015 tempest-VolumesTransfersV355Test-1639754844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:52:18 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-0582dd46-923e-4ea0-99e7-54e8f35c5015 tempest-VolumesTransfersV355Test-1639754844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:52:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-0582dd46-923e-4ea0-99e7-54e8f35c5015 tempest-VolumesTransfersV355Test-1639754844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:52:18 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-0582dd46-923e-4ea0-99e7-54e8f35c5015 tempest-VolumesTransfersV355Test-1639754844 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:52:18 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-0582dd46-923e-4ea0-99e7-54e8f35c5015 tempest-VolumesTransfersV355Test-1639754844 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:52:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0582dd46-923e-4ea0-99e7-54e8f35c5015 tempest-VolumesTransfersV355Test-1639754844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8bc9a5ae-7021-4a6e-a732-36fd5ee7f596 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:52:18 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-da2349c9-d76b-4f2b-97cc-faa339d64a34 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eee80ee-077e-42e0-bfec-433f5470ce13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08a567aa-2655-40b2-a460-0c1a49f2b478', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:52:18 devstack sudo[101942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8bc9a5ae-7021-4a6e-a732-36fd5ee7f596 1073741824 Sep 08 06:52:18 devstack sudo[101942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:52:18 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-da2349c9-d76b-4f2b-97cc-faa339d64a34 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ae53980-73ea-46eb-934d-ac9287276a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:52:18 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-da2349c9-d76b-4f2b-97cc-faa339d64a34 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Volume volume-08a567aa-2655-40b2-a460-0c1a49f2b478 (08a567aa-2655-40b2-a460-0c1a49f2b478): created successfully Sep 08 06:52:18 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-da2349c9-d76b-4f2b-97cc-faa339d64a34 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ae53980-73ea-46eb-934d-ac9287276a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:52:18 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-da2349c9-d76b-4f2b-97cc-faa339d64a34 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Flow 'volume_create_manager' (fb24a74d-b5df-4d67-831d-bfd787e82899) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:52:18 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-da2349c9-d76b-4f2b-97cc-faa339d64a34 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Created volume successfully. Sep 08 06:52:19 devstack sudo[101942]: pam_unix(sudo:session): session closed for user root Sep 08 06:52:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0582dd46-923e-4ea0-99e7-54e8f35c5015 tempest-VolumesTransfersV355Test-1639754844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8bc9a5ae-7021-4a6e-a732-36fd5ee7f596 1073741824" returned: 0 in 0.536s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:52:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0582dd46-923e-4ea0-99e7-54e8f35c5015 tempest-VolumesTransfersV355Test-1639754844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8bc9a5ae-7021-4a6e-a732-36fd5ee7f596 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:52:19 devstack sudo[101964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8bc9a5ae-7021-4a6e-a732-36fd5ee7f596 Sep 08 06:52:19 devstack sudo[101964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:52:19 devstack sudo[101964]: pam_unix(sudo:session): session closed for user root Sep 08 06:52:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0582dd46-923e-4ea0-99e7-54e8f35c5015 tempest-VolumesTransfersV355Test-1639754844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8bc9a5ae-7021-4a6e-a732-36fd5ee7f596" returned: 0 in 0.287s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:52:19 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-0582dd46-923e-4ea0-99e7-54e8f35c5015 tempest-VolumesTransfersV355Test-1639754844 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:52:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-0582dd46-923e-4ea0-99e7-54e8f35c5015 tempest-VolumesTransfersV355Test-1639754844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:52:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-209f51cf-48c0-414a-bc1c-2e059bbf08be tempest-CreateVolumesFromSnapshotTest-1179291947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.300s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:52:19 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-209f51cf-48c0-414a-bc1c-2e059bbf08be tempest-CreateVolumesFromSnapshotTest-1179291947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:52:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1757172465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1b1aba8-48b5-4222-a811-677fa880d88f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a37e205e226f44668d16fcf1e7b8dd1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:52:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:52:16Z,use_quota=True,user_id='2b53c6cbd9754ae38c2e90b0a71a3c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:52:19 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-209f51cf-48c0-414a-bc1c-2e059bbf08be tempest-CreateVolumesFromSnapshotTest-1179291947 None] Creating volume d1b1aba8-48b5-4222-a811-677fa880d88f {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:52:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-209f51cf-48c0-414a-bc1c-2e059bbf08be tempest-CreateVolumesFromSnapshotTest-1179291947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:52:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-209f51cf-48c0-414a-bc1c-2e059bbf08be tempest-CreateVolumesFromSnapshotTest-1179291947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:52:19 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-209f51cf-48c0-414a-bc1c-2e059bbf08be tempest-CreateVolumesFromSnapshotTest-1179291947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:52:19 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-209f51cf-48c0-414a-bc1c-2e059bbf08be tempest-CreateVolumesFromSnapshotTest-1179291947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:52:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-209f51cf-48c0-414a-bc1c-2e059bbf08be tempest-CreateVolumesFromSnapshotTest-1179291947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:52:19 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-209f51cf-48c0-414a-bc1c-2e059bbf08be tempest-CreateVolumesFromSnapshotTest-1179291947 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:52:19 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-209f51cf-48c0-414a-bc1c-2e059bbf08be tempest-CreateVolumesFromSnapshotTest-1179291947 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:52:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-209f51cf-48c0-414a-bc1c-2e059bbf08be tempest-CreateVolumesFromSnapshotTest-1179291947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d1b1aba8-48b5-4222-a811-677fa880d88f 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:52:19 devstack sudo[101976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d1b1aba8-48b5-4222-a811-677fa880d88f 1073741824 Sep 08 06:52:19 devstack sudo[101976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:52:19 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0582dd46-923e-4ea0-99e7-54e8f35c5015 tempest-VolumesTransfersV355Test-1639754844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddd168ef-d5dd-49e7-9cd3-44d484f5a69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bc9a5ae-7021-4a6e-a732-36fd5ee7f596', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:52:19 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0582dd46-923e-4ea0-99e7-54e8f35c5015 tempest-VolumesTransfersV355Test-1639754844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24ee0eef-abee-491b-b6ac-8a957814ef21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:52:19 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-0582dd46-923e-4ea0-99e7-54e8f35c5015 tempest-VolumesTransfersV355Test-1639754844 None] Volume volume-8bc9a5ae-7021-4a6e-a732-36fd5ee7f596 (8bc9a5ae-7021-4a6e-a732-36fd5ee7f596): created successfully Sep 08 06:52:19 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0582dd46-923e-4ea0-99e7-54e8f35c5015 tempest-VolumesTransfersV355Test-1639754844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24ee0eef-abee-491b-b6ac-8a957814ef21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:52:19 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0582dd46-923e-4ea0-99e7-54e8f35c5015 tempest-VolumesTransfersV355Test-1639754844 None] Flow 'volume_create_manager' (82e73bbb-a9f4-4820-822b-3b3ccaa23a6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:52:19 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-0582dd46-923e-4ea0-99e7-54e8f35c5015 tempest-VolumesTransfersV355Test-1639754844 None] Created volume successfully. Sep 08 06:52:20 devstack cinder-volume[87507]: DEBUG oslo_service.periodic_task [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87507) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 06:52:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:52:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:52:20 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:52:20 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:52:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:52:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:52:20 devstack sudo[102006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:52:20 devstack sudo[102006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:52:20 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-97cb7598-c60f-445a-aef1-9aa248edcb0c tempest-VolumesActionsTest-1238384040 None] Acquiring lock "cinder-aa8a4571-b304-4037-8887-07da22bc357b" by "attach_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:52:20 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-97cb7598-c60f-445a-aef1-9aa248edcb0c tempest-VolumesActionsTest-1238384040 None] Lock "cinder-aa8a4571-b304-4037-8887-07da22bc357b" acquired by "attach_volume" :: waited 0.034s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:52:20 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-97cb7598-c60f-445a-aef1-9aa248edcb0c tempest-VolumesActionsTest-1238384040 None] Attaching volume aa8a4571-b304-4037-8887-07da22bc357b to instance 775d00c9-2fba-4de0-9ad4-5f19e8bdfe60 at mountpoint /dev/vdb on host None. Sep 08 06:52:20 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-97cb7598-c60f-445a-aef1-9aa248edcb0c tempest-VolumesActionsTest-1238384040 None] Attach volume completed successfully. Sep 08 06:52:20 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-97cb7598-c60f-445a-aef1-9aa248edcb0c tempest-VolumesActionsTest-1238384040 None] Lock "cinder-aa8a4571-b304-4037-8887-07da22bc357b" released by "attach_volume" :: held 0.205s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:52:20 devstack sudo[102006]: pam_unix(sudo:session): session closed for user root Sep 08 06:52:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.519s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:52:20 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:52:20 devstack cinder-volume[87507]: DEBUG oslo_service.periodic_task [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Running periodic task VolumeManager._thread_info {{(pid=87507) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 06:52:20 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] thread count: 29 {{(pid=87507) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 06:52:20 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] thread info: [<_MainThread(MainThread, started 127913129345152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87507) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 06:52:20 devstack sudo[101976]: pam_unix(sudo:session): session closed for user root Sep 08 06:52:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-209f51cf-48c0-414a-bc1c-2e059bbf08be tempest-CreateVolumesFromSnapshotTest-1179291947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d1b1aba8-48b5-4222-a811-677fa880d88f 1073741824" returned: 0 in 0.958s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:52:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-209f51cf-48c0-414a-bc1c-2e059bbf08be tempest-CreateVolumesFromSnapshotTest-1179291947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d1b1aba8-48b5-4222-a811-677fa880d88f {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:52:20 devstack sudo[102051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d1b1aba8-48b5-4222-a811-677fa880d88f Sep 08 06:52:20 devstack sudo[102051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:52:21 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-69d875a6-13bc-470f-b6ea-928e0d3706b4 tempest-VolumesActionsTest-1238384040 None] Acquiring lock "cinder-aa8a4571-b304-4037-8887-07da22bc357b-detach_volume" by "detach_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:52:21 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-69d875a6-13bc-470f-b6ea-928e0d3706b4 tempest-VolumesActionsTest-1238384040 None] Lock "cinder-aa8a4571-b304-4037-8887-07da22bc357b-detach_volume" acquired by "detach_volume" :: waited 0.042s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:52:21 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-69d875a6-13bc-470f-b6ea-928e0d3706b4 tempest-VolumesActionsTest-1238384040 None] Detaching volume aa8a4571-b304-4037-8887-07da22bc357b from instance 775d00c9-2fba-4de0-9ad4-5f19e8bdfe60. Sep 08 06:52:21 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-69d875a6-13bc-470f-b6ea-928e0d3706b4 tempest-VolumesActionsTest-1238384040 None] Detach volume completed successfully. Sep 08 06:52:21 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-69d875a6-13bc-470f-b6ea-928e0d3706b4 tempest-VolumesActionsTest-1238384040 None] Lock "cinder-aa8a4571-b304-4037-8887-07da22bc357b-detach_volume" released by "detach_volume" :: held 0.121s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:52:21 devstack sudo[102051]: pam_unix(sudo:session): session closed for user root Sep 08 06:52:21 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-209f51cf-48c0-414a-bc1c-2e059bbf08be tempest-CreateVolumesFromSnapshotTest-1179291947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d1b1aba8-48b5-4222-a811-677fa880d88f" returned: 0 in 0.626s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:52:21 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-209f51cf-48c0-414a-bc1c-2e059bbf08be tempest-CreateVolumesFromSnapshotTest-1179291947 None] <== create_volume: return (1671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:52:21 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-209f51cf-48c0-414a-bc1c-2e059bbf08be tempest-CreateVolumesFromSnapshotTest-1179291947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.675s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:52:21 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-209f51cf-48c0-414a-bc1c-2e059bbf08be tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e11349a4-cbe6-4f12-ad6d-ad2b1e2b0ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1b1aba8-48b5-4222-a811-677fa880d88f', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:52:21 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-209f51cf-48c0-414a-bc1c-2e059bbf08be tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (583a74e6-5a9a-4469-b1c4-8763ae8d0e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:52:21 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-2ce437cd-f7de-489e-a1b9-3d4879169f5e tempest-VolumesTransfersV355Test-1238747135 None] Transfer volume completed successfully. Sep 08 06:52:21 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-209f51cf-48c0-414a-bc1c-2e059bbf08be tempest-CreateVolumesFromSnapshotTest-1179291947 None] Volume volume-d1b1aba8-48b5-4222-a811-677fa880d88f (d1b1aba8-48b5-4222-a811-677fa880d88f): created successfully Sep 08 06:52:21 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-209f51cf-48c0-414a-bc1c-2e059bbf08be tempest-CreateVolumesFromSnapshotTest-1179291947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (583a74e6-5a9a-4469-b1c4-8763ae8d0e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:52:21 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-209f51cf-48c0-414a-bc1c-2e059bbf08be tempest-CreateVolumesFromSnapshotTest-1179291947 None] Flow 'volume_create_manager' (91b94526-7bf7-44f5-b179-db15ce725766) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:52:21 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-209f51cf-48c0-414a-bc1c-2e059bbf08be tempest-CreateVolumesFromSnapshotTest-1179291947 None] Created volume successfully. Sep 08 06:52:21 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-a767ff33-f3fc-46ac-b815-5331f9289f35 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Acquiring lock "cinder-d1b1aba8-48b5-4222-a811-677fa880d88f-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:52:21 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-a767ff33-f3fc-46ac-b815-5331f9289f35 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Lock "cinder-d1b1aba8-48b5-4222-a811-677fa880d88f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:52:22 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-a767ff33-f3fc-46ac-b815-5331f9289f35 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Acquiring lock "cinder-quobyte-d1b1aba8-48b5-4222-a811-677fa880d88f" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:52:22 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-a767ff33-f3fc-46ac-b815-5331f9289f35 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Lock "cinder-quobyte-d1b1aba8-48b5-4222-a811-677fa880d88f" acquired by "delete_volume" :: waited 0.022s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:52:22 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[85bb2679-d4c5-4d4b-8f66-0e7b0fda3a9c]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:52:22 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a767ff33-f3fc-46ac-b815-5331f9289f35 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d1b1aba8-48b5-4222-a811-677fa880d88f {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:52:22 devstack sudo[102100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d1b1aba8-48b5-4222-a811-677fa880d88f Sep 08 06:52:22 devstack sudo[102100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:52:22 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-97226eee-c15e-4cc7-bb9d-a18774321fd6 tempest-VolumesTransfersV355Test-1807218516 None] Acquiring lock "cinder-8bc9a5ae-7021-4a6e-a732-36fd5ee7f596-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:52:22 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-97226eee-c15e-4cc7-bb9d-a18774321fd6 tempest-VolumesTransfersV355Test-1807218516 None] Lock "cinder-8bc9a5ae-7021-4a6e-a732-36fd5ee7f596-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:52:22 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-97226eee-c15e-4cc7-bb9d-a18774321fd6 tempest-VolumesTransfersV355Test-1807218516 None] Acquiring lock "cinder-quobyte-8bc9a5ae-7021-4a6e-a732-36fd5ee7f596" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:52:22 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-97226eee-c15e-4cc7-bb9d-a18774321fd6 tempest-VolumesTransfersV355Test-1807218516 None] Lock "cinder-quobyte-8bc9a5ae-7021-4a6e-a732-36fd5ee7f596" acquired by "delete_volume" :: waited 0.022s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:52:22 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[caae1d45-35d5-4331-b08a-01764cb866bf]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:52:22 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-97226eee-c15e-4cc7-bb9d-a18774321fd6 tempest-VolumesTransfersV355Test-1807218516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8bc9a5ae-7021-4a6e-a732-36fd5ee7f596 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:52:22 devstack sudo[102100]: pam_unix(sudo:session): session closed for user root Sep 08 06:52:22 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a767ff33-f3fc-46ac-b815-5331f9289f35 tempest-CreateVolumesFromSnapshotTest-1179291947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d1b1aba8-48b5-4222-a811-677fa880d88f" returned: 0 in 0.579s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:52:22 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a767ff33-f3fc-46ac-b815-5331f9289f35 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d1b1aba8-48b5-4222-a811-677fa880d88f {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:52:22 devstack sudo[102126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8bc9a5ae-7021-4a6e-a732-36fd5ee7f596 Sep 08 06:52:22 devstack sudo[102126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:52:22 devstack sudo[102132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d1b1aba8-48b5-4222-a811-677fa880d88f Sep 08 06:52:22 devstack sudo[102132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:52:22 devstack sudo[102132]: pam_unix(sudo:session): session closed for user root Sep 08 06:52:22 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a767ff33-f3fc-46ac-b815-5331f9289f35 tempest-CreateVolumesFromSnapshotTest-1179291947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d1b1aba8-48b5-4222-a811-677fa880d88f" returned: 0 in 0.300s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:52:22 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-a767ff33-f3fc-46ac-b815-5331f9289f35 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Lock "cinder-quobyte-d1b1aba8-48b5-4222-a811-677fa880d88f" released by "delete_volume" :: held 0.923s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:52:23 devstack sudo[102126]: pam_unix(sudo:session): session closed for user root Sep 08 06:52:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-97226eee-c15e-4cc7-bb9d-a18774321fd6 tempest-VolumesTransfersV355Test-1807218516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8bc9a5ae-7021-4a6e-a732-36fd5ee7f596" returned: 0 in 0.458s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:52:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-97226eee-c15e-4cc7-bb9d-a18774321fd6 tempest-VolumesTransfersV355Test-1807218516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8bc9a5ae-7021-4a6e-a732-36fd5ee7f596 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:52:23 devstack sudo[102151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8bc9a5ae-7021-4a6e-a732-36fd5ee7f596 Sep 08 06:52:23 devstack sudo[102151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:52:23 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-a767ff33-f3fc-46ac-b815-5331f9289f35 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Created reservations ['d9ff7463-3737-4c75-b730-9b046d54b620', 'bd986ec2-2399-4552-8ec7-e429bc9ce357', '19735b8d-e8d6-44ce-b983-584fcf1c3f4d', 'acc59d56-7e31-48fd-aa07-9df3de6ef297'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:52:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a767ff33-f3fc-46ac-b815-5331f9289f35 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:52:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a767ff33-f3fc-46ac-b815-5331f9289f35 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:52:23 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-a767ff33-f3fc-46ac-b815-5331f9289f35 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:52:23 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-a767ff33-f3fc-46ac-b815-5331f9289f35 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:52:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a767ff33-f3fc-46ac-b815-5331f9289f35 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:52:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a767ff33-f3fc-46ac-b815-5331f9289f35 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:52:23 devstack sudo[102156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:52:23 devstack sudo[102156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:52:23 devstack sudo[102151]: pam_unix(sudo:session): session closed for user root Sep 08 06:52:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-97226eee-c15e-4cc7-bb9d-a18774321fd6 tempest-VolumesTransfersV355Test-1807218516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8bc9a5ae-7021-4a6e-a732-36fd5ee7f596" returned: 0 in 0.344s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:52:23 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-97226eee-c15e-4cc7-bb9d-a18774321fd6 tempest-VolumesTransfersV355Test-1807218516 None] Lock "cinder-quobyte-8bc9a5ae-7021-4a6e-a732-36fd5ee7f596" released by "delete_volume" :: held 0.858s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:52:23 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-97226eee-c15e-4cc7-bb9d-a18774321fd6 tempest-VolumesTransfersV355Test-1807218516 None] Created reservations ['0364cb3c-bed5-47d0-a701-d1d404f16844', 'c6282127-60bc-45fc-9759-b557e7e73b4f', 'd26a5ad0-0a8d-48fb-a3aa-244bf201e70f', '650a851d-be19-48a7-aacf-578bf6552d26'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:52:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-97226eee-c15e-4cc7-bb9d-a18774321fd6 tempest-VolumesTransfersV355Test-1807218516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:52:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-97226eee-c15e-4cc7-bb9d-a18774321fd6 tempest-VolumesTransfersV355Test-1807218516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:52:23 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-97226eee-c15e-4cc7-bb9d-a18774321fd6 tempest-VolumesTransfersV355Test-1807218516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:52:23 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-97226eee-c15e-4cc7-bb9d-a18774321fd6 tempest-VolumesTransfersV355Test-1807218516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:52:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-97226eee-c15e-4cc7-bb9d-a18774321fd6 tempest-VolumesTransfersV355Test-1807218516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:52:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-97226eee-c15e-4cc7-bb9d-a18774321fd6 tempest-VolumesTransfersV355Test-1807218516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:52:23 devstack sudo[102174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:52:23 devstack sudo[102174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:52:23 devstack sudo[102156]: pam_unix(sudo:session): session closed for user root Sep 08 06:52:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a767ff33-f3fc-46ac-b815-5331f9289f35 tempest-CreateVolumesFromSnapshotTest-1179291947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.423s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:52:23 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-a767ff33-f3fc-46ac-b815-5331f9289f35 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:52:23 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-a767ff33-f3fc-46ac-b815-5331f9289f35 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Deleted volume successfully. Sep 08 06:52:23 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-a767ff33-f3fc-46ac-b815-5331f9289f35 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Lock "cinder-d1b1aba8-48b5-4222-a811-677fa880d88f-delete_volume" released by "delete_volume" :: held 1.686s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:52:23 devstack sudo[102174]: pam_unix(sudo:session): session closed for user root Sep 08 06:52:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-97226eee-c15e-4cc7-bb9d-a18774321fd6 tempest-VolumesTransfersV355Test-1807218516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.331s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:52:23 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-97226eee-c15e-4cc7-bb9d-a18774321fd6 tempest-VolumesTransfersV355Test-1807218516 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:52:23 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-97226eee-c15e-4cc7-bb9d-a18774321fd6 tempest-VolumesTransfersV355Test-1807218516 None] Deleted volume successfully. Sep 08 06:52:23 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-97226eee-c15e-4cc7-bb9d-a18774321fd6 tempest-VolumesTransfersV355Test-1807218516 None] Lock "cinder-8bc9a5ae-7021-4a6e-a732-36fd5ee7f596-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:52:24 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-b2358335-ec87-42d2-8413-9372c571e750 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Acquiring lock "cinder-08a567aa-2655-40b2-a460-0c1a49f2b478-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:52:24 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-b2358335-ec87-42d2-8413-9372c571e750 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Lock "cinder-08a567aa-2655-40b2-a460-0c1a49f2b478-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:52:24 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-b2358335-ec87-42d2-8413-9372c571e750 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Acquiring lock "cinder-quobyte-08a567aa-2655-40b2-a460-0c1a49f2b478" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:52:24 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-b2358335-ec87-42d2-8413-9372c571e750 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Lock "cinder-quobyte-08a567aa-2655-40b2-a460-0c1a49f2b478" acquired by "delete_volume" :: waited 0.022s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:52:24 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9810a06a-3c12-47a8-9e62-d6113cf254d0]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:52:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b2358335-ec87-42d2-8413-9372c571e750 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-08a567aa-2655-40b2-a460-0c1a49f2b478 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:52:24 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ab46bc2-84a1-4ce9-b70a-aa52c74e8121 tempest-VolumesTransfersV355Test-1639754844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:52:24 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4ab46bc2-84a1-4ce9-b70a-aa52c74e8121 tempest-VolumesTransfersV355Test-1639754844 None] Flow 'volume_create_manager' (037d63f9-418d-4eda-ad8a-281197a7e62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:52:24 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4ab46bc2-84a1-4ce9-b70a-aa52c74e8121 tempest-VolumesTransfersV355Test-1639754844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9355e245-9807-4206-980c-644d416447d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:52:24 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4ab46bc2-84a1-4ce9-b70a-aa52c74e8121 tempest-VolumesTransfersV355Test-1639754844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9355e245-9807-4206-980c-644d416447d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:52:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1728549629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef80d06f-b5eb-4170-adb1-1a9c2df92f34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f929b2902a374001acddc9da4cc4453a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:52:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:52:24Z,use_quota=True,user_id='f37f4a3abcfc4aeeaf9cbd0c079cd7b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:52:24 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4ab46bc2-84a1-4ce9-b70a-aa52c74e8121 tempest-VolumesTransfersV355Test-1639754844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75f58425-c082-49ab-bf42-2d59dcd05218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:52:24 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4ab46bc2-84a1-4ce9-b70a-aa52c74e8121 tempest-VolumesTransfersV355Test-1639754844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75f58425-c082-49ab-bf42-2d59dcd05218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:52:24 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4ab46bc2-84a1-4ce9-b70a-aa52c74e8121 tempest-VolumesTransfersV355Test-1639754844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c15996e-1f43-4994-b8c1-9c29289f078c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:52:24 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4ab46bc2-84a1-4ce9-b70a-aa52c74e8121 tempest-VolumesTransfersV355Test-1639754844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c15996e-1f43-4994-b8c1-9c29289f078c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef80d06f-b5eb-4170-adb1-1a9c2df92f34', 'volume_name': 'volume-ef80d06f-b5eb-4170-adb1-1a9c2df92f34', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:52:24 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4ab46bc2-84a1-4ce9-b70a-aa52c74e8121 tempest-VolumesTransfersV355Test-1639754844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2003aa2-12be-41cf-b651-7feecac0e288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:52:24 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4ab46bc2-84a1-4ce9-b70a-aa52c74e8121 tempest-VolumesTransfersV355Test-1639754844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2003aa2-12be-41cf-b651-7feecac0e288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:52:24 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4ab46bc2-84a1-4ce9-b70a-aa52c74e8121 tempest-VolumesTransfersV355Test-1639754844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15e61bb4-8df6-40cd-b7b5-a32d9599dcca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:52:24 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-4ab46bc2-84a1-4ce9-b70a-aa52c74e8121 tempest-VolumesTransfersV355Test-1639754844 None] Volume ef80d06f-b5eb-4170-adb1-1a9c2df92f34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef80d06f-b5eb-4170-adb1-1a9c2df92f34', 'volume_size': 1} Sep 08 06:52:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4ab46bc2-84a1-4ce9-b70a-aa52c74e8121 tempest-VolumesTransfersV355Test-1639754844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:52:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4ab46bc2-84a1-4ce9-b70a-aa52c74e8121 tempest-VolumesTransfersV355Test-1639754844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:52:24 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-4ab46bc2-84a1-4ce9-b70a-aa52c74e8121 tempest-VolumesTransfersV355Test-1639754844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:52:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1728549629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef80d06f-b5eb-4170-adb1-1a9c2df92f34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f929b2902a374001acddc9da4cc4453a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:52:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:52:24Z,use_quota=True,user_id='f37f4a3abcfc4aeeaf9cbd0c079cd7b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:52:24 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-4ab46bc2-84a1-4ce9-b70a-aa52c74e8121 tempest-VolumesTransfersV355Test-1639754844 None] Creating volume ef80d06f-b5eb-4170-adb1-1a9c2df92f34 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:52:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4ab46bc2-84a1-4ce9-b70a-aa52c74e8121 tempest-VolumesTransfersV355Test-1639754844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:52:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4ab46bc2-84a1-4ce9-b70a-aa52c74e8121 tempest-VolumesTransfersV355Test-1639754844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:52:24 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-4ab46bc2-84a1-4ce9-b70a-aa52c74e8121 tempest-VolumesTransfersV355Test-1639754844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:52:24 devstack sudo[102201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-08a567aa-2655-40b2-a460-0c1a49f2b478 Sep 08 06:52:24 devstack sudo[102201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:52:24 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-4ab46bc2-84a1-4ce9-b70a-aa52c74e8121 tempest-VolumesTransfersV355Test-1639754844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:52:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4ab46bc2-84a1-4ce9-b70a-aa52c74e8121 tempest-VolumesTransfersV355Test-1639754844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:52:24 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-4ab46bc2-84a1-4ce9-b70a-aa52c74e8121 tempest-VolumesTransfersV355Test-1639754844 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:52:24 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-4ab46bc2-84a1-4ce9-b70a-aa52c74e8121 tempest-VolumesTransfersV355Test-1639754844 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:52:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4ab46bc2-84a1-4ce9-b70a-aa52c74e8121 tempest-VolumesTransfersV355Test-1639754844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ef80d06f-b5eb-4170-adb1-1a9c2df92f34 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:52:24 devstack sudo[102208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ef80d06f-b5eb-4170-adb1-1a9c2df92f34 1073741824 Sep 08 06:52:24 devstack sudo[102208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:52:24 devstack sudo[102201]: pam_unix(sudo:session): session closed for user root Sep 08 06:52:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b2358335-ec87-42d2-8413-9372c571e750 tempest-CreateVolumesFromSnapshotTest-1179291947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-08a567aa-2655-40b2-a460-0c1a49f2b478" returned: 0 in 0.422s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:52:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b2358335-ec87-42d2-8413-9372c571e750 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-08a567aa-2655-40b2-a460-0c1a49f2b478 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:52:24 devstack sudo[102223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-08a567aa-2655-40b2-a460-0c1a49f2b478 Sep 08 06:52:24 devstack sudo[102223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:52:25 devstack sudo[102208]: pam_unix(sudo:session): session closed for user root Sep 08 06:52:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4ab46bc2-84a1-4ce9-b70a-aa52c74e8121 tempest-VolumesTransfersV355Test-1639754844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ef80d06f-b5eb-4170-adb1-1a9c2df92f34 1073741824" returned: 0 in 0.562s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:52:25 devstack sudo[102223]: pam_unix(sudo:session): session closed for user root Sep 08 06:52:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b2358335-ec87-42d2-8413-9372c571e750 tempest-CreateVolumesFromSnapshotTest-1179291947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-08a567aa-2655-40b2-a460-0c1a49f2b478" returned: 0 in 0.306s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:52:25 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-b2358335-ec87-42d2-8413-9372c571e750 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Lock "cinder-quobyte-08a567aa-2655-40b2-a460-0c1a49f2b478" released by "delete_volume" :: held 0.772s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:52:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4ab46bc2-84a1-4ce9-b70a-aa52c74e8121 tempest-VolumesTransfersV355Test-1639754844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ef80d06f-b5eb-4170-adb1-1a9c2df92f34 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:52:25 devstack sudo[102239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ef80d06f-b5eb-4170-adb1-1a9c2df92f34 Sep 08 06:52:25 devstack sudo[102239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:52:25 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-b2358335-ec87-42d2-8413-9372c571e750 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Created reservations ['1342bf24-801f-423e-81d7-af8ef197db91', 'a0677d9c-13db-4d29-9156-2cb252ca3d47', 'cb69c08b-77b6-40b8-8bb5-e54884689bc8', 'acf02fab-3b9f-4e9f-b2ba-9c61a87daaa7'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:52:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b2358335-ec87-42d2-8413-9372c571e750 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:52:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b2358335-ec87-42d2-8413-9372c571e750 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:52:25 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-b2358335-ec87-42d2-8413-9372c571e750 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:52:25 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-b2358335-ec87-42d2-8413-9372c571e750 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:52:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b2358335-ec87-42d2-8413-9372c571e750 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:52:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b2358335-ec87-42d2-8413-9372c571e750 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:52:25 devstack sudo[102244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:52:25 devstack sudo[102244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:52:25 devstack sudo[102239]: pam_unix(sudo:session): session closed for user root Sep 08 06:52:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4ab46bc2-84a1-4ce9-b70a-aa52c74e8121 tempest-VolumesTransfersV355Test-1639754844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ef80d06f-b5eb-4170-adb1-1a9c2df92f34" returned: 0 in 0.299s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:52:25 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-4ab46bc2-84a1-4ce9-b70a-aa52c74e8121 tempest-VolumesTransfersV355Test-1639754844 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:52:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4ab46bc2-84a1-4ce9-b70a-aa52c74e8121 tempest-VolumesTransfersV355Test-1639754844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:52:25 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4ab46bc2-84a1-4ce9-b70a-aa52c74e8121 tempest-VolumesTransfersV355Test-1639754844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15e61bb4-8df6-40cd-b7b5-a32d9599dcca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef80d06f-b5eb-4170-adb1-1a9c2df92f34', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:52:25 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4ab46bc2-84a1-4ce9-b70a-aa52c74e8121 tempest-VolumesTransfersV355Test-1639754844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0cefe2e-e746-4169-80dd-676c3a948d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:52:25 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-c222122e-76ed-4541-b2c6-f19f5e025a49 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Acquiring lock "cinder-9102b518-793f-416d-a206-f454b41f96f0-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:52:25 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-4ab46bc2-84a1-4ce9-b70a-aa52c74e8121 tempest-VolumesTransfersV355Test-1639754844 None] Volume volume-ef80d06f-b5eb-4170-adb1-1a9c2df92f34 (ef80d06f-b5eb-4170-adb1-1a9c2df92f34): created successfully Sep 08 06:52:25 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4ab46bc2-84a1-4ce9-b70a-aa52c74e8121 tempest-VolumesTransfersV355Test-1639754844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0cefe2e-e746-4169-80dd-676c3a948d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:52:25 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4ab46bc2-84a1-4ce9-b70a-aa52c74e8121 tempest-VolumesTransfersV355Test-1639754844 None] Flow 'volume_create_manager' (037d63f9-418d-4eda-ad8a-281197a7e62c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:52:25 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-c222122e-76ed-4541-b2c6-f19f5e025a49 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Lock "cinder-9102b518-793f-416d-a206-f454b41f96f0-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:52:25 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-4ab46bc2-84a1-4ce9-b70a-aa52c74e8121 tempest-VolumesTransfersV355Test-1639754844 None] Created volume successfully. Sep 08 06:52:25 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-c222122e-76ed-4541-b2c6-f19f5e025a49 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Acquiring lock "cinder-quobyte-9102b518-793f-416d-a206-f454b41f96f0" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:52:25 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-c222122e-76ed-4541-b2c6-f19f5e025a49 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Lock "cinder-quobyte-9102b518-793f-416d-a206-f454b41f96f0" acquired by "delete_volume" :: waited 0.025s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:52:25 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3037f7b-5d90-4a62-8427-c6deacfa681e]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:52:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-c222122e-76ed-4541-b2c6-f19f5e025a49 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9102b518-793f-416d-a206-f454b41f96f0 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:52:25 devstack sudo[102244]: pam_unix(sudo:session): session closed for user root Sep 08 06:52:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b2358335-ec87-42d2-8413-9372c571e750 tempest-CreateVolumesFromSnapshotTest-1179291947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.328s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:52:25 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-b2358335-ec87-42d2-8413-9372c571e750 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:52:25 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-b2358335-ec87-42d2-8413-9372c571e750 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Deleted volume successfully. Sep 08 06:52:25 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-b2358335-ec87-42d2-8413-9372c571e750 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Lock "cinder-08a567aa-2655-40b2-a460-0c1a49f2b478-delete_volume" released by "delete_volume" :: held 1.380s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:52:25 devstack sudo[102259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9102b518-793f-416d-a206-f454b41f96f0 Sep 08 06:52:25 devstack sudo[102259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:52:26 devstack sudo[102259]: pam_unix(sudo:session): session closed for user root Sep 08 06:52:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-c222122e-76ed-4541-b2c6-f19f5e025a49 tempest-CreateVolumesFromSnapshotTest-1179291947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9102b518-793f-416d-a206-f454b41f96f0" returned: 0 in 0.409s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:52:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-c222122e-76ed-4541-b2c6-f19f5e025a49 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9102b518-793f-416d-a206-f454b41f96f0 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:52:26 devstack sudo[102277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9102b518-793f-416d-a206-f454b41f96f0 Sep 08 06:52:26 devstack sudo[102277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:52:26 devstack sudo[102277]: pam_unix(sudo:session): session closed for user root Sep 08 06:52:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-c222122e-76ed-4541-b2c6-f19f5e025a49 tempest-CreateVolumesFromSnapshotTest-1179291947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9102b518-793f-416d-a206-f454b41f96f0" returned: 0 in 0.271s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:52:26 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-c222122e-76ed-4541-b2c6-f19f5e025a49 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Lock "cinder-quobyte-9102b518-793f-416d-a206-f454b41f96f0" released by "delete_volume" :: held 0.740s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:52:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-23a460c4-7c68-4c86-86bb-561389a1887f tempest-VolumesActionsTest-1238384040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:52:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-23a460c4-7c68-4c86-86bb-561389a1887f tempest-VolumesActionsTest-1238384040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:52:26 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d832ed-25a9-4c0e-b914-12681321916b]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:52:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-23a460c4-7c68-4c86-86bb-561389a1887f tempest-VolumesActionsTest-1238384040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-aa8a4571-b304-4037-8887-07da22bc357b {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:52:26 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-c222122e-76ed-4541-b2c6-f19f5e025a49 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Created reservations ['2e99b126-5a26-4ef2-9f45-d634f3bb1a43', '9b0b66d4-033d-404a-bb0f-18c0ffc4909a', 'a37f8971-587e-4aac-838c-68ebee574705', '56a220c2-ef98-4b8e-ad30-7815ecb41f99'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:52:26 devstack sudo[102289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-aa8a4571-b304-4037-8887-07da22bc357b Sep 08 06:52:26 devstack sudo[102289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:52:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-c222122e-76ed-4541-b2c6-f19f5e025a49 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:52:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-c222122e-76ed-4541-b2c6-f19f5e025a49 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:52:26 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-c222122e-76ed-4541-b2c6-f19f5e025a49 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:52:26 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-c222122e-76ed-4541-b2c6-f19f5e025a49 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:52:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-c222122e-76ed-4541-b2c6-f19f5e025a49 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:52:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-c222122e-76ed-4541-b2c6-f19f5e025a49 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:52:26 devstack sudo[102297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:52:26 devstack sudo[102297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:52:26 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-5c5ee776-417a-4d14-9b00-b338ceda1e97 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Acquiring lock "cinder-5e39bb2a-d433-4d6e-bdb8-e830426649ed-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:52:26 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-5c5ee776-417a-4d14-9b00-b338ceda1e97 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Lock "cinder-5e39bb2a-d433-4d6e-bdb8-e830426649ed-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:52:26 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-5c5ee776-417a-4d14-9b00-b338ceda1e97 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Acquiring lock "cinder-quobyte-5e39bb2a-d433-4d6e-bdb8-e830426649ed" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:52:26 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-9336f200-b87a-44ba-aa75-f301f6774997 tempest-VolumesTransfersV355Test-1807218516 None] Acquiring lock "cinder-ef80d06f-b5eb-4170-adb1-1a9c2df92f34-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:52:26 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-5c5ee776-417a-4d14-9b00-b338ceda1e97 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Lock "cinder-quobyte-5e39bb2a-d433-4d6e-bdb8-e830426649ed" acquired by "delete_volume" :: waited 0.032s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:52:26 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-9336f200-b87a-44ba-aa75-f301f6774997 tempest-VolumesTransfersV355Test-1807218516 None] Lock "cinder-ef80d06f-b5eb-4170-adb1-1a9c2df92f34-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:52:26 devstack sudo[102289]: pam_unix(sudo:session): session closed for user root Sep 08 06:52:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-23a460c4-7c68-4c86-86bb-561389a1887f tempest-VolumesActionsTest-1238384040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-aa8a4571-b304-4037-8887-07da22bc357b" returned: 0 in 0.506s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:52:26 devstack sudo[102297]: pam_unix(sudo:session): session closed for user root Sep 08 06:52:26 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd31fc1-7465-40a1-9d1d-63e9948f817d]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:52:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5c5ee776-417a-4d14-9b00-b338ceda1e97 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5e39bb2a-d433-4d6e-bdb8-e830426649ed {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:52:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-c222122e-76ed-4541-b2c6-f19f5e025a49 tempest-CreateVolumesFromSnapshotTest-1179291947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.343s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:52:26 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2eb6eed-9b1c-4702-9802-4bb1c4f62edd]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:52:26 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-c222122e-76ed-4541-b2c6-f19f5e025a49 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:52:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-23a460c4-7c68-4c86-86bb-561389a1887f tempest-VolumesActionsTest-1238384040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-aa8a4571-b304-4037-8887-07da22bc357b {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:52:26 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-c222122e-76ed-4541-b2c6-f19f5e025a49 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Deleted volume successfully. Sep 08 06:52:26 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-9336f200-b87a-44ba-aa75-f301f6774997 tempest-VolumesTransfersV355Test-1807218516 None] Acquiring lock "cinder-quobyte-ef80d06f-b5eb-4170-adb1-1a9c2df92f34" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:52:26 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-c222122e-76ed-4541-b2c6-f19f5e025a49 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Lock "cinder-9102b518-793f-416d-a206-f454b41f96f0-delete_volume" released by "delete_volume" :: held 1.434s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:52:26 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-9336f200-b87a-44ba-aa75-f301f6774997 tempest-VolumesTransfersV355Test-1807218516 None] Lock "cinder-quobyte-ef80d06f-b5eb-4170-adb1-1a9c2df92f34" acquired by "delete_volume" :: waited 0.030s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:52:26 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7089baee-deaf-4f2a-80f2-e058e5565117]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:52:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9336f200-b87a-44ba-aa75-f301f6774997 tempest-VolumesTransfersV355Test-1807218516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ef80d06f-b5eb-4170-adb1-1a9c2df92f34 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:52:26 devstack sudo[102312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5e39bb2a-d433-4d6e-bdb8-e830426649ed Sep 08 06:52:26 devstack sudo[102312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:52:27 devstack sudo[102313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-aa8a4571-b304-4037-8887-07da22bc357b Sep 08 06:52:27 devstack sudo[102313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:52:27 devstack sudo[102318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ef80d06f-b5eb-4170-adb1-1a9c2df92f34 Sep 08 06:52:27 devstack sudo[102318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:52:27 devstack sudo[102313]: pam_unix(sudo:session): session closed for user root Sep 08 06:52:27 devstack sudo[102312]: pam_unix(sudo:session): session closed for user root Sep 08 06:52:27 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-23a460c4-7c68-4c86-86bb-561389a1887f tempest-VolumesActionsTest-1238384040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-aa8a4571-b304-4037-8887-07da22bc357b" returned: 0 in 0.383s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:52:27 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-23a460c4-7c68-4c86-86bb-561389a1887f tempest-VolumesActionsTest-1238384040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-aa8a4571-b304-4037-8887-07da22bc357b /opt/stack/data/cinder/conversion/aa8a4571-b304-4037-8887-07da22bc357b.temp_image.6dd84915-cf07-4e21-acab-ed63141d8b1953g18il3.img {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:52:27 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5c5ee776-417a-4d14-9b00-b338ceda1e97 tempest-CreateVolumesFromSnapshotTest-1179291947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5e39bb2a-d433-4d6e-bdb8-e830426649ed" returned: 0 in 0.420s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:52:27 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5c5ee776-417a-4d14-9b00-b338ceda1e97 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5e39bb2a-d433-4d6e-bdb8-e830426649ed {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:52:27 devstack sudo[102337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-aa8a4571-b304-4037-8887-07da22bc357b /opt/stack/data/cinder/conversion/aa8a4571-b304-4037-8887-07da22bc357b.temp_image.6dd84915-cf07-4e21-acab-ed63141d8b1953g18il3.img Sep 08 06:52:27 devstack sudo[102337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:52:27 devstack sudo[102338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5e39bb2a-d433-4d6e-bdb8-e830426649ed Sep 08 06:52:27 devstack sudo[102338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:52:27 devstack sudo[102318]: pam_unix(sudo:session): session closed for user root Sep 08 06:52:27 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9336f200-b87a-44ba-aa75-f301f6774997 tempest-VolumesTransfersV355Test-1807218516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ef80d06f-b5eb-4170-adb1-1a9c2df92f34" returned: 0 in 0.406s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:52:27 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9336f200-b87a-44ba-aa75-f301f6774997 tempest-VolumesTransfersV355Test-1807218516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ef80d06f-b5eb-4170-adb1-1a9c2df92f34 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:52:27 devstack sudo[102347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ef80d06f-b5eb-4170-adb1-1a9c2df92f34 Sep 08 06:52:27 devstack sudo[102347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:52:27 devstack sudo[102338]: pam_unix(sudo:session): session closed for user root Sep 08 06:52:27 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5c5ee776-417a-4d14-9b00-b338ceda1e97 tempest-CreateVolumesFromSnapshotTest-1179291947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5e39bb2a-d433-4d6e-bdb8-e830426649ed" returned: 0 in 0.277s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:52:27 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-5c5ee776-417a-4d14-9b00-b338ceda1e97 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Lock "cinder-quobyte-5e39bb2a-d433-4d6e-bdb8-e830426649ed" released by "delete_volume" :: held 0.804s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:52:27 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-5c5ee776-417a-4d14-9b00-b338ceda1e97 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Created reservations ['42879fba-7804-41d7-a9b8-b6d9cf707168', 'da2c9f05-d630-43a3-8cd7-ae67003304cd', '13bf6e62-3ea9-44ec-b09a-6842fa4d2a27', '78a79f0c-a3eb-4abb-9c74-ceeeb2f51809'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:52:27 devstack sudo[102347]: pam_unix(sudo:session): session closed for user root Sep 08 06:52:27 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9336f200-b87a-44ba-aa75-f301f6774997 tempest-VolumesTransfersV355Test-1807218516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ef80d06f-b5eb-4170-adb1-1a9c2df92f34" returned: 0 in 0.468s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:52:27 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-9336f200-b87a-44ba-aa75-f301f6774997 tempest-VolumesTransfersV355Test-1807218516 None] Lock "cinder-quobyte-ef80d06f-b5eb-4170-adb1-1a9c2df92f34" released by "delete_volume" :: held 0.964s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:52:28 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-5c5ee776-417a-4d14-9b00-b338ceda1e97 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:52:28 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-5c5ee776-417a-4d14-9b00-b338ceda1e97 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:52:28 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-5c5ee776-417a-4d14-9b00-b338ceda1e97 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:52:28 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-5c5ee776-417a-4d14-9b00-b338ceda1e97 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:52:28 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-5c5ee776-417a-4d14-9b00-b338ceda1e97 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:52:28 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5c5ee776-417a-4d14-9b00-b338ceda1e97 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:52:28 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-9336f200-b87a-44ba-aa75-f301f6774997 tempest-VolumesTransfersV355Test-1807218516 None] Created reservations ['40a5022d-2a31-4d2b-8bf4-2d2347b7aeac', 'e50221d2-7fe6-4703-82f4-9a39f9f6b6ed', '5bd9cbda-9a9c-4ab5-9785-6a8d3e97278b', 'ac9c2692-63f0-468c-9027-28691ba9f8d1'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:52:28 devstack sudo[102382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:52:28 devstack sudo[102382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:52:28 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-9336f200-b87a-44ba-aa75-f301f6774997 tempest-VolumesTransfersV355Test-1807218516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:52:28 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-9336f200-b87a-44ba-aa75-f301f6774997 tempest-VolumesTransfersV355Test-1807218516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:52:28 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-9336f200-b87a-44ba-aa75-f301f6774997 tempest-VolumesTransfersV355Test-1807218516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:52:28 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-9336f200-b87a-44ba-aa75-f301f6774997 tempest-VolumesTransfersV355Test-1807218516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:52:28 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-9336f200-b87a-44ba-aa75-f301f6774997 tempest-VolumesTransfersV355Test-1807218516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:52:28 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9336f200-b87a-44ba-aa75-f301f6774997 tempest-VolumesTransfersV355Test-1807218516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:52:28 devstack sudo[102390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:52:28 devstack sudo[102390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:52:28 devstack sudo[102382]: pam_unix(sudo:session): session closed for user root Sep 08 06:52:28 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5c5ee776-417a-4d14-9b00-b338ceda1e97 tempest-CreateVolumesFromSnapshotTest-1179291947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.561s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:52:28 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-5c5ee776-417a-4d14-9b00-b338ceda1e97 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:52:28 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-5c5ee776-417a-4d14-9b00-b338ceda1e97 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Deleted volume successfully. Sep 08 06:52:28 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-5c5ee776-417a-4d14-9b00-b338ceda1e97 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Lock "cinder-5e39bb2a-d433-4d6e-bdb8-e830426649ed-delete_volume" released by "delete_volume" :: held 1.986s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:52:28 devstack sudo[102390]: pam_unix(sudo:session): session closed for user root Sep 08 06:52:28 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9336f200-b87a-44ba-aa75-f301f6774997 tempest-VolumesTransfersV355Test-1807218516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.654s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:52:28 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-9336f200-b87a-44ba-aa75-f301f6774997 tempest-VolumesTransfersV355Test-1807218516 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:52:28 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-9336f200-b87a-44ba-aa75-f301f6774997 tempest-VolumesTransfersV355Test-1807218516 None] Deleted volume successfully. Sep 08 06:52:29 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-9336f200-b87a-44ba-aa75-f301f6774997 tempest-VolumesTransfersV355Test-1807218516 None] Lock "cinder-ef80d06f-b5eb-4170-adb1-1a9c2df92f34-delete_volume" released by "delete_volume" :: held 2.169s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:52:29 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-7756b3fc-707d-4415-b433-638f059bd839 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Acquiring lock "cinder-1cdd1477-3e56-40bd-8fe0-6ba154aec949-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:52:29 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-7756b3fc-707d-4415-b433-638f059bd839 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Lock "cinder-1cdd1477-3e56-40bd-8fe0-6ba154aec949-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:52:29 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-7756b3fc-707d-4415-b433-638f059bd839 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Acquiring lock "cinder-quobyte-1cdd1477-3e56-40bd-8fe0-6ba154aec949" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:52:29 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-7756b3fc-707d-4415-b433-638f059bd839 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Lock "cinder-quobyte-1cdd1477-3e56-40bd-8fe0-6ba154aec949" acquired by "delete_volume" :: waited 0.044s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:52:29 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d1d098-28b2-4b8d-8662-c0b36fe54585]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:52:29 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7756b3fc-707d-4415-b433-638f059bd839 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1cdd1477-3e56-40bd-8fe0-6ba154aec949 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:52:29 devstack sudo[102431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1cdd1477-3e56-40bd-8fe0-6ba154aec949 Sep 08 06:52:29 devstack sudo[102431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:52:30 devstack sudo[102431]: pam_unix(sudo:session): session closed for user root Sep 08 06:52:30 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7756b3fc-707d-4415-b433-638f059bd839 tempest-CreateVolumesFromSnapshotTest-1179291947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1cdd1477-3e56-40bd-8fe0-6ba154aec949" returned: 0 in 0.798s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:52:30 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7756b3fc-707d-4415-b433-638f059bd839 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1cdd1477-3e56-40bd-8fe0-6ba154aec949 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:52:30 devstack sudo[102460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1cdd1477-3e56-40bd-8fe0-6ba154aec949 Sep 08 06:52:30 devstack sudo[102460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:52:30 devstack sudo[102460]: pam_unix(sudo:session): session closed for user root Sep 08 06:52:30 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7756b3fc-707d-4415-b433-638f059bd839 tempest-CreateVolumesFromSnapshotTest-1179291947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1cdd1477-3e56-40bd-8fe0-6ba154aec949" returned: 0 in 0.645s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:52:30 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-7756b3fc-707d-4415-b433-638f059bd839 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Lock "cinder-quobyte-1cdd1477-3e56-40bd-8fe0-6ba154aec949" released by "delete_volume" :: held 1.556s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:52:31 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-7756b3fc-707d-4415-b433-638f059bd839 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Created reservations ['07392255-0cdb-452b-aa8a-9560e2bf07c6', '54dd5060-e120-480c-ba08-347b87440fc2', 'ab04db95-9136-4ff9-8424-28dc102bc37f', 'b9f0dd9a-a4cb-40e8-894f-f79d6b8a3e7d'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:52:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-7756b3fc-707d-4415-b433-638f059bd839 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:52:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-7756b3fc-707d-4415-b433-638f059bd839 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:52:31 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-7756b3fc-707d-4415-b433-638f059bd839 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:52:31 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-7756b3fc-707d-4415-b433-638f059bd839 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:52:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-7756b3fc-707d-4415-b433-638f059bd839 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:52:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7756b3fc-707d-4415-b433-638f059bd839 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:52:31 devstack sudo[102493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:52:31 devstack sudo[102493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:52:31 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-e02d71ed-e5c2-4219-a629-1aca79fb85fe tempest-CreateVolumesFromSnapshotTest-1179291947 None] Acquiring lock "cinder-63d4a44a-7223-4d73-8a44-82d59831ed9c-delete_snapshot" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:52:31 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-e02d71ed-e5c2-4219-a629-1aca79fb85fe tempest-CreateVolumesFromSnapshotTest-1179291947 None] Lock "cinder-63d4a44a-7223-4d73-8a44-82d59831ed9c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.072s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:52:31 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-e02d71ed-e5c2-4219-a629-1aca79fb85fe tempest-CreateVolumesFromSnapshotTest-1179291947 None] Acquiring lock "cinder-quobyte-8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:52:31 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-e02d71ed-e5c2-4219-a629-1aca79fb85fe tempest-CreateVolumesFromSnapshotTest-1179291947 None] Lock "cinder-quobyte-8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4" acquired by "delete_snapshot" :: waited 0.060s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:52:31 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-e02d71ed-e5c2-4219-a629-1aca79fb85fe tempest-CreateVolumesFromSnapshotTest-1179291947 None] Acquiring lock "cinder-quobyte-63d4a44a-7223-4d73-8a44-82d59831ed9c" by "_delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:52:32 devstack sudo[102493]: pam_unix(sudo:session): session closed for user root Sep 08 06:52:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7756b3fc-707d-4415-b433-638f059bd839 tempest-CreateVolumesFromSnapshotTest-1179291947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.758s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:52:32 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-7756b3fc-707d-4415-b433-638f059bd839 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:52:32 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-7756b3fc-707d-4415-b433-638f059bd839 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Deleted volume successfully. Sep 08 06:52:32 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-e02d71ed-e5c2-4219-a629-1aca79fb85fe tempest-CreateVolumesFromSnapshotTest-1179291947 None] Lock "cinder-quobyte-63d4a44a-7223-4d73-8a44-82d59831ed9c" acquired by "_delete_snapshot" :: waited 0.085s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:52:32 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-e02d71ed-e5c2-4219-a629-1aca79fb85fe tempest-CreateVolumesFromSnapshotTest-1179291947 None] Deleting offline snapshot 63d4a44a-7223-4d73-8a44-82d59831ed9c of volume 8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4 {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 06:52:32 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-e02d71ed-e5c2-4219-a629-1aca79fb85fe tempest-CreateVolumesFromSnapshotTest-1179291947 None] snapshot_file for this snap is: volume-8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4.63d4a44a-7223-4d73-8a44-82d59831ed9c {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 06:52:32 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ae3232-192b-4446-aa61-f64f29a077cb]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:52:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e02d71ed-e5c2-4219-a629-1aca79fb85fe tempest-CreateVolumesFromSnapshotTest-1179291947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4.63d4a44a-7223-4d73-8a44-82d59831ed9c {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:52:32 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-7756b3fc-707d-4415-b433-638f059bd839 tempest-CreateVolumesFromSnapshotTest-1179291947 None] Lock "cinder-1cdd1477-3e56-40bd-8fe0-6ba154aec949-delete_volume" released by "delete_volume" :: held 2.991s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:52:32 devstack sudo[102521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4.63d4a44a-7223-4d73-8a44-82d59831ed9c Sep 08 06:52:32 devstack sudo[102521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:52:33 devstack sudo[102337]: pam_unix(sudo:session): session closed for user root Sep 08 06:52:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-23a460c4-7c68-4c86-86bb-561389a1887f tempest-VolumesActionsTest-1238384040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-aa8a4571-b304-4037-8887-07da22bc357b /opt/stack/data/cinder/conversion/aa8a4571-b304-4037-8887-07da22bc357b.temp_image.6dd84915-cf07-4e21-acab-ed63141d8b1953g18il3.img" returned: 0 in 5.798s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:52:33 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7828b4da-5408-418f-8c9b-de55f13c0f89]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:52:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-23a460c4-7c68-4c86-86bb-561389a1887f tempest-VolumesActionsTest-1238384040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-aa8a4571-b304-4037-8887-07da22bc357b {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:52:33 devstack sudo[102521]: pam_unix(sudo:session): session closed for user root Sep 08 06:52:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e02d71ed-e5c2-4219-a629-1aca79fb85fe tempest-CreateVolumesFromSnapshotTest-1179291947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4.63d4a44a-7223-4d73-8a44-82d59831ed9c" returned: 0 in 1.043s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:52:33 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-e02d71ed-e5c2-4219-a629-1aca79fb85fe tempest-CreateVolumesFromSnapshotTest-1179291947 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 06:52:33 devstack sudo[102553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-aa8a4571-b304-4037-8887-07da22bc357b Sep 08 06:52:33 devstack sudo[102553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:52:33 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb07b19-91d1-43d4-a748-608eb268fb58]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:52:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e02d71ed-e5c2-4219-a629-1aca79fb85fe tempest-CreateVolumesFromSnapshotTest-1179291947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:52:33 devstack sudo[102562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4 Sep 08 06:52:33 devstack sudo[102562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:52:34 devstack sudo[102562]: pam_unix(sudo:session): session closed for user root Sep 08 06:52:34 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e02d71ed-e5c2-4219-a629-1aca79fb85fe tempest-CreateVolumesFromSnapshotTest-1179291947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4" returned: 0 in 0.780s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:52:34 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e02d71ed-e5c2-4219-a629-1aca79fb85fe tempest-CreateVolumesFromSnapshotTest-1179291947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4.63d4a44a-7223-4d73-8a44-82d59831ed9c {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:52:34 devstack sudo[102553]: pam_unix(sudo:session): session closed for user root Sep 08 06:52:34 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-23a460c4-7c68-4c86-86bb-561389a1887f tempest-VolumesActionsTest-1238384040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-aa8a4571-b304-4037-8887-07da22bc357b" returned: 0 in 1.008s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:52:34 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-23a460c4-7c68-4c86-86bb-561389a1887f tempest-VolumesActionsTest-1238384040 None] Image conversion details: src /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-aa8a4571-b304-4037-8887-07da22bc357b, size 1024.00 MB, duration 5.80 sec, destination /opt/stack/data/cinder/conversion/aa8a4571-b304-4037-8887-07da22bc357b.temp_image.6dd84915-cf07-4e21-acab-ed63141d8b1953g18il3.img {{(pid=87507) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 06:52:34 devstack cinder-volume[87507]: INFO cinder.image.image_utils [None req-23a460c4-7c68-4c86-86bb-561389a1887f tempest-VolumesActionsTest-1238384040 None] Converted 1024.00 MB image at 176.56 MB/s Sep 08 06:52:34 devstack sudo[102611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4.63d4a44a-7223-4d73-8a44-82d59831ed9c Sep 08 06:52:34 devstack sudo[102611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:52:34 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-23a460c4-7c68-4c86-86bb-561389a1887f tempest-VolumesActionsTest-1238384040 None] 6dd84915-cf07-4e21-acab-ed63141d8b19 was raw, no need to convert to raw {{(pid=87507) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 08 06:52:34 devstack sudo[102611]: pam_unix(sudo:session): session closed for user root Sep 08 06:52:34 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e02d71ed-e5c2-4219-a629-1aca79fb85fe tempest-CreateVolumesFromSnapshotTest-1179291947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4.63d4a44a-7223-4d73-8a44-82d59831ed9c" returned: 0 in 0.620s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:52:34 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e02d71ed-e5c2-4219-a629-1aca79fb85fe tempest-CreateVolumesFromSnapshotTest-1179291947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4.63d4a44a-7223-4d73-8a44-82d59831ed9c {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:52:34 devstack sudo[102638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4.63d4a44a-7223-4d73-8a44-82d59831ed9c Sep 08 06:52:34 devstack sudo[102638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:52:35 devstack sudo[102638]: pam_unix(sudo:session): session closed for user root Sep 08 06:52:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e02d71ed-e5c2-4219-a629-1aca79fb85fe tempest-CreateVolumesFromSnapshotTest-1179291947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4.63d4a44a-7223-4d73-8a44-82d59831ed9c" returned: 0 in 0.380s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:52:35 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-e02d71ed-e5c2-4219-a629-1aca79fb85fe tempest-CreateVolumesFromSnapshotTest-1179291947 None] Lock "cinder-quobyte-63d4a44a-7223-4d73-8a44-82d59831ed9c" released by "_delete_snapshot" :: held 3.070s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:52:35 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-e02d71ed-e5c2-4219-a629-1aca79fb85fe tempest-CreateVolumesFromSnapshotTest-1179291947 None] Lock "cinder-quobyte-8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4" released by "delete_snapshot" :: held 3.165s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:52:35 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-e02d71ed-e5c2-4219-a629-1aca79fb85fe tempest-CreateVolumesFromSnapshotTest-1179291947 None] Created reservations ['7ab965e7-1265-4173-a6f7-49265e0c76c8', 'e007dc58-8f67-4318-9f46-57a7e8e4d549', 'dfdbbdee-5c50-4969-b418-5829b175abf2', '5d6302af-ad65-4935-beb7-421934c40f85'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:52:35 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-e02d71ed-e5c2-4219-a629-1aca79fb85fe tempest-CreateVolumesFromSnapshotTest-1179291947 None] Delete snapshot completed successfully. Sep 08 06:52:35 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-e02d71ed-e5c2-4219-a629-1aca79fb85fe tempest-CreateVolumesFromSnapshotTest-1179291947 None] Lock "cinder-63d4a44a-7223-4d73-8a44-82d59831ed9c-delete_snapshot" released by "delete_snapshot" :: held 3.433s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:52:36 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-47ba7d1a-c8aa-4a0b-9a9d-df514ca2d1ae tempest-CreateVolumesFromSnapshotTest-1179291947 None] Acquiring lock "cinder-8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:52:36 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-47ba7d1a-c8aa-4a0b-9a9d-df514ca2d1ae tempest-CreateVolumesFromSnapshotTest-1179291947 None] Lock "cinder-8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:52:36 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-47ba7d1a-c8aa-4a0b-9a9d-df514ca2d1ae tempest-CreateVolumesFromSnapshotTest-1179291947 None] Acquiring lock "cinder-quobyte-8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:52:36 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-47ba7d1a-c8aa-4a0b-9a9d-df514ca2d1ae tempest-CreateVolumesFromSnapshotTest-1179291947 None] Lock "cinder-quobyte-8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4" acquired by "delete_volume" :: waited 0.024s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:52:36 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c73ecd-fb20-4415-9c67-b2bf5e811cb7]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:52:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-47ba7d1a-c8aa-4a0b-9a9d-df514ca2d1ae tempest-CreateVolumesFromSnapshotTest-1179291947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:52:36 devstack sudo[102698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4 Sep 08 06:52:36 devstack sudo[102698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:52:37 devstack sudo[102698]: pam_unix(sudo:session): session closed for user root Sep 08 06:52:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-47ba7d1a-c8aa-4a0b-9a9d-df514ca2d1ae tempest-CreateVolumesFromSnapshotTest-1179291947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4" returned: 0 in 0.604s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:52:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-47ba7d1a-c8aa-4a0b-9a9d-df514ca2d1ae tempest-CreateVolumesFromSnapshotTest-1179291947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:52:37 devstack sudo[102722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4 Sep 08 06:52:37 devstack sudo[102722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:52:37 devstack sudo[102722]: pam_unix(sudo:session): session closed for user root Sep 08 06:52:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-47ba7d1a-c8aa-4a0b-9a9d-df514ca2d1ae tempest-CreateVolumesFromSnapshotTest-1179291947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4" returned: 0 in 0.375s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:52:37 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-47ba7d1a-c8aa-4a0b-9a9d-df514ca2d1ae tempest-CreateVolumesFromSnapshotTest-1179291947 None] Lock "cinder-quobyte-8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4" released by "delete_volume" :: held 1.088s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:52:37 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-47ba7d1a-c8aa-4a0b-9a9d-df514ca2d1ae tempest-CreateVolumesFromSnapshotTest-1179291947 None] Created reservations ['d4cfdabc-a1f2-4e19-95d9-1df7334d4698', 'e3eaa609-b293-47ee-96df-75cc98c2a77a', 'ba8232ad-c201-4617-a250-05472b36e1db', '0f8d5e75-5291-4874-bc4e-5c233e66022e'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:52:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-47ba7d1a-c8aa-4a0b-9a9d-df514ca2d1ae tempest-CreateVolumesFromSnapshotTest-1179291947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:52:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-47ba7d1a-c8aa-4a0b-9a9d-df514ca2d1ae tempest-CreateVolumesFromSnapshotTest-1179291947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:52:37 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-47ba7d1a-c8aa-4a0b-9a9d-df514ca2d1ae tempest-CreateVolumesFromSnapshotTest-1179291947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:52:37 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-47ba7d1a-c8aa-4a0b-9a9d-df514ca2d1ae tempest-CreateVolumesFromSnapshotTest-1179291947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:52:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-47ba7d1a-c8aa-4a0b-9a9d-df514ca2d1ae tempest-CreateVolumesFromSnapshotTest-1179291947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:52:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-47ba7d1a-c8aa-4a0b-9a9d-df514ca2d1ae tempest-CreateVolumesFromSnapshotTest-1179291947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:52:37 devstack sudo[102746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:52:37 devstack sudo[102746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:52:37 devstack sudo[102746]: pam_unix(sudo:session): session closed for user root Sep 08 06:52:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-47ba7d1a-c8aa-4a0b-9a9d-df514ca2d1ae tempest-CreateVolumesFromSnapshotTest-1179291947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.339s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:52:38 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-47ba7d1a-c8aa-4a0b-9a9d-df514ca2d1ae tempest-CreateVolumesFromSnapshotTest-1179291947 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:52:38 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-47ba7d1a-c8aa-4a0b-9a9d-df514ca2d1ae tempest-CreateVolumesFromSnapshotTest-1179291947 None] Deleted volume successfully. Sep 08 06:52:38 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-47ba7d1a-c8aa-4a0b-9a9d-df514ca2d1ae tempest-CreateVolumesFromSnapshotTest-1179291947 None] Lock "cinder-8a6facdc-9b80-40eb-b3d1-25bdc6fb31e4-delete_volume" released by "delete_volume" :: held 1.786s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:52:38 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-3f7fafc0-7741-4b8d-b63f-f1d8528e879f tempest-AttachVolumeTestJSON-921065048 None] Acquiring lock "cinder-c3e5ebbb-2dea-45b0-bbff-7fcaf0394604-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:52:38 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-3f7fafc0-7741-4b8d-b63f-f1d8528e879f tempest-AttachVolumeTestJSON-921065048 None] Lock "cinder-c3e5ebbb-2dea-45b0-bbff-7fcaf0394604-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:52:38 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-3f7fafc0-7741-4b8d-b63f-f1d8528e879f tempest-AttachVolumeTestJSON-921065048 None] Acquiring lock "cinder-quobyte-c3e5ebbb-2dea-45b0-bbff-7fcaf0394604" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:52:38 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-3f7fafc0-7741-4b8d-b63f-f1d8528e879f tempest-AttachVolumeTestJSON-921065048 None] Lock "cinder-quobyte-c3e5ebbb-2dea-45b0-bbff-7fcaf0394604" acquired by "delete_volume" :: waited 0.021s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:52:38 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e31c1b-b818-4324-8c00-1a7de4ef1b08]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:52:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3f7fafc0-7741-4b8d-b63f-f1d8528e879f tempest-AttachVolumeTestJSON-921065048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c3e5ebbb-2dea-45b0-bbff-7fcaf0394604 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:52:39 devstack sudo[102785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c3e5ebbb-2dea-45b0-bbff-7fcaf0394604 Sep 08 06:52:39 devstack sudo[102785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:52:39 devstack sudo[102785]: pam_unix(sudo:session): session closed for user root Sep 08 06:52:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3f7fafc0-7741-4b8d-b63f-f1d8528e879f tempest-AttachVolumeTestJSON-921065048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c3e5ebbb-2dea-45b0-bbff-7fcaf0394604" returned: 0 in 0.616s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:52:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3f7fafc0-7741-4b8d-b63f-f1d8528e879f tempest-AttachVolumeTestJSON-921065048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c3e5ebbb-2dea-45b0-bbff-7fcaf0394604 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:52:39 devstack sudo[102808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c3e5ebbb-2dea-45b0-bbff-7fcaf0394604 Sep 08 06:52:39 devstack sudo[102808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:52:39 devstack sudo[102808]: pam_unix(sudo:session): session closed for user root Sep 08 06:52:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3f7fafc0-7741-4b8d-b63f-f1d8528e879f tempest-AttachVolumeTestJSON-921065048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c3e5ebbb-2dea-45b0-bbff-7fcaf0394604" returned: 0 in 0.369s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:52:39 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-3f7fafc0-7741-4b8d-b63f-f1d8528e879f tempest-AttachVolumeTestJSON-921065048 None] Lock "cinder-quobyte-c3e5ebbb-2dea-45b0-bbff-7fcaf0394604" released by "delete_volume" :: held 1.051s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:52:39 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-3f7fafc0-7741-4b8d-b63f-f1d8528e879f tempest-AttachVolumeTestJSON-921065048 None] Created reservations ['cc748504-6c5e-4dec-b4ff-cae42fee6aed', 'b7730896-aae4-458f-8ba5-7843b20bdc8c', 'c822b725-3b9d-42b3-bb9f-e486538c98f7', '08c5fe03-e8b5-411d-9e35-80af86938d72'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:52:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-3f7fafc0-7741-4b8d-b63f-f1d8528e879f tempest-AttachVolumeTestJSON-921065048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:52:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-3f7fafc0-7741-4b8d-b63f-f1d8528e879f tempest-AttachVolumeTestJSON-921065048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:52:40 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-3f7fafc0-7741-4b8d-b63f-f1d8528e879f tempest-AttachVolumeTestJSON-921065048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:52:40 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-3f7fafc0-7741-4b8d-b63f-f1d8528e879f tempest-AttachVolumeTestJSON-921065048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:52:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-3f7fafc0-7741-4b8d-b63f-f1d8528e879f tempest-AttachVolumeTestJSON-921065048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:52:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3f7fafc0-7741-4b8d-b63f-f1d8528e879f tempest-AttachVolumeTestJSON-921065048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:52:40 devstack sudo[102827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:52:40 devstack sudo[102827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:52:40 devstack sudo[102827]: pam_unix(sudo:session): session closed for user root Sep 08 06:52:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3f7fafc0-7741-4b8d-b63f-f1d8528e879f tempest-AttachVolumeTestJSON-921065048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.312s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:52:40 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-3f7fafc0-7741-4b8d-b63f-f1d8528e879f tempest-AttachVolumeTestJSON-921065048 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:52:40 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-3f7fafc0-7741-4b8d-b63f-f1d8528e879f tempest-AttachVolumeTestJSON-921065048 None] Deleted volume successfully. Sep 08 06:52:40 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-3f7fafc0-7741-4b8d-b63f-f1d8528e879f tempest-AttachVolumeTestJSON-921065048 None] Lock "cinder-c3e5ebbb-2dea-45b0-bbff-7fcaf0394604-delete_volume" released by "delete_volume" :: held 1.754s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:52:41 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-663af610-d5f2-4f8f-9ccf-b0fa10cee5f2 tempest-AttachVolumeTestJSON-921065048 None] Acquiring lock "cinder-05a9c336-6790-414a-9df8-7d73202be656-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:52:41 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-663af610-d5f2-4f8f-9ccf-b0fa10cee5f2 tempest-AttachVolumeTestJSON-921065048 None] Lock "cinder-05a9c336-6790-414a-9df8-7d73202be656-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:52:41 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-e51f7932-d9ab-47fb-99c9-40fc476f394a tempest-VolumesGetTest-1169103151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:52:41 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-e51f7932-d9ab-47fb-99c9-40fc476f394a tempest-VolumesGetTest-1169103151 None] Flow 'volume_create_manager' (11ca869e-c6dc-4565-bc3c-7bce02d544f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:52:41 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-e51f7932-d9ab-47fb-99c9-40fc476f394a tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (123435f5-7a3a-4ac3-ad4d-39a6140d5f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:52:41 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-e51f7932-d9ab-47fb-99c9-40fc476f394a tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (123435f5-7a3a-4ac3-ad4d-39a6140d5f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:52:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1851689077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98f595ed-3259-43cf-abc8-3d3a7273db3f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d485bed2a56746eebce00d898e0d496c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:52:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:52:41Z,use_quota=True,user_id='eb60e87e5f514c66b1b8c39892da34fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:52:41 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-e51f7932-d9ab-47fb-99c9-40fc476f394a tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56053bca-2ce6-46b7-a090-4ddfc0c9a69b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:52:41 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-e51f7932-d9ab-47fb-99c9-40fc476f394a tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56053bca-2ce6-46b7-a090-4ddfc0c9a69b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:52:41 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-e51f7932-d9ab-47fb-99c9-40fc476f394a tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (757e6f5a-2a38-4ca1-a252-5a85a5567d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:52:41 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-e51f7932-d9ab-47fb-99c9-40fc476f394a tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (757e6f5a-2a38-4ca1-a252-5a85a5567d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98f595ed-3259-43cf-abc8-3d3a7273db3f', 'volume_name': 'volume-98f595ed-3259-43cf-abc8-3d3a7273db3f', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:52:41 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-e51f7932-d9ab-47fb-99c9-40fc476f394a tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29419bd2-7b00-4c8c-bf0f-09c803670ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:52:41 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-e51f7932-d9ab-47fb-99c9-40fc476f394a tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29419bd2-7b00-4c8c-bf0f-09c803670ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:52:41 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-e51f7932-d9ab-47fb-99c9-40fc476f394a tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba60e344-b974-4168-af6b-6ed5a405dcf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:52:41 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-e51f7932-d9ab-47fb-99c9-40fc476f394a tempest-VolumesGetTest-1169103151 None] Volume 98f595ed-3259-43cf-abc8-3d3a7273db3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98f595ed-3259-43cf-abc8-3d3a7273db3f', 'volume_size': 1} Sep 08 06:52:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-e51f7932-d9ab-47fb-99c9-40fc476f394a tempest-VolumesGetTest-1169103151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:52:41 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-663af610-d5f2-4f8f-9ccf-b0fa10cee5f2 tempest-AttachVolumeTestJSON-921065048 None] Acquiring lock "cinder-quobyte-05a9c336-6790-414a-9df8-7d73202be656" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:52:41 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-663af610-d5f2-4f8f-9ccf-b0fa10cee5f2 tempest-AttachVolumeTestJSON-921065048 None] Lock "cinder-quobyte-05a9c336-6790-414a-9df8-7d73202be656" acquired by "delete_volume" :: waited 0.015s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:52:41 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[82270832-c612-456a-95d3-caa7a503b567]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:52:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-663af610-d5f2-4f8f-9ccf-b0fa10cee5f2 tempest-AttachVolumeTestJSON-921065048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-05a9c336-6790-414a-9df8-7d73202be656 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:52:41 devstack sudo[102872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-05a9c336-6790-414a-9df8-7d73202be656 Sep 08 06:52:41 devstack sudo[102872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:52:41 devstack sudo[102872]: pam_unix(sudo:session): session closed for user root Sep 08 06:52:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-663af610-d5f2-4f8f-9ccf-b0fa10cee5f2 tempest-AttachVolumeTestJSON-921065048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-05a9c336-6790-414a-9df8-7d73202be656" returned: 0 in 0.455s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:52:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-663af610-d5f2-4f8f-9ccf-b0fa10cee5f2 tempest-AttachVolumeTestJSON-921065048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-05a9c336-6790-414a-9df8-7d73202be656 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:52:42 devstack sudo[102893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-05a9c336-6790-414a-9df8-7d73202be656 Sep 08 06:52:42 devstack sudo[102893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:52:42 devstack sudo[102893]: pam_unix(sudo:session): session closed for user root Sep 08 06:52:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-663af610-d5f2-4f8f-9ccf-b0fa10cee5f2 tempest-AttachVolumeTestJSON-921065048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-05a9c336-6790-414a-9df8-7d73202be656" returned: 0 in 0.323s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:52:42 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-663af610-d5f2-4f8f-9ccf-b0fa10cee5f2 tempest-AttachVolumeTestJSON-921065048 None] Lock "cinder-quobyte-05a9c336-6790-414a-9df8-7d73202be656" released by "delete_volume" :: held 0.844s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:52:42 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-663af610-d5f2-4f8f-9ccf-b0fa10cee5f2 tempest-AttachVolumeTestJSON-921065048 None] Created reservations ['310ab4b6-80f7-463e-96da-d010f151cc75', '747cb2e9-330a-4712-bfc9-e97d01a8bbff', 'c7040ac3-57df-4858-9a09-1a6befa73bf6', 'ceaadba9-2532-41c3-99f6-94a4c9963cac'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:52:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-663af610-d5f2-4f8f-9ccf-b0fa10cee5f2 tempest-AttachVolumeTestJSON-921065048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:52:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-663af610-d5f2-4f8f-9ccf-b0fa10cee5f2 tempest-AttachVolumeTestJSON-921065048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:52:42 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-663af610-d5f2-4f8f-9ccf-b0fa10cee5f2 tempest-AttachVolumeTestJSON-921065048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:52:42 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-663af610-d5f2-4f8f-9ccf-b0fa10cee5f2 tempest-AttachVolumeTestJSON-921065048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:52:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-663af610-d5f2-4f8f-9ccf-b0fa10cee5f2 tempest-AttachVolumeTestJSON-921065048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:52:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-663af610-d5f2-4f8f-9ccf-b0fa10cee5f2 tempest-AttachVolumeTestJSON-921065048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:52:42 devstack sudo[102912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:52:42 devstack sudo[102912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:52:42 devstack sudo[102912]: pam_unix(sudo:session): session closed for user root Sep 08 06:52:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-663af610-d5f2-4f8f-9ccf-b0fa10cee5f2 tempest-AttachVolumeTestJSON-921065048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.292s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:52:42 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-663af610-d5f2-4f8f-9ccf-b0fa10cee5f2 tempest-AttachVolumeTestJSON-921065048 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:52:42 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-663af610-d5f2-4f8f-9ccf-b0fa10cee5f2 tempest-AttachVolumeTestJSON-921065048 None] Deleted volume successfully. Sep 08 06:52:42 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-663af610-d5f2-4f8f-9ccf-b0fa10cee5f2 tempest-AttachVolumeTestJSON-921065048 None] Lock "cinder-05a9c336-6790-414a-9df8-7d73202be656-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:52:52 devstack cinder-volume[87507]: DEBUG dbcounter [-] [87507] Writing DB stats cinder:SELECT=105,cinder:INSERT=27,cinder:UPDATE=141,cinder:DELETE=10 {{(pid=87507) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 06:52:52 devstack cinder-volume[87507]: DEBUG dbcounter [-] [87507] Writing DB stats cinder:SELECT=107,cinder:UPDATE=138,cinder:INSERT=40,cinder:DELETE=13 {{(pid=87507) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 06:52:56 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [req-a06399a6-a7b6-4f93-b855-c7c188599ea6 req-613dd60f-31c9-4a24-b696-026e3cf3a55d tempest-VolumesSnapshotsTestJSON-1473847660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:52:56 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-a06399a6-a7b6-4f93-b855-c7c188599ea6 req-613dd60f-31c9-4a24-b696-026e3cf3a55d tempest-VolumesSnapshotsTestJSON-1473847660 None] Flow 'volume_create_manager' (3463ecaf-cd34-4f44-98a4-1a924458cb03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:52:56 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-a06399a6-a7b6-4f93-b855-c7c188599ea6 req-613dd60f-31c9-4a24-b696-026e3cf3a55d tempest-VolumesSnapshotsTestJSON-1473847660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92fbb50a-0c22-49fa-88a6-052ffc659c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:52:56 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-a06399a6-a7b6-4f93-b855-c7c188599ea6 req-613dd60f-31c9-4a24-b696-026e3cf3a55d tempest-VolumesSnapshotsTestJSON-1473847660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92fbb50a-0c22-49fa-88a6-052ffc659c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:52:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-894806849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac6c7704-ec6f-4cca-bea2-e1b935446c3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='122f34625b174ceaaf3146945226fbb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:52:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:52:56Z,use_quota=True,user_id='824b9792caf148a7ab2a449ce7d8bca9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:52:56 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-a06399a6-a7b6-4f93-b855-c7c188599ea6 req-613dd60f-31c9-4a24-b696-026e3cf3a55d tempest-VolumesSnapshotsTestJSON-1473847660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a0e0d89-4267-429a-b84c-132cb438c2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:52:56 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-a06399a6-a7b6-4f93-b855-c7c188599ea6 req-613dd60f-31c9-4a24-b696-026e3cf3a55d tempest-VolumesSnapshotsTestJSON-1473847660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a0e0d89-4267-429a-b84c-132cb438c2a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:52:56 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-a06399a6-a7b6-4f93-b855-c7c188599ea6 req-613dd60f-31c9-4a24-b696-026e3cf3a55d tempest-VolumesSnapshotsTestJSON-1473847660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a839bbd2-e426-43b0-a6f9-2463abcb301d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:52:56 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-a06399a6-a7b6-4f93-b855-c7c188599ea6 req-613dd60f-31c9-4a24-b696-026e3cf3a55d tempest-VolumesSnapshotsTestJSON-1473847660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a839bbd2-e426-43b0-a6f9-2463abcb301d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac6c7704-ec6f-4cca-bea2-e1b935446c3d', 'volume_name': 'volume-ac6c7704-ec6f-4cca-bea2-e1b935446c3d', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:52:56 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-a06399a6-a7b6-4f93-b855-c7c188599ea6 req-613dd60f-31c9-4a24-b696-026e3cf3a55d tempest-VolumesSnapshotsTestJSON-1473847660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4981d82b-7e8f-47c2-9640-68c0f71e08cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:52:56 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-a06399a6-a7b6-4f93-b855-c7c188599ea6 req-613dd60f-31c9-4a24-b696-026e3cf3a55d tempest-VolumesSnapshotsTestJSON-1473847660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4981d82b-7e8f-47c2-9640-68c0f71e08cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:52:56 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-a06399a6-a7b6-4f93-b855-c7c188599ea6 req-613dd60f-31c9-4a24-b696-026e3cf3a55d tempest-VolumesSnapshotsTestJSON-1473847660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35cc5260-5e06-46c1-a08e-9652484725e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:52:56 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [req-a06399a6-a7b6-4f93-b855-c7c188599ea6 req-613dd60f-31c9-4a24-b696-026e3cf3a55d tempest-VolumesSnapshotsTestJSON-1473847660 None] Volume ac6c7704-ec6f-4cca-bea2-e1b935446c3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac6c7704-ec6f-4cca-bea2-e1b935446c3d', 'volume_size': 1} Sep 08 06:52:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-a06399a6-a7b6-4f93-b855-c7c188599ea6 req-613dd60f-31c9-4a24-b696-026e3cf3a55d tempest-VolumesSnapshotsTestJSON-1473847660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:53:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-23a460c4-7c68-4c86-86bb-561389a1887f tempest-VolumesActionsTest-1238384040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 34.323s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:53:00 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-23a460c4-7c68-4c86-86bb-561389a1887f tempest-VolumesActionsTest-1238384040 None] Uploaded volume to glance image-id: 6dd84915-cf07-4e21-acab-ed63141d8b19. {{(pid=87507) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 08 06:53:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-e51f7932-d9ab-47fb-99c9-40fc476f394a tempest-VolumesGetTest-1169103151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.256s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:53:00 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-e51f7932-d9ab-47fb-99c9-40fc476f394a tempest-VolumesGetTest-1169103151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:52:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1851689077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98f595ed-3259-43cf-abc8-3d3a7273db3f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d485bed2a56746eebce00d898e0d496c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:52:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:52:41Z,use_quota=True,user_id='eb60e87e5f514c66b1b8c39892da34fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:53:00 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-e51f7932-d9ab-47fb-99c9-40fc476f394a tempest-VolumesGetTest-1169103151 None] Creating volume 98f595ed-3259-43cf-abc8-3d3a7273db3f {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:53:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-e51f7932-d9ab-47fb-99c9-40fc476f394a tempest-VolumesGetTest-1169103151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:53:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-e51f7932-d9ab-47fb-99c9-40fc476f394a tempest-VolumesGetTest-1169103151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:53:00 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-e51f7932-d9ab-47fb-99c9-40fc476f394a tempest-VolumesGetTest-1169103151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:53:00 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-e51f7932-d9ab-47fb-99c9-40fc476f394a tempest-VolumesGetTest-1169103151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:53:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-e51f7932-d9ab-47fb-99c9-40fc476f394a tempest-VolumesGetTest-1169103151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:53:00 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-e51f7932-d9ab-47fb-99c9-40fc476f394a tempest-VolumesGetTest-1169103151 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:53:00 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-e51f7932-d9ab-47fb-99c9-40fc476f394a tempest-VolumesGetTest-1169103151 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:53:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e51f7932-d9ab-47fb-99c9-40fc476f394a tempest-VolumesGetTest-1169103151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-98f595ed-3259-43cf-abc8-3d3a7273db3f 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:00 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-23a460c4-7c68-4c86-86bb-561389a1887f tempest-VolumesActionsTest-1238384040 None] Copy volume to image completed successfully. Sep 08 06:53:00 devstack sudo[103461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-98f595ed-3259-43cf-abc8-3d3a7273db3f 1073741824 Sep 08 06:53:00 devstack sudo[103461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:01 devstack sudo[103461]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e51f7932-d9ab-47fb-99c9-40fc476f394a tempest-VolumesGetTest-1169103151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-98f595ed-3259-43cf-abc8-3d3a7273db3f 1073741824" returned: 0 in 0.506s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e51f7932-d9ab-47fb-99c9-40fc476f394a tempest-VolumesGetTest-1169103151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-98f595ed-3259-43cf-abc8-3d3a7273db3f {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:01 devstack sudo[103485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-98f595ed-3259-43cf-abc8-3d3a7273db3f Sep 08 06:53:01 devstack sudo[103485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:01 devstack sudo[103485]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e51f7932-d9ab-47fb-99c9-40fc476f394a tempest-VolumesGetTest-1169103151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-98f595ed-3259-43cf-abc8-3d3a7273db3f" returned: 0 in 0.299s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:01 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-e51f7932-d9ab-47fb-99c9-40fc476f394a tempest-VolumesGetTest-1169103151 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:53:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-e51f7932-d9ab-47fb-99c9-40fc476f394a tempest-VolumesGetTest-1169103151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:53:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-a06399a6-a7b6-4f93-b855-c7c188599ea6 req-613dd60f-31c9-4a24-b696-026e3cf3a55d tempest-VolumesSnapshotsTestJSON-1473847660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.246s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:53:01 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [req-a06399a6-a7b6-4f93-b855-c7c188599ea6 req-613dd60f-31c9-4a24-b696-026e3cf3a55d tempest-VolumesSnapshotsTestJSON-1473847660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:52:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-894806849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac6c7704-ec6f-4cca-bea2-e1b935446c3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='122f34625b174ceaaf3146945226fbb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:52:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:52:56Z,use_quota=True,user_id='824b9792caf148a7ab2a449ce7d8bca9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:53:01 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [req-a06399a6-a7b6-4f93-b855-c7c188599ea6 req-613dd60f-31c9-4a24-b696-026e3cf3a55d tempest-VolumesSnapshotsTestJSON-1473847660 None] Creating volume ac6c7704-ec6f-4cca-bea2-e1b935446c3d {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:53:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-a06399a6-a7b6-4f93-b855-c7c188599ea6 req-613dd60f-31c9-4a24-b696-026e3cf3a55d tempest-VolumesSnapshotsTestJSON-1473847660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:53:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-a06399a6-a7b6-4f93-b855-c7c188599ea6 req-613dd60f-31c9-4a24-b696-026e3cf3a55d tempest-VolumesSnapshotsTestJSON-1473847660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:53:01 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [req-a06399a6-a7b6-4f93-b855-c7c188599ea6 req-613dd60f-31c9-4a24-b696-026e3cf3a55d tempest-VolumesSnapshotsTestJSON-1473847660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:53:01 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [req-a06399a6-a7b6-4f93-b855-c7c188599ea6 req-613dd60f-31c9-4a24-b696-026e3cf3a55d tempest-VolumesSnapshotsTestJSON-1473847660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:53:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-a06399a6-a7b6-4f93-b855-c7c188599ea6 req-613dd60f-31c9-4a24-b696-026e3cf3a55d tempest-VolumesSnapshotsTestJSON-1473847660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:53:01 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [req-a06399a6-a7b6-4f93-b855-c7c188599ea6 req-613dd60f-31c9-4a24-b696-026e3cf3a55d tempest-VolumesSnapshotsTestJSON-1473847660 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:53:01 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [req-a06399a6-a7b6-4f93-b855-c7c188599ea6 req-613dd60f-31c9-4a24-b696-026e3cf3a55d tempest-VolumesSnapshotsTestJSON-1473847660 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:53:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [req-a06399a6-a7b6-4f93-b855-c7c188599ea6 req-613dd60f-31c9-4a24-b696-026e3cf3a55d tempest-VolumesSnapshotsTestJSON-1473847660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ac6c7704-ec6f-4cca-bea2-e1b935446c3d 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:01 devstack sudo[103497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ac6c7704-ec6f-4cca-bea2-e1b935446c3d 1073741824 Sep 08 06:53:01 devstack sudo[103497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:01 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-e51f7932-d9ab-47fb-99c9-40fc476f394a tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba60e344-b974-4168-af6b-6ed5a405dcf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98f595ed-3259-43cf-abc8-3d3a7273db3f', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:01 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-e51f7932-d9ab-47fb-99c9-40fc476f394a tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68724380-d500-4f97-8a4d-ae221fe53d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:01 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-e51f7932-d9ab-47fb-99c9-40fc476f394a tempest-VolumesGetTest-1169103151 None] Volume volume-98f595ed-3259-43cf-abc8-3d3a7273db3f (98f595ed-3259-43cf-abc8-3d3a7273db3f): created successfully Sep 08 06:53:01 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-e51f7932-d9ab-47fb-99c9-40fc476f394a tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68724380-d500-4f97-8a4d-ae221fe53d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:01 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-e51f7932-d9ab-47fb-99c9-40fc476f394a tempest-VolumesGetTest-1169103151 None] Flow 'volume_create_manager' (11ca869e-c6dc-4565-bc3c-7bce02d544f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:53:01 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-e51f7932-d9ab-47fb-99c9-40fc476f394a tempest-VolumesGetTest-1169103151 None] Created volume successfully. Sep 08 06:53:02 devstack sudo[103497]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:02 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [req-a06399a6-a7b6-4f93-b855-c7c188599ea6 req-613dd60f-31c9-4a24-b696-026e3cf3a55d tempest-VolumesSnapshotsTestJSON-1473847660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ac6c7704-ec6f-4cca-bea2-e1b935446c3d 1073741824" returned: 0 in 0.687s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:02 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [req-a06399a6-a7b6-4f93-b855-c7c188599ea6 req-613dd60f-31c9-4a24-b696-026e3cf3a55d tempest-VolumesSnapshotsTestJSON-1473847660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ac6c7704-ec6f-4cca-bea2-e1b935446c3d {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:02 devstack sudo[103524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ac6c7704-ec6f-4cca-bea2-e1b935446c3d Sep 08 06:53:02 devstack sudo[103524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:02 devstack sudo[103524]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:02 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [req-a06399a6-a7b6-4f93-b855-c7c188599ea6 req-613dd60f-31c9-4a24-b696-026e3cf3a55d tempest-VolumesSnapshotsTestJSON-1473847660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ac6c7704-ec6f-4cca-bea2-e1b935446c3d" returned: 0 in 0.510s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:02 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [req-a06399a6-a7b6-4f93-b855-c7c188599ea6 req-613dd60f-31c9-4a24-b696-026e3cf3a55d tempest-VolumesSnapshotsTestJSON-1473847660 None] <== create_volume: return (1269ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:53:02 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-a06399a6-a7b6-4f93-b855-c7c188599ea6 req-613dd60f-31c9-4a24-b696-026e3cf3a55d tempest-VolumesSnapshotsTestJSON-1473847660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.271s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:53:02 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-05768a9f-6687-4155-983d-226e23426146 tempest-VolumesActionsTest-1238384040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:53:02 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-05768a9f-6687-4155-983d-226e23426146 tempest-VolumesActionsTest-1238384040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:53:02 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-a06399a6-a7b6-4f93-b855-c7c188599ea6 req-613dd60f-31c9-4a24-b696-026e3cf3a55d tempest-VolumesSnapshotsTestJSON-1473847660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35cc5260-5e06-46c1-a08e-9652484725e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac6c7704-ec6f-4cca-bea2-e1b935446c3d', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:02 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-a06399a6-a7b6-4f93-b855-c7c188599ea6 req-613dd60f-31c9-4a24-b696-026e3cf3a55d tempest-VolumesSnapshotsTestJSON-1473847660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a4bfe8c-ec95-4a17-9c2c-e0dd4df6ba98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:02 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd687a0-fb0b-4c54-a62d-50b5392783ac]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:53:02 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-05768a9f-6687-4155-983d-226e23426146 tempest-VolumesActionsTest-1238384040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-aa8a4571-b304-4037-8887-07da22bc357b {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:02 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [req-a06399a6-a7b6-4f93-b855-c7c188599ea6 req-613dd60f-31c9-4a24-b696-026e3cf3a55d tempest-VolumesSnapshotsTestJSON-1473847660 None] Volume volume-ac6c7704-ec6f-4cca-bea2-e1b935446c3d (ac6c7704-ec6f-4cca-bea2-e1b935446c3d): created successfully Sep 08 06:53:02 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-a06399a6-a7b6-4f93-b855-c7c188599ea6 req-613dd60f-31c9-4a24-b696-026e3cf3a55d tempest-VolumesSnapshotsTestJSON-1473847660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a4bfe8c-ec95-4a17-9c2c-e0dd4df6ba98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:02 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-a06399a6-a7b6-4f93-b855-c7c188599ea6 req-613dd60f-31c9-4a24-b696-026e3cf3a55d tempest-VolumesSnapshotsTestJSON-1473847660 None] Flow 'volume_create_manager' (3463ecaf-cd34-4f44-98a4-1a924458cb03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:53:02 devstack cinder-volume[87507]: INFO cinder.volume.manager [req-a06399a6-a7b6-4f93-b855-c7c188599ea6 req-613dd60f-31c9-4a24-b696-026e3cf3a55d tempest-VolumesSnapshotsTestJSON-1473847660 None] Created volume successfully. Sep 08 06:53:03 devstack sudo[103545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-aa8a4571-b304-4037-8887-07da22bc357b Sep 08 06:53:03 devstack sudo[103545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:03 devstack sudo[103545]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-05768a9f-6687-4155-983d-226e23426146 tempest-VolumesActionsTest-1238384040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-aa8a4571-b304-4037-8887-07da22bc357b" returned: 0 in 0.498s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:03 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d90870c-007a-4de0-9668-eacfd26f60e4]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:53:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-05768a9f-6687-4155-983d-226e23426146 tempest-VolumesActionsTest-1238384040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-aa8a4571-b304-4037-8887-07da22bc357b {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:03 devstack sudo[103566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-aa8a4571-b304-4037-8887-07da22bc357b Sep 08 06:53:03 devstack sudo[103566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:03 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-38492fa5-4e2e-4343-bdaa-82e826d3a4f1 tempest-VolumesGetTest-1169103151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:53:03 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-38492fa5-4e2e-4343-bdaa-82e826d3a4f1 tempest-VolumesGetTest-1169103151 None] Flow 'volume_create_manager' (56d437e3-59e4-41aa-8597-c14a6642b5ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:53:03 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-38492fa5-4e2e-4343-bdaa-82e826d3a4f1 tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (368a81e2-27ad-40d0-87a6-002706a1dfec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:03 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-38492fa5-4e2e-4343-bdaa-82e826d3a4f1 tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (368a81e2-27ad-40d0-87a6-002706a1dfec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:53:03Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-372665111',display_name='tempest-VolumesGetTest-Volume-239479574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b9429fd-7990-4297-ae11-061f7de1cc17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d485bed2a56746eebce00d898e0d496c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:53:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:53:03Z,use_quota=True,user_id='eb60e87e5f514c66b1b8c39892da34fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:03 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-38492fa5-4e2e-4343-bdaa-82e826d3a4f1 tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8326c04b-2304-41c0-8227-4bd1d1b053a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:03 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-38492fa5-4e2e-4343-bdaa-82e826d3a4f1 tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8326c04b-2304-41c0-8227-4bd1d1b053a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:03 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-38492fa5-4e2e-4343-bdaa-82e826d3a4f1 tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d32a26e2-57b5-45c1-ac21-61881c43479f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:03 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-38492fa5-4e2e-4343-bdaa-82e826d3a4f1 tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d32a26e2-57b5-45c1-ac21-61881c43479f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b9429fd-7990-4297-ae11-061f7de1cc17', 'volume_name': 'volume-6b9429fd-7990-4297-ae11-061f7de1cc17', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:03 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-38492fa5-4e2e-4343-bdaa-82e826d3a4f1 tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7a3e86d-fea9-4bbf-a41e-1c863c4866c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:03 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-38492fa5-4e2e-4343-bdaa-82e826d3a4f1 tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7a3e86d-fea9-4bbf-a41e-1c863c4866c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:03 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-38492fa5-4e2e-4343-bdaa-82e826d3a4f1 tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f087b8c7-f927-48e1-bdee-7c745890eb61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:03 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-38492fa5-4e2e-4343-bdaa-82e826d3a4f1 tempest-VolumesGetTest-1169103151 None] Volume 6b9429fd-7990-4297-ae11-061f7de1cc17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b9429fd-7990-4297-ae11-061f7de1cc17', 'volume_size': 1} Sep 08 06:53:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-38492fa5-4e2e-4343-bdaa-82e826d3a4f1 tempest-VolumesGetTest-1169103151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:53:03 devstack sudo[103566]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-05768a9f-6687-4155-983d-226e23426146 tempest-VolumesActionsTest-1238384040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-aa8a4571-b304-4037-8887-07da22bc357b" returned: 0 in 0.431s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-05768a9f-6687-4155-983d-226e23426146 tempest-VolumesActionsTest-1238384040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-aa8a4571-b304-4037-8887-07da22bc357b /opt/stack/data/cinder/conversion/aa8a4571-b304-4037-8887-07da22bc357b.temp_image.8fe3d74d-f77b-4692-a684-5b13d8ccd164s6u1qp6q.img {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:03 devstack sudo[103584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-aa8a4571-b304-4037-8887-07da22bc357b /opt/stack/data/cinder/conversion/aa8a4571-b304-4037-8887-07da22bc357b.temp_image.8fe3d74d-f77b-4692-a684-5b13d8ccd164s6u1qp6q.img Sep 08 06:53:03 devstack sudo[103584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:04 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-ec80f992-e9fe-44c0-9b3d-6f92bed8187e req-07a74351-b4d4-4f16-944f-ae0826ab59c5 tempest-VolumesSnapshotsTestJSON-1473847660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:53:08 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba6f0084-57ff-4d9d-a719-e88a3cdae0a2 tempest-SnapshotDependencyTests-1228523502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:53:08 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ba6f0084-57ff-4d9d-a719-e88a3cdae0a2 tempest-SnapshotDependencyTests-1228523502 None] Flow 'volume_create_manager' (12ba379e-c554-4f56-8592-f7b59ba53b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:53:08 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ba6f0084-57ff-4d9d-a719-e88a3cdae0a2 tempest-SnapshotDependencyTests-1228523502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6949589-6aa8-49c4-8521-f0bd9172f47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:08 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ba6f0084-57ff-4d9d-a719-e88a3cdae0a2 tempest-SnapshotDependencyTests-1228523502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6949589-6aa8-49c4-8521-f0bd9172f47c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:53:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1511700339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34fb25d7-19a1-4719-942d-21cfbd3d7eeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3cb00c6bffd401c9f4b4360affd6dce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:53:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:53:08Z,use_quota=True,user_id='59ce6b1a7feb41d096026bdc9e457cd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:08 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ba6f0084-57ff-4d9d-a719-e88a3cdae0a2 tempest-SnapshotDependencyTests-1228523502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c315814-18c5-4e25-a11f-dfbfb55355f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:08 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ba6f0084-57ff-4d9d-a719-e88a3cdae0a2 tempest-SnapshotDependencyTests-1228523502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c315814-18c5-4e25-a11f-dfbfb55355f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:08 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ba6f0084-57ff-4d9d-a719-e88a3cdae0a2 tempest-SnapshotDependencyTests-1228523502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01ccfbbb-83e0-4b96-a739-007e8f8e004b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:08 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ba6f0084-57ff-4d9d-a719-e88a3cdae0a2 tempest-SnapshotDependencyTests-1228523502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01ccfbbb-83e0-4b96-a739-007e8f8e004b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34fb25d7-19a1-4719-942d-21cfbd3d7eeb', 'volume_name': 'volume-34fb25d7-19a1-4719-942d-21cfbd3d7eeb', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:08 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ba6f0084-57ff-4d9d-a719-e88a3cdae0a2 tempest-SnapshotDependencyTests-1228523502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d826222-0d13-4036-bc36-b20f590947f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:08 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ba6f0084-57ff-4d9d-a719-e88a3cdae0a2 tempest-SnapshotDependencyTests-1228523502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d826222-0d13-4036-bc36-b20f590947f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:08 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ba6f0084-57ff-4d9d-a719-e88a3cdae0a2 tempest-SnapshotDependencyTests-1228523502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65420351-b7c2-4c6b-bf9a-b9109ffd1e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:08 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-ba6f0084-57ff-4d9d-a719-e88a3cdae0a2 tempest-SnapshotDependencyTests-1228523502 None] Volume 34fb25d7-19a1-4719-942d-21cfbd3d7eeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34fb25d7-19a1-4719-942d-21cfbd3d7eeb', 'volume_size': 1} Sep 08 06:53:08 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-ba6f0084-57ff-4d9d-a719-e88a3cdae0a2 tempest-SnapshotDependencyTests-1228523502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:53:09 devstack sudo[103584]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:09 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-05768a9f-6687-4155-983d-226e23426146 tempest-VolumesActionsTest-1238384040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-aa8a4571-b304-4037-8887-07da22bc357b /opt/stack/data/cinder/conversion/aa8a4571-b304-4037-8887-07da22bc357b.temp_image.8fe3d74d-f77b-4692-a684-5b13d8ccd164s6u1qp6q.img" returned: 0 in 5.480s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:09 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d90b8d1-41a5-4816-ae5a-16c8804b23c2]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:53:09 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-05768a9f-6687-4155-983d-226e23426146 tempest-VolumesActionsTest-1238384040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-aa8a4571-b304-4037-8887-07da22bc357b {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:09 devstack sudo[103760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-aa8a4571-b304-4037-8887-07da22bc357b Sep 08 06:53:09 devstack sudo[103760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:09 devstack sudo[103760]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:09 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-05768a9f-6687-4155-983d-226e23426146 tempest-VolumesActionsTest-1238384040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-aa8a4571-b304-4037-8887-07da22bc357b" returned: 0 in 0.528s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:09 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-05768a9f-6687-4155-983d-226e23426146 tempest-VolumesActionsTest-1238384040 None] Image conversion details: src /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-aa8a4571-b304-4037-8887-07da22bc357b, size 1024.00 MB, duration 5.48 sec, destination /opt/stack/data/cinder/conversion/aa8a4571-b304-4037-8887-07da22bc357b.temp_image.8fe3d74d-f77b-4692-a684-5b13d8ccd164s6u1qp6q.img {{(pid=87507) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 06:53:09 devstack cinder-volume[87507]: INFO cinder.image.image_utils [None req-05768a9f-6687-4155-983d-226e23426146 tempest-VolumesActionsTest-1238384040 None] Converted 1024.00 MB image at 186.84 MB/s Sep 08 06:53:09 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-05768a9f-6687-4155-983d-226e23426146 tempest-VolumesActionsTest-1238384040 None] 8fe3d74d-f77b-4692-a684-5b13d8ccd164 was raw, converting to qcow2 {{(pid=87507) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Sep 08 06:53:09 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[480cc260-3435-4c98-bb25-ac12a6effbb8]: (4, 'raw') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:53:09 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-05768a9f-6687-4155-983d-226e23426146 tempest-VolumesActionsTest-1238384040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/aa8a4571-b304-4037-8887-07da22bc357b.temp_image.8fe3d74d-f77b-4692-a684-5b13d8ccd164s6u1qp6q.img {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:09 devstack sudo[103783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/aa8a4571-b304-4037-8887-07da22bc357b.temp_image.8fe3d74d-f77b-4692-a684-5b13d8ccd164s6u1qp6q.img Sep 08 06:53:09 devstack sudo[103783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:10 devstack sudo[103783]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:10 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-05768a9f-6687-4155-983d-226e23426146 tempest-VolumesActionsTest-1238384040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/aa8a4571-b304-4037-8887-07da22bc357b.temp_image.8fe3d74d-f77b-4692-a684-5b13d8ccd164s6u1qp6q.img" returned: 0 in 0.328s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:10 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-05768a9f-6687-4155-983d-226e23426146 tempest-VolumesActionsTest-1238384040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/aa8a4571-b304-4037-8887-07da22bc357b.temp_image.8fe3d74d-f77b-4692-a684-5b13d8ccd164s6u1qp6q.img {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:10 devstack sudo[103796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/aa8a4571-b304-4037-8887-07da22bc357b.temp_image.8fe3d74d-f77b-4692-a684-5b13d8ccd164s6u1qp6q.img Sep 08 06:53:10 devstack sudo[103796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:10 devstack sudo[103796]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:10 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-05768a9f-6687-4155-983d-226e23426146 tempest-VolumesActionsTest-1238384040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/aa8a4571-b304-4037-8887-07da22bc357b.temp_image.8fe3d74d-f77b-4692-a684-5b13d8ccd164s6u1qp6q.img" returned: 1 in 0.317s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:10 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-05768a9f-6687-4155-983d-226e23426146 tempest-VolumesActionsTest-1238384040 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/aa8a4571-b304-4037-8887-07da22bc357b.temp_image.8fe3d74d-f77b-4692-a684-5b13d8ccd164s6u1qp6q.img' failed. Not Retrying. {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 06:53:10 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-05768a9f-6687-4155-983d-226e23426146 tempest-VolumesActionsTest-1238384040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/aa8a4571-b304-4037-8887-07da22bc357b.temp_image.8fe3d74d-f77b-4692-a684-5b13d8ccd164s6u1qp6q.img /opt/stack/data/cinder/conversion/vol_upload_3bmn137w {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:10 devstack sudo[103812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/aa8a4571-b304-4037-8887-07da22bc357b.temp_image.8fe3d74d-f77b-4692-a684-5b13d8ccd164s6u1qp6q.img /opt/stack/data/cinder/conversion/vol_upload_3bmn137w Sep 08 06:53:10 devstack sudo[103812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:10 devstack sudo[103812]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:10 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-05768a9f-6687-4155-983d-226e23426146 tempest-VolumesActionsTest-1238384040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/aa8a4571-b304-4037-8887-07da22bc357b.temp_image.8fe3d74d-f77b-4692-a684-5b13d8ccd164s6u1qp6q.img /opt/stack/data/cinder/conversion/vol_upload_3bmn137w" returned: 0 in 0.254s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:10 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-05768a9f-6687-4155-983d-226e23426146 tempest-VolumesActionsTest-1238384040 None] Image conversion details: src /opt/stack/data/cinder/conversion/aa8a4571-b304-4037-8887-07da22bc357b.temp_image.8fe3d74d-f77b-4692-a684-5b13d8ccd164s6u1qp6q.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_3bmn137w {{(pid=87507) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 06:53:10 devstack cinder-volume[87507]: INFO cinder.image.image_utils [None req-05768a9f-6687-4155-983d-226e23426146 tempest-VolumesActionsTest-1238384040 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 08 06:53:10 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b87502-433c-4d4d-870a-425d008c477c]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:53:10 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-05768a9f-6687-4155-983d-226e23426146 tempest-VolumesActionsTest-1238384040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_3bmn137w {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:10 devstack sudo[103826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_3bmn137w Sep 08 06:53:10 devstack sudo[103826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:11 devstack sudo[103826]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-05768a9f-6687-4155-983d-226e23426146 tempest-VolumesActionsTest-1238384040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_3bmn137w" returned: 0 in 0.324s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:12 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-05768a9f-6687-4155-983d-226e23426146 tempest-VolumesActionsTest-1238384040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.550s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:53:12 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-05768a9f-6687-4155-983d-226e23426146 tempest-VolumesActionsTest-1238384040 None] Uploaded volume to glance image-id: 8fe3d74d-f77b-4692-a684-5b13d8ccd164. {{(pid=87507) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 08 06:53:12 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-38492fa5-4e2e-4343-bdaa-82e826d3a4f1 tempest-VolumesGetTest-1169103151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.738s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:53:12 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-38492fa5-4e2e-4343-bdaa-82e826d3a4f1 tempest-VolumesGetTest-1169103151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:53:03Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-372665111',display_name='tempest-VolumesGetTest-Volume-239479574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b9429fd-7990-4297-ae11-061f7de1cc17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d485bed2a56746eebce00d898e0d496c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:53:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:53:03Z,use_quota=True,user_id='eb60e87e5f514c66b1b8c39892da34fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:53:12 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-38492fa5-4e2e-4343-bdaa-82e826d3a4f1 tempest-VolumesGetTest-1169103151 None] Creating volume 6b9429fd-7990-4297-ae11-061f7de1cc17 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:53:12 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-38492fa5-4e2e-4343-bdaa-82e826d3a4f1 tempest-VolumesGetTest-1169103151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:53:12 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-38492fa5-4e2e-4343-bdaa-82e826d3a4f1 tempest-VolumesGetTest-1169103151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:53:12 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-38492fa5-4e2e-4343-bdaa-82e826d3a4f1 tempest-VolumesGetTest-1169103151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:53:12 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-38492fa5-4e2e-4343-bdaa-82e826d3a4f1 tempest-VolumesGetTest-1169103151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:53:12 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-38492fa5-4e2e-4343-bdaa-82e826d3a4f1 tempest-VolumesGetTest-1169103151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:53:12 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-38492fa5-4e2e-4343-bdaa-82e826d3a4f1 tempest-VolumesGetTest-1169103151 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:53:12 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-38492fa5-4e2e-4343-bdaa-82e826d3a4f1 tempest-VolumesGetTest-1169103151 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:53:12 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-38492fa5-4e2e-4343-bdaa-82e826d3a4f1 tempest-VolumesGetTest-1169103151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6b9429fd-7990-4297-ae11-061f7de1cc17 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:12 devstack sudo[103879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6b9429fd-7990-4297-ae11-061f7de1cc17 1073741824 Sep 08 06:53:12 devstack sudo[103879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:12 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-05768a9f-6687-4155-983d-226e23426146 tempest-VolumesActionsTest-1238384040 None] Copy volume to image completed successfully. Sep 08 06:53:12 devstack sudo[103879]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:12 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-38492fa5-4e2e-4343-bdaa-82e826d3a4f1 tempest-VolumesGetTest-1169103151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6b9429fd-7990-4297-ae11-061f7de1cc17 1073741824" returned: 0 in 0.397s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:12 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-38492fa5-4e2e-4343-bdaa-82e826d3a4f1 tempest-VolumesGetTest-1169103151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6b9429fd-7990-4297-ae11-061f7de1cc17 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:12 devstack sudo[103897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6b9429fd-7990-4297-ae11-061f7de1cc17 Sep 08 06:53:12 devstack sudo[103897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:13 devstack sudo[103897]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-38492fa5-4e2e-4343-bdaa-82e826d3a4f1 tempest-VolumesGetTest-1169103151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6b9429fd-7990-4297-ae11-061f7de1cc17" returned: 0 in 0.244s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:13 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-38492fa5-4e2e-4343-bdaa-82e826d3a4f1 tempest-VolumesGetTest-1169103151 None] <== create_volume: return (679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:53:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-38492fa5-4e2e-4343-bdaa-82e826d3a4f1 tempest-VolumesGetTest-1169103151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:53:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-ec80f992-e9fe-44c0-9b3d-6f92bed8187e req-07a74351-b4d4-4f16-944f-ae0826ab59c5 tempest-VolumesSnapshotsTestJSON-1473847660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.540s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:53:13 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-38492fa5-4e2e-4343-bdaa-82e826d3a4f1 tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f087b8c7-f927-48e1-bdee-7c745890eb61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b9429fd-7990-4297-ae11-061f7de1cc17', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:13 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-38492fa5-4e2e-4343-bdaa-82e826d3a4f1 tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cba5ba8-a3b8-4bd1-a6ea-0d9c4492bff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:13 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [req-ec80f992-e9fe-44c0-9b3d-6f92bed8187e req-07a74351-b4d4-4f16-944f-ae0826ab59c5 tempest-VolumesSnapshotsTestJSON-1473847660 None] Creating offline snapshot 734e4643-0471-457c-b190-c718a8079102 of volume ac6c7704-ec6f-4cca-bea2-e1b935446c3d {{(pid=87507) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 06:53:13 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-38492fa5-4e2e-4343-bdaa-82e826d3a4f1 tempest-VolumesGetTest-1169103151 None] Volume volume-6b9429fd-7990-4297-ae11-061f7de1cc17 (6b9429fd-7990-4297-ae11-061f7de1cc17): created successfully Sep 08 06:53:13 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-38492fa5-4e2e-4343-bdaa-82e826d3a4f1 tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cba5ba8-a3b8-4bd1-a6ea-0d9c4492bff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:13 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-38492fa5-4e2e-4343-bdaa-82e826d3a4f1 tempest-VolumesGetTest-1169103151 None] Flow 'volume_create_manager' (56d437e3-59e4-41aa-8597-c14a6642b5ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:53:13 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f852919a-c855-4259-b736-64b93b6eec44]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:53:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [req-ec80f992-e9fe-44c0-9b3d-6f92bed8187e req-07a74351-b4d4-4f16-944f-ae0826ab59c5 tempest-VolumesSnapshotsTestJSON-1473847660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ac6c7704-ec6f-4cca-bea2-e1b935446c3d {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:13 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-38492fa5-4e2e-4343-bdaa-82e826d3a4f1 tempest-VolumesGetTest-1169103151 None] Created volume successfully. Sep 08 06:53:13 devstack sudo[103909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ac6c7704-ec6f-4cca-bea2-e1b935446c3d Sep 08 06:53:13 devstack sudo[103909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:13 devstack sudo[103909]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [req-ec80f992-e9fe-44c0-9b3d-6f92bed8187e req-07a74351-b4d4-4f16-944f-ae0826ab59c5 tempest-VolumesSnapshotsTestJSON-1473847660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ac6c7704-ec6f-4cca-bea2-e1b935446c3d" returned: 0 in 0.385s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [req-ec80f992-e9fe-44c0-9b3d-6f92bed8187e req-07a74351-b4d4-4f16-944f-ae0826ab59c5 tempest-VolumesSnapshotsTestJSON-1473847660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ac6c7704-ec6f-4cca-bea2-e1b935446c3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ac6c7704-ec6f-4cca-bea2-e1b935446c3d.734e4643-0471-457c-b190-c718a8079102 1G {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:13 devstack sudo[103926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ac6c7704-ec6f-4cca-bea2-e1b935446c3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ac6c7704-ec6f-4cca-bea2-e1b935446c3d.734e4643-0471-457c-b190-c718a8079102 1G Sep 08 06:53:13 devstack sudo[103926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:13 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-84b06b23-f058-42bb-ad77-d334ac761a39 tempest-VolumesGetTest-1169103151 None] Acquiring lock "cinder-6b9429fd-7990-4297-ae11-061f7de1cc17-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:53:13 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-84b06b23-f058-42bb-ad77-d334ac761a39 tempest-VolumesGetTest-1169103151 None] Lock "cinder-6b9429fd-7990-4297-ae11-061f7de1cc17-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:53:13 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-84b06b23-f058-42bb-ad77-d334ac761a39 tempest-VolumesGetTest-1169103151 None] Acquiring lock "cinder-quobyte-6b9429fd-7990-4297-ae11-061f7de1cc17" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:53:13 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-84b06b23-f058-42bb-ad77-d334ac761a39 tempest-VolumesGetTest-1169103151 None] Lock "cinder-quobyte-6b9429fd-7990-4297-ae11-061f7de1cc17" acquired by "delete_volume" :: waited 0.017s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:53:13 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ebf2b0-0360-4b7d-bdb7-82ee015b75d5]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:53:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-84b06b23-f058-42bb-ad77-d334ac761a39 tempest-VolumesGetTest-1169103151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6b9429fd-7990-4297-ae11-061f7de1cc17 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:13 devstack sudo[103934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6b9429fd-7990-4297-ae11-061f7de1cc17 Sep 08 06:53:13 devstack sudo[103934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:13 devstack sudo[103926]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [req-ec80f992-e9fe-44c0-9b3d-6f92bed8187e req-07a74351-b4d4-4f16-944f-ae0826ab59c5 tempest-VolumesSnapshotsTestJSON-1473847660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ac6c7704-ec6f-4cca-bea2-e1b935446c3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ac6c7704-ec6f-4cca-bea2-e1b935446c3d.734e4643-0471-457c-b190-c718a8079102 1G" returned: 0 in 0.473s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [req-ec80f992-e9fe-44c0-9b3d-6f92bed8187e req-07a74351-b4d4-4f16-944f-ae0826ab59c5 tempest-VolumesSnapshotsTestJSON-1473847660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac6c7704-ec6f-4cca-bea2-e1b935446c3d -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ac6c7704-ec6f-4cca-bea2-e1b935446c3d.734e4643-0471-457c-b190-c718a8079102 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:14 devstack sudo[103948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac6c7704-ec6f-4cca-bea2-e1b935446c3d -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ac6c7704-ec6f-4cca-bea2-e1b935446c3d.734e4643-0471-457c-b190-c718a8079102 Sep 08 06:53:14 devstack sudo[103948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:14 devstack sudo[103934]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-84b06b23-f058-42bb-ad77-d334ac761a39 tempest-VolumesGetTest-1169103151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6b9429fd-7990-4297-ae11-061f7de1cc17" returned: 0 in 0.416s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-84b06b23-f058-42bb-ad77-d334ac761a39 tempest-VolumesGetTest-1169103151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6b9429fd-7990-4297-ae11-061f7de1cc17 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:14 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-ebcfe7a4-1df8-4074-9054-8a4fe6038b73 tempest-VolumesActionsTest-1238384040 None] Acquiring lock "cinder-aa8a4571-b304-4037-8887-07da22bc357b-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:53:14 devstack sudo[103956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6b9429fd-7990-4297-ae11-061f7de1cc17 Sep 08 06:53:14 devstack sudo[103956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:14 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-ebcfe7a4-1df8-4074-9054-8a4fe6038b73 tempest-VolumesActionsTest-1238384040 None] Lock "cinder-aa8a4571-b304-4037-8887-07da22bc357b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:53:14 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-ebcfe7a4-1df8-4074-9054-8a4fe6038b73 tempest-VolumesActionsTest-1238384040 None] Acquiring lock "cinder-quobyte-aa8a4571-b304-4037-8887-07da22bc357b" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:53:14 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-ebcfe7a4-1df8-4074-9054-8a4fe6038b73 tempest-VolumesActionsTest-1238384040 None] Lock "cinder-quobyte-aa8a4571-b304-4037-8887-07da22bc357b" acquired by "delete_volume" :: waited 0.017s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:53:14 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77f7f62-2d16-4e87-988f-8d2281849935]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:53:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ebcfe7a4-1df8-4074-9054-8a4fe6038b73 tempest-VolumesActionsTest-1238384040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-aa8a4571-b304-4037-8887-07da22bc357b {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:14 devstack sudo[103948]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [req-ec80f992-e9fe-44c0-9b3d-6f92bed8187e req-07a74351-b4d4-4f16-944f-ae0826ab59c5 tempest-VolumesSnapshotsTestJSON-1473847660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac6c7704-ec6f-4cca-bea2-e1b935446c3d -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ac6c7704-ec6f-4cca-bea2-e1b935446c3d.734e4643-0471-457c-b190-c718a8079102" returned: 0 in 0.355s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:14 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [req-ec80f992-e9fe-44c0-9b3d-6f92bed8187e req-07a74351-b4d4-4f16-944f-ae0826ab59c5 tempest-VolumesSnapshotsTestJSON-1473847660 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ac6c7704-ec6f-4cca-bea2-e1b935446c3d.734e4643-0471-457c-b190-c718a8079102 is being set with open permissions: ugo+rw Sep 08 06:53:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [req-ec80f992-e9fe-44c0-9b3d-6f92bed8187e req-07a74351-b4d4-4f16-944f-ae0826ab59c5 tempest-VolumesSnapshotsTestJSON-1473847660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ac6c7704-ec6f-4cca-bea2-e1b935446c3d.734e4643-0471-457c-b190-c718a8079102 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:14 devstack sudo[103969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ac6c7704-ec6f-4cca-bea2-e1b935446c3d.734e4643-0471-457c-b190-c718a8079102 Sep 08 06:53:14 devstack sudo[103969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:14 devstack sudo[103963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-aa8a4571-b304-4037-8887-07da22bc357b Sep 08 06:53:14 devstack sudo[103963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:14 devstack sudo[103956]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-84b06b23-f058-42bb-ad77-d334ac761a39 tempest-VolumesGetTest-1169103151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6b9429fd-7990-4297-ae11-061f7de1cc17" returned: 0 in 0.289s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:14 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-84b06b23-f058-42bb-ad77-d334ac761a39 tempest-VolumesGetTest-1169103151 None] Lock "cinder-quobyte-6b9429fd-7990-4297-ae11-061f7de1cc17" released by "delete_volume" :: held 0.753s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:53:14 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-84b06b23-f058-42bb-ad77-d334ac761a39 tempest-VolumesGetTest-1169103151 None] Created reservations ['a7866983-0edb-4c16-ae86-1eb5ababa76f', '7732bd1e-a49c-4255-b974-9713c5d35b41', '769becef-c713-4efe-988b-ca7cd37be43f', '76ff987c-0b73-499d-a509-05f5c58520e1'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:53:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-84b06b23-f058-42bb-ad77-d334ac761a39 tempest-VolumesGetTest-1169103151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:53:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-84b06b23-f058-42bb-ad77-d334ac761a39 tempest-VolumesGetTest-1169103151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:53:14 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-84b06b23-f058-42bb-ad77-d334ac761a39 tempest-VolumesGetTest-1169103151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:53:14 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-84b06b23-f058-42bb-ad77-d334ac761a39 tempest-VolumesGetTest-1169103151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:53:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-84b06b23-f058-42bb-ad77-d334ac761a39 tempest-VolumesGetTest-1169103151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:53:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-84b06b23-f058-42bb-ad77-d334ac761a39 tempest-VolumesGetTest-1169103151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:14 devstack sudo[103979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:53:14 devstack sudo[103979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:14 devstack sudo[103969]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [req-ec80f992-e9fe-44c0-9b3d-6f92bed8187e req-07a74351-b4d4-4f16-944f-ae0826ab59c5 tempest-VolumesSnapshotsTestJSON-1473847660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ac6c7704-ec6f-4cca-bea2-e1b935446c3d.734e4643-0471-457c-b190-c718a8079102" returned: 0 in 0.276s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [req-ec80f992-e9fe-44c0-9b3d-6f92bed8187e req-07a74351-b4d4-4f16-944f-ae0826ab59c5 tempest-VolumesSnapshotsTestJSON-1473847660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ac6c7704-ec6f-4cca-bea2-e1b935446c3d.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:14 devstack sudo[103963]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ebcfe7a4-1df8-4074-9054-8a4fe6038b73 tempest-VolumesActionsTest-1238384040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-aa8a4571-b304-4037-8887-07da22bc357b" returned: 0 in 0.414s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ebcfe7a4-1df8-4074-9054-8a4fe6038b73 tempest-VolumesActionsTest-1238384040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-aa8a4571-b304-4037-8887-07da22bc357b {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:14 devstack sudo[103988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ac6c7704-ec6f-4cca-bea2-e1b935446c3d.info Sep 08 06:53:14 devstack sudo[103988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:14 devstack sudo[103989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-aa8a4571-b304-4037-8887-07da22bc357b Sep 08 06:53:14 devstack sudo[103989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:14 devstack sudo[103979]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-84b06b23-f058-42bb-ad77-d334ac761a39 tempest-VolumesGetTest-1169103151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.286s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:14 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-84b06b23-f058-42bb-ad77-d334ac761a39 tempest-VolumesGetTest-1169103151 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:53:14 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-adea4007-4590-4b72-9e88-073e46f8bbab tempest-VolumesGetTest-1169103151 None] Acquiring lock "cinder-98f595ed-3259-43cf-abc8-3d3a7273db3f-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:53:14 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-84b06b23-f058-42bb-ad77-d334ac761a39 tempest-VolumesGetTest-1169103151 None] Deleted volume successfully. Sep 08 06:53:14 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-84b06b23-f058-42bb-ad77-d334ac761a39 tempest-VolumesGetTest-1169103151 None] Lock "cinder-6b9429fd-7990-4297-ae11-061f7de1cc17-delete_volume" released by "delete_volume" :: held 1.339s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:53:14 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-adea4007-4590-4b72-9e88-073e46f8bbab tempest-VolumesGetTest-1169103151 None] Lock "cinder-98f595ed-3259-43cf-abc8-3d3a7273db3f-delete_volume" acquired by "delete_volume" :: waited 0.122s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:53:15 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-adea4007-4590-4b72-9e88-073e46f8bbab tempest-VolumesGetTest-1169103151 None] Acquiring lock "cinder-quobyte-98f595ed-3259-43cf-abc8-3d3a7273db3f" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:53:15 devstack sudo[103989]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ebcfe7a4-1df8-4074-9054-8a4fe6038b73 tempest-VolumesActionsTest-1238384040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-aa8a4571-b304-4037-8887-07da22bc357b" returned: 0 in 0.354s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:15 devstack sudo[103988]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:15 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-adea4007-4590-4b72-9e88-073e46f8bbab tempest-VolumesGetTest-1169103151 None] Lock "cinder-quobyte-98f595ed-3259-43cf-abc8-3d3a7273db3f" acquired by "delete_volume" :: waited 0.019s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:53:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [req-ec80f992-e9fe-44c0-9b3d-6f92bed8187e req-07a74351-b4d4-4f16-944f-ae0826ab59c5 tempest-VolumesSnapshotsTestJSON-1473847660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ac6c7704-ec6f-4cca-bea2-e1b935446c3d.info" returned: 0 in 0.399s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:15 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [req-ec80f992-e9fe-44c0-9b3d-6f92bed8187e req-07a74351-b4d4-4f16-944f-ae0826ab59c5 tempest-VolumesSnapshotsTestJSON-1473847660 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ac6c7704-ec6f-4cca-bea2-e1b935446c3d.info is being set with open permissions: ugo+rw Sep 08 06:53:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [req-ec80f992-e9fe-44c0-9b3d-6f92bed8187e req-07a74351-b4d4-4f16-944f-ae0826ab59c5 tempest-VolumesSnapshotsTestJSON-1473847660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ac6c7704-ec6f-4cca-bea2-e1b935446c3d.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:15 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-ebcfe7a4-1df8-4074-9054-8a4fe6038b73 tempest-VolumesActionsTest-1238384040 None] Lock "cinder-quobyte-aa8a4571-b304-4037-8887-07da22bc357b" released by "delete_volume" :: held 0.830s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:53:15 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c3bb1d-f0ae-43f6-a92a-d4ffbadbec82]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:53:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-adea4007-4590-4b72-9e88-073e46f8bbab tempest-VolumesGetTest-1169103151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-98f595ed-3259-43cf-abc8-3d3a7273db3f {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:15 devstack sudo[104007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ac6c7704-ec6f-4cca-bea2-e1b935446c3d.info Sep 08 06:53:15 devstack sudo[104007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:15 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-ebcfe7a4-1df8-4074-9054-8a4fe6038b73 tempest-VolumesActionsTest-1238384040 None] Created reservations ['8cee9b90-07ea-4b91-a1aa-d49d8141d325', '54361660-f9dc-46e4-bfc7-61a9b671799e', '070a24cb-bf80-471d-86ff-d36f6bb6b937', '50c60c59-6933-4492-955c-2a138c1936c4'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:53:15 devstack sudo[104008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-98f595ed-3259-43cf-abc8-3d3a7273db3f Sep 08 06:53:15 devstack sudo[104008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-ebcfe7a4-1df8-4074-9054-8a4fe6038b73 tempest-VolumesActionsTest-1238384040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:53:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-ebcfe7a4-1df8-4074-9054-8a4fe6038b73 tempest-VolumesActionsTest-1238384040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:53:15 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-ebcfe7a4-1df8-4074-9054-8a4fe6038b73 tempest-VolumesActionsTest-1238384040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:53:15 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-ebcfe7a4-1df8-4074-9054-8a4fe6038b73 tempest-VolumesActionsTest-1238384040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:53:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-ebcfe7a4-1df8-4074-9054-8a4fe6038b73 tempest-VolumesActionsTest-1238384040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:53:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ebcfe7a4-1df8-4074-9054-8a4fe6038b73 tempest-VolumesActionsTest-1238384040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:15 devstack sudo[104017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:53:15 devstack sudo[104017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:15 devstack sudo[104007]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [req-ec80f992-e9fe-44c0-9b3d-6f92bed8187e req-07a74351-b4d4-4f16-944f-ae0826ab59c5 tempest-VolumesSnapshotsTestJSON-1473847660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ac6c7704-ec6f-4cca-bea2-e1b935446c3d.info" returned: 0 in 0.266s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-ec80f992-e9fe-44c0-9b3d-6f92bed8187e req-07a74351-b4d4-4f16-944f-ae0826ab59c5 tempest-VolumesSnapshotsTestJSON-1473847660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.270s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:53:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-ba6f0084-57ff-4d9d-a719-e88a3cdae0a2 tempest-SnapshotDependencyTests-1228523502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.937s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:53:15 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-ba6f0084-57ff-4d9d-a719-e88a3cdae0a2 tempest-SnapshotDependencyTests-1228523502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:53:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1511700339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34fb25d7-19a1-4719-942d-21cfbd3d7eeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3cb00c6bffd401c9f4b4360affd6dce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:53:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:53:08Z,use_quota=True,user_id='59ce6b1a7feb41d096026bdc9e457cd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:53:15 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-ba6f0084-57ff-4d9d-a719-e88a3cdae0a2 tempest-SnapshotDependencyTests-1228523502 None] Creating volume 34fb25d7-19a1-4719-942d-21cfbd3d7eeb {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:53:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-ba6f0084-57ff-4d9d-a719-e88a3cdae0a2 tempest-SnapshotDependencyTests-1228523502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:53:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-ba6f0084-57ff-4d9d-a719-e88a3cdae0a2 tempest-SnapshotDependencyTests-1228523502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:53:15 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-ba6f0084-57ff-4d9d-a719-e88a3cdae0a2 tempest-SnapshotDependencyTests-1228523502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:53:15 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-ba6f0084-57ff-4d9d-a719-e88a3cdae0a2 tempest-SnapshotDependencyTests-1228523502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:53:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-ba6f0084-57ff-4d9d-a719-e88a3cdae0a2 tempest-SnapshotDependencyTests-1228523502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:53:15 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-ba6f0084-57ff-4d9d-a719-e88a3cdae0a2 tempest-SnapshotDependencyTests-1228523502 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:53:15 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-ba6f0084-57ff-4d9d-a719-e88a3cdae0a2 tempest-SnapshotDependencyTests-1228523502 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:53:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ba6f0084-57ff-4d9d-a719-e88a3cdae0a2 tempest-SnapshotDependencyTests-1228523502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-34fb25d7-19a1-4719-942d-21cfbd3d7eeb 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:15 devstack sudo[104023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-34fb25d7-19a1-4719-942d-21cfbd3d7eeb 1073741824 Sep 08 06:53:15 devstack sudo[104023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:15 devstack cinder-volume[87507]: INFO cinder.volume.manager [req-ec80f992-e9fe-44c0-9b3d-6f92bed8187e req-07a74351-b4d4-4f16-944f-ae0826ab59c5 tempest-VolumesSnapshotsTestJSON-1473847660 None] Create snapshot completed successfully Sep 08 06:53:15 devstack sudo[104008]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-adea4007-4590-4b72-9e88-073e46f8bbab tempest-VolumesGetTest-1169103151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-98f595ed-3259-43cf-abc8-3d3a7273db3f" returned: 0 in 0.454s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-adea4007-4590-4b72-9e88-073e46f8bbab tempest-VolumesGetTest-1169103151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-98f595ed-3259-43cf-abc8-3d3a7273db3f {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:15 devstack sudo[104034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-98f595ed-3259-43cf-abc8-3d3a7273db3f Sep 08 06:53:15 devstack sudo[104034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:15 devstack sudo[104017]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ebcfe7a4-1df8-4074-9054-8a4fe6038b73 tempest-VolumesActionsTest-1238384040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.378s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:15 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-ebcfe7a4-1df8-4074-9054-8a4fe6038b73 tempest-VolumesActionsTest-1238384040 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:53:15 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-ebcfe7a4-1df8-4074-9054-8a4fe6038b73 tempest-VolumesActionsTest-1238384040 None] Deleted volume successfully. Sep 08 06:53:15 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-ebcfe7a4-1df8-4074-9054-8a4fe6038b73 tempest-VolumesActionsTest-1238384040 None] Lock "cinder-aa8a4571-b304-4037-8887-07da22bc357b-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:53:15 devstack sudo[104034]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-adea4007-4590-4b72-9e88-073e46f8bbab tempest-VolumesGetTest-1169103151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-98f595ed-3259-43cf-abc8-3d3a7273db3f" returned: 0 in 0.293s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:15 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-adea4007-4590-4b72-9e88-073e46f8bbab tempest-VolumesGetTest-1169103151 None] Lock "cinder-quobyte-98f595ed-3259-43cf-abc8-3d3a7273db3f" released by "delete_volume" :: held 0.796s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:53:15 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-adea4007-4590-4b72-9e88-073e46f8bbab tempest-VolumesGetTest-1169103151 None] Created reservations ['984852ab-84ad-4ec1-a351-fa17e3ae1716', 'b0adea5a-2846-48cd-a7fb-989fe0568294', '73bbc34e-1139-49a0-998d-9b80c5df9fe0', '51c2bbb0-32ac-48d8-9981-0d1d78c9ea1d'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:53:15 devstack sudo[104023]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ba6f0084-57ff-4d9d-a719-e88a3cdae0a2 tempest-SnapshotDependencyTests-1228523502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-34fb25d7-19a1-4719-942d-21cfbd3d7eeb 1073741824" returned: 0 in 0.534s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ba6f0084-57ff-4d9d-a719-e88a3cdae0a2 tempest-SnapshotDependencyTests-1228523502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-34fb25d7-19a1-4719-942d-21cfbd3d7eeb {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-adea4007-4590-4b72-9e88-073e46f8bbab tempest-VolumesGetTest-1169103151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:53:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-adea4007-4590-4b72-9e88-073e46f8bbab tempest-VolumesGetTest-1169103151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:53:15 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-adea4007-4590-4b72-9e88-073e46f8bbab tempest-VolumesGetTest-1169103151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:53:16 devstack sudo[104054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-34fb25d7-19a1-4719-942d-21cfbd3d7eeb Sep 08 06:53:16 devstack sudo[104054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:16 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-adea4007-4590-4b72-9e88-073e46f8bbab tempest-VolumesGetTest-1169103151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:53:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-adea4007-4590-4b72-9e88-073e46f8bbab tempest-VolumesGetTest-1169103151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:53:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-adea4007-4590-4b72-9e88-073e46f8bbab tempest-VolumesGetTest-1169103151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:16 devstack sudo[104059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:53:16 devstack sudo[104059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:16 devstack cinder-volume[87507]: DEBUG cinder.coordination [req-fb9fc679-f088-4442-9570-4da9a2b96790 req-e89a352f-ab1c-47df-abd5-edb35c2267a9 tempest-VolumesSnapshotsTestJSON-1473847660 None] Acquiring lock "cinder-734e4643-0471-457c-b190-c718a8079102-delete_snapshot" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:53:16 devstack cinder-volume[87507]: DEBUG cinder.coordination [req-fb9fc679-f088-4442-9570-4da9a2b96790 req-e89a352f-ab1c-47df-abd5-edb35c2267a9 tempest-VolumesSnapshotsTestJSON-1473847660 None] Lock "cinder-734e4643-0471-457c-b190-c718a8079102-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:53:16 devstack cinder-volume[87507]: DEBUG cinder.coordination [req-fb9fc679-f088-4442-9570-4da9a2b96790 req-e89a352f-ab1c-47df-abd5-edb35c2267a9 tempest-VolumesSnapshotsTestJSON-1473847660 None] Acquiring lock "cinder-quobyte-ac6c7704-ec6f-4cca-bea2-e1b935446c3d" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:53:16 devstack cinder-volume[87507]: DEBUG cinder.coordination [req-fb9fc679-f088-4442-9570-4da9a2b96790 req-e89a352f-ab1c-47df-abd5-edb35c2267a9 tempest-VolumesSnapshotsTestJSON-1473847660 None] Lock "cinder-quobyte-ac6c7704-ec6f-4cca-bea2-e1b935446c3d" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:53:16 devstack cinder-volume[87507]: DEBUG cinder.coordination [req-fb9fc679-f088-4442-9570-4da9a2b96790 req-e89a352f-ab1c-47df-abd5-edb35c2267a9 tempest-VolumesSnapshotsTestJSON-1473847660 None] Acquiring lock "cinder-quobyte-734e4643-0471-457c-b190-c718a8079102" by "_delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:53:16 devstack cinder-volume[87507]: DEBUG cinder.coordination [req-fb9fc679-f088-4442-9570-4da9a2b96790 req-e89a352f-ab1c-47df-abd5-edb35c2267a9 tempest-VolumesSnapshotsTestJSON-1473847660 None] Lock "cinder-quobyte-734e4643-0471-457c-b190-c718a8079102" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:53:16 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [req-fb9fc679-f088-4442-9570-4da9a2b96790 req-e89a352f-ab1c-47df-abd5-edb35c2267a9 tempest-VolumesSnapshotsTestJSON-1473847660 None] Deleting offline snapshot 734e4643-0471-457c-b190-c718a8079102 of volume ac6c7704-ec6f-4cca-bea2-e1b935446c3d {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 06:53:16 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [req-fb9fc679-f088-4442-9570-4da9a2b96790 req-e89a352f-ab1c-47df-abd5-edb35c2267a9 tempest-VolumesSnapshotsTestJSON-1473847660 None] snapshot_file for this snap is: volume-ac6c7704-ec6f-4cca-bea2-e1b935446c3d.734e4643-0471-457c-b190-c718a8079102 {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 06:53:16 devstack sudo[104054]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ba6f0084-57ff-4d9d-a719-e88a3cdae0a2 tempest-SnapshotDependencyTests-1228523502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-34fb25d7-19a1-4719-942d-21cfbd3d7eeb" returned: 0 in 0.445s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:16 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-ba6f0084-57ff-4d9d-a719-e88a3cdae0a2 tempest-SnapshotDependencyTests-1228523502 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:53:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-ba6f0084-57ff-4d9d-a719-e88a3cdae0a2 tempest-SnapshotDependencyTests-1228523502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:53:16 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf680199-f3a2-48c7-b46b-f845428c118a]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:53:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [req-fb9fc679-f088-4442-9570-4da9a2b96790 req-e89a352f-ab1c-47df-abd5-edb35c2267a9 tempest-VolumesSnapshotsTestJSON-1473847660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ac6c7704-ec6f-4cca-bea2-e1b935446c3d.734e4643-0471-457c-b190-c718a8079102 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:16 devstack sudo[104059]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-adea4007-4590-4b72-9e88-073e46f8bbab tempest-VolumesGetTest-1169103151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.416s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:16 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-adea4007-4590-4b72-9e88-073e46f8bbab tempest-VolumesGetTest-1169103151 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:53:16 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ba6f0084-57ff-4d9d-a719-e88a3cdae0a2 tempest-SnapshotDependencyTests-1228523502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65420351-b7c2-4c6b-bf9a-b9109ffd1e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34fb25d7-19a1-4719-942d-21cfbd3d7eeb', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:16 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ba6f0084-57ff-4d9d-a719-e88a3cdae0a2 tempest-SnapshotDependencyTests-1228523502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fab0a65-9075-42d0-a39a-00b0f75b9124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:16 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-adea4007-4590-4b72-9e88-073e46f8bbab tempest-VolumesGetTest-1169103151 None] Deleted volume successfully. Sep 08 06:53:16 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-ba6f0084-57ff-4d9d-a719-e88a3cdae0a2 tempest-SnapshotDependencyTests-1228523502 None] Volume volume-34fb25d7-19a1-4719-942d-21cfbd3d7eeb (34fb25d7-19a1-4719-942d-21cfbd3d7eeb): created successfully Sep 08 06:53:16 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ba6f0084-57ff-4d9d-a719-e88a3cdae0a2 tempest-SnapshotDependencyTests-1228523502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fab0a65-9075-42d0-a39a-00b0f75b9124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:16 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ba6f0084-57ff-4d9d-a719-e88a3cdae0a2 tempest-SnapshotDependencyTests-1228523502 None] Flow 'volume_create_manager' (12ba379e-c554-4f56-8592-f7b59ba53b9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:53:16 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-adea4007-4590-4b72-9e88-073e46f8bbab tempest-VolumesGetTest-1169103151 None] Lock "cinder-98f595ed-3259-43cf-abc8-3d3a7273db3f-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:53:16 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-ba6f0084-57ff-4d9d-a719-e88a3cdae0a2 tempest-SnapshotDependencyTests-1228523502 None] Created volume successfully. Sep 08 06:53:16 devstack sudo[104075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ac6c7704-ec6f-4cca-bea2-e1b935446c3d.734e4643-0471-457c-b190-c718a8079102 Sep 08 06:53:16 devstack sudo[104075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:16 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-aed5e777-a71d-400c-bdf4-bd4f527bc2be tempest-VolumesGetTest-1169103151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:53:16 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-aed5e777-a71d-400c-bdf4-bd4f527bc2be tempest-VolumesGetTest-1169103151 None] Flow 'volume_create_manager' (f55c2a6b-54c4-4c6c-8f24-5f95f69f1059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:53:16 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-aed5e777-a71d-400c-bdf4-bd4f527bc2be tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19423cca-b6c2-4f62-82cc-5709f2d7e8bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:16 devstack sudo[104075]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [req-fb9fc679-f088-4442-9570-4da9a2b96790 req-e89a352f-ab1c-47df-abd5-edb35c2267a9 tempest-VolumesSnapshotsTestJSON-1473847660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ac6c7704-ec6f-4cca-bea2-e1b935446c3d.734e4643-0471-457c-b190-c718a8079102" returned: 0 in 0.446s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:16 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [req-fb9fc679-f088-4442-9570-4da9a2b96790 req-e89a352f-ab1c-47df-abd5-edb35c2267a9 tempest-VolumesSnapshotsTestJSON-1473847660 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac6c7704-ec6f-4cca-bea2-e1b935446c3d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 06:53:16 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-aed5e777-a71d-400c-bdf4-bd4f527bc2be tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19423cca-b6c2-4f62-82cc-5709f2d7e8bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:53:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1726774305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=420a03f4-8808-47e4-b770-db5bbb69492c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d485bed2a56746eebce00d898e0d496c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:53:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:53:17Z,use_quota=True,user_id='eb60e87e5f514c66b1b8c39892da34fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:16 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-aed5e777-a71d-400c-bdf4-bd4f527bc2be tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8af42a25-105e-49ea-b5ed-17112e2bfb61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:16 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-aed5e777-a71d-400c-bdf4-bd4f527bc2be tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8af42a25-105e-49ea-b5ed-17112e2bfb61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:16 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-aed5e777-a71d-400c-bdf4-bd4f527bc2be tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2426195f-5f6e-4387-b297-78a8425d1886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:16 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-aed5e777-a71d-400c-bdf4-bd4f527bc2be tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2426195f-5f6e-4387-b297-78a8425d1886) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '420a03f4-8808-47e4-b770-db5bbb69492c', 'volume_name': 'volume-420a03f4-8808-47e4-b770-db5bbb69492c', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:16 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-aed5e777-a71d-400c-bdf4-bd4f527bc2be tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b3ceee4-11f1-40b5-9da1-923dd33d5b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:16 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-aed5e777-a71d-400c-bdf4-bd4f527bc2be tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b3ceee4-11f1-40b5-9da1-923dd33d5b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:16 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-aed5e777-a71d-400c-bdf4-bd4f527bc2be tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da2b3cd2-2126-4f86-8049-6dd7daec4bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:16 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-aed5e777-a71d-400c-bdf4-bd4f527bc2be tempest-VolumesGetTest-1169103151 None] Volume 420a03f4-8808-47e4-b770-db5bbb69492c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-420a03f4-8808-47e4-b770-db5bbb69492c', 'volume_size': 1} Sep 08 06:53:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-aed5e777-a71d-400c-bdf4-bd4f527bc2be tempest-VolumesGetTest-1169103151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:53:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-aed5e777-a71d-400c-bdf4-bd4f527bc2be tempest-VolumesGetTest-1169103151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:53:16 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-aed5e777-a71d-400c-bdf4-bd4f527bc2be tempest-VolumesGetTest-1169103151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:53:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1726774305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=420a03f4-8808-47e4-b770-db5bbb69492c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d485bed2a56746eebce00d898e0d496c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:53:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:53:17Z,use_quota=True,user_id='eb60e87e5f514c66b1b8c39892da34fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:53:16 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-aed5e777-a71d-400c-bdf4-bd4f527bc2be tempest-VolumesGetTest-1169103151 None] Creating volume 420a03f4-8808-47e4-b770-db5bbb69492c {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:53:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-aed5e777-a71d-400c-bdf4-bd4f527bc2be tempest-VolumesGetTest-1169103151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:53:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-aed5e777-a71d-400c-bdf4-bd4f527bc2be tempest-VolumesGetTest-1169103151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:53:16 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-aed5e777-a71d-400c-bdf4-bd4f527bc2be tempest-VolumesGetTest-1169103151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:53:16 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-aed5e777-a71d-400c-bdf4-bd4f527bc2be tempest-VolumesGetTest-1169103151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:53:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-aed5e777-a71d-400c-bdf4-bd4f527bc2be tempest-VolumesGetTest-1169103151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:53:16 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-aed5e777-a71d-400c-bdf4-bd4f527bc2be tempest-VolumesGetTest-1169103151 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:53:16 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-aed5e777-a71d-400c-bdf4-bd4f527bc2be tempest-VolumesGetTest-1169103151 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:53:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-aed5e777-a71d-400c-bdf4-bd4f527bc2be tempest-VolumesGetTest-1169103151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-420a03f4-8808-47e4-b770-db5bbb69492c 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:16 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8cd34fa-66a4-4057-ac17-dee8e060e92b]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:53:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [req-fb9fc679-f088-4442-9570-4da9a2b96790 req-e89a352f-ab1c-47df-abd5-edb35c2267a9 tempest-VolumesSnapshotsTestJSON-1473847660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ac6c7704-ec6f-4cca-bea2-e1b935446c3d {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:16 devstack sudo[104095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-420a03f4-8808-47e4-b770-db5bbb69492c 1073741824 Sep 08 06:53:16 devstack sudo[104095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:17 devstack sudo[104096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ac6c7704-ec6f-4cca-bea2-e1b935446c3d Sep 08 06:53:17 devstack sudo[104096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-94f678b4-e27e-4a3c-8d22-92982389fd9b tempest-SnapshotDependencyTests-1228523502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:53:17 devstack sudo[104096]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [req-fb9fc679-f088-4442-9570-4da9a2b96790 req-e89a352f-ab1c-47df-abd5-edb35c2267a9 tempest-VolumesSnapshotsTestJSON-1473847660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ac6c7704-ec6f-4cca-bea2-e1b935446c3d" returned: 0 in 0.493s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [req-fb9fc679-f088-4442-9570-4da9a2b96790 req-e89a352f-ab1c-47df-abd5-edb35c2267a9 tempest-VolumesSnapshotsTestJSON-1473847660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ac6c7704-ec6f-4cca-bea2-e1b935446c3d.734e4643-0471-457c-b190-c718a8079102 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:17 devstack sudo[104122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ac6c7704-ec6f-4cca-bea2-e1b935446c3d.734e4643-0471-457c-b190-c718a8079102 Sep 08 06:53:17 devstack sudo[104122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:17 devstack sudo[104095]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-aed5e777-a71d-400c-bdf4-bd4f527bc2be tempest-VolumesGetTest-1169103151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-420a03f4-8808-47e4-b770-db5bbb69492c 1073741824" returned: 0 in 0.594s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-aed5e777-a71d-400c-bdf4-bd4f527bc2be tempest-VolumesGetTest-1169103151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-420a03f4-8808-47e4-b770-db5bbb69492c {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:17 devstack sudo[104127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-420a03f4-8808-47e4-b770-db5bbb69492c Sep 08 06:53:17 devstack sudo[104127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:17 devstack sudo[104122]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [req-fb9fc679-f088-4442-9570-4da9a2b96790 req-e89a352f-ab1c-47df-abd5-edb35c2267a9 tempest-VolumesSnapshotsTestJSON-1473847660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ac6c7704-ec6f-4cca-bea2-e1b935446c3d.734e4643-0471-457c-b190-c718a8079102" returned: 0 in 0.377s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [req-fb9fc679-f088-4442-9570-4da9a2b96790 req-e89a352f-ab1c-47df-abd5-edb35c2267a9 tempest-VolumesSnapshotsTestJSON-1473847660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ac6c7704-ec6f-4cca-bea2-e1b935446c3d.734e4643-0471-457c-b190-c718a8079102 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:17 devstack sudo[104142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ac6c7704-ec6f-4cca-bea2-e1b935446c3d.734e4643-0471-457c-b190-c718a8079102 Sep 08 06:53:17 devstack sudo[104142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:17 devstack sudo[104127]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-aed5e777-a71d-400c-bdf4-bd4f527bc2be tempest-VolumesGetTest-1169103151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-420a03f4-8808-47e4-b770-db5bbb69492c" returned: 0 in 0.299s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:17 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-aed5e777-a71d-400c-bdf4-bd4f527bc2be tempest-VolumesGetTest-1169103151 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:53:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-aed5e777-a71d-400c-bdf4-bd4f527bc2be tempest-VolumesGetTest-1169103151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:53:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-94f678b4-e27e-4a3c-8d22-92982389fd9b tempest-SnapshotDependencyTests-1228523502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.589s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:53:17 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-aed5e777-a71d-400c-bdf4-bd4f527bc2be tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da2b3cd2-2126-4f86-8049-6dd7daec4bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-420a03f4-8808-47e4-b770-db5bbb69492c', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:17 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-aed5e777-a71d-400c-bdf4-bd4f527bc2be tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0360a6c1-73e3-4e76-a568-e3a0c41d602b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:17 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-94f678b4-e27e-4a3c-8d22-92982389fd9b tempest-SnapshotDependencyTests-1228523502 None] Creating offline snapshot 9955308c-56b6-4c45-97fe-8fd5d13a4484 of volume 34fb25d7-19a1-4719-942d-21cfbd3d7eeb {{(pid=87507) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 06:53:17 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-aed5e777-a71d-400c-bdf4-bd4f527bc2be tempest-VolumesGetTest-1169103151 None] Volume volume-420a03f4-8808-47e4-b770-db5bbb69492c (420a03f4-8808-47e4-b770-db5bbb69492c): created successfully Sep 08 06:53:17 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-aed5e777-a71d-400c-bdf4-bd4f527bc2be tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0360a6c1-73e3-4e76-a568-e3a0c41d602b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:17 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-aed5e777-a71d-400c-bdf4-bd4f527bc2be tempest-VolumesGetTest-1169103151 None] Flow 'volume_create_manager' (f55c2a6b-54c4-4c6c-8f24-5f95f69f1059) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:53:17 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a12a77-bf3c-44ec-8cbb-1917153257e5]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:53:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-94f678b4-e27e-4a3c-8d22-92982389fd9b tempest-SnapshotDependencyTests-1228523502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-34fb25d7-19a1-4719-942d-21cfbd3d7eeb {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:17 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-aed5e777-a71d-400c-bdf4-bd4f527bc2be tempest-VolumesGetTest-1169103151 None] Created volume successfully. Sep 08 06:53:18 devstack sudo[104142]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:18 devstack sudo[104147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-34fb25d7-19a1-4719-942d-21cfbd3d7eeb Sep 08 06:53:18 devstack sudo[104147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [req-fb9fc679-f088-4442-9570-4da9a2b96790 req-e89a352f-ab1c-47df-abd5-edb35c2267a9 tempest-VolumesSnapshotsTestJSON-1473847660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ac6c7704-ec6f-4cca-bea2-e1b935446c3d.734e4643-0471-457c-b190-c718a8079102" returned: 0 in 0.273s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:18 devstack cinder-volume[87507]: DEBUG cinder.coordination [req-fb9fc679-f088-4442-9570-4da9a2b96790 req-e89a352f-ab1c-47df-abd5-edb35c2267a9 tempest-VolumesSnapshotsTestJSON-1473847660 None] Lock "cinder-quobyte-734e4643-0471-457c-b190-c718a8079102" released by "_delete_snapshot" :: held 1.823s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:53:18 devstack cinder-volume[87507]: DEBUG cinder.coordination [req-fb9fc679-f088-4442-9570-4da9a2b96790 req-e89a352f-ab1c-47df-abd5-edb35c2267a9 tempest-VolumesSnapshotsTestJSON-1473847660 None] Lock "cinder-quobyte-ac6c7704-ec6f-4cca-bea2-e1b935446c3d" released by "delete_snapshot" :: held 1.869s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:53:18 devstack cinder-volume[87507]: DEBUG cinder.quota [req-fb9fc679-f088-4442-9570-4da9a2b96790 req-e89a352f-ab1c-47df-abd5-edb35c2267a9 tempest-VolumesSnapshotsTestJSON-1473847660 None] Created reservations ['62e4a82b-c35e-453d-9d30-e793b91c01ee', 'bdf95784-db7f-4423-9b67-15b4d01e4047', '31d083c8-fc17-4846-ac40-ef0d8efd71ea', 'b8310aca-6ab5-450c-8316-2cede3cc552d'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:53:18 devstack cinder-volume[87507]: INFO cinder.volume.manager [req-fb9fc679-f088-4442-9570-4da9a2b96790 req-e89a352f-ab1c-47df-abd5-edb35c2267a9 tempest-VolumesSnapshotsTestJSON-1473847660 None] Delete snapshot completed successfully. Sep 08 06:53:18 devstack cinder-volume[87507]: DEBUG cinder.coordination [req-fb9fc679-f088-4442-9570-4da9a2b96790 req-e89a352f-ab1c-47df-abd5-edb35c2267a9 tempest-VolumesSnapshotsTestJSON-1473847660 None] Lock "cinder-734e4643-0471-457c-b190-c718a8079102-delete_snapshot" released by "delete_snapshot" :: held 2.039s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:53:18 devstack sudo[104147]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-94f678b4-e27e-4a3c-8d22-92982389fd9b tempest-SnapshotDependencyTests-1228523502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-34fb25d7-19a1-4719-942d-21cfbd3d7eeb" returned: 0 in 0.452s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-94f678b4-e27e-4a3c-8d22-92982389fd9b tempest-SnapshotDependencyTests-1228523502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-34fb25d7-19a1-4719-942d-21cfbd3d7eeb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-34fb25d7-19a1-4719-942d-21cfbd3d7eeb.9955308c-56b6-4c45-97fe-8fd5d13a4484 1G {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:18 devstack sudo[104168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-34fb25d7-19a1-4719-942d-21cfbd3d7eeb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-34fb25d7-19a1-4719-942d-21cfbd3d7eeb.9955308c-56b6-4c45-97fe-8fd5d13a4484 1G Sep 08 06:53:18 devstack sudo[104168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:18 devstack cinder-volume[87507]: DEBUG cinder.coordination [req-4dc3ab46-a218-42f7-88c4-d92ef7611017 req-352085ab-7e7f-443a-bab3-dfc5227f517d tempest-VolumesSnapshotsTestJSON-1473847660 None] Acquiring lock "cinder-ac6c7704-ec6f-4cca-bea2-e1b935446c3d-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:53:18 devstack cinder-volume[87507]: DEBUG cinder.coordination [req-4dc3ab46-a218-42f7-88c4-d92ef7611017 req-352085ab-7e7f-443a-bab3-dfc5227f517d tempest-VolumesSnapshotsTestJSON-1473847660 None] Lock "cinder-ac6c7704-ec6f-4cca-bea2-e1b935446c3d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:53:18 devstack cinder-volume[87507]: DEBUG cinder.coordination [req-4dc3ab46-a218-42f7-88c4-d92ef7611017 req-352085ab-7e7f-443a-bab3-dfc5227f517d tempest-VolumesSnapshotsTestJSON-1473847660 None] Acquiring lock "cinder-quobyte-ac6c7704-ec6f-4cca-bea2-e1b935446c3d" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:53:18 devstack cinder-volume[87507]: DEBUG cinder.coordination [req-4dc3ab46-a218-42f7-88c4-d92ef7611017 req-352085ab-7e7f-443a-bab3-dfc5227f517d tempest-VolumesSnapshotsTestJSON-1473847660 None] Lock "cinder-quobyte-ac6c7704-ec6f-4cca-bea2-e1b935446c3d" acquired by "delete_volume" :: waited 0.022s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:53:18 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66c08ec-7514-45de-b0e8-91e097b60ddc]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:53:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [req-4dc3ab46-a218-42f7-88c4-d92ef7611017 req-352085ab-7e7f-443a-bab3-dfc5227f517d tempest-VolumesSnapshotsTestJSON-1473847660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ac6c7704-ec6f-4cca-bea2-e1b935446c3d {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:18 devstack sudo[104178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ac6c7704-ec6f-4cca-bea2-e1b935446c3d Sep 08 06:53:18 devstack sudo[104178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:18 devstack sudo[104168]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-94f678b4-e27e-4a3c-8d22-92982389fd9b tempest-SnapshotDependencyTests-1228523502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-34fb25d7-19a1-4719-942d-21cfbd3d7eeb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-34fb25d7-19a1-4719-942d-21cfbd3d7eeb.9955308c-56b6-4c45-97fe-8fd5d13a4484 1G" returned: 0 in 0.487s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-94f678b4-e27e-4a3c-8d22-92982389fd9b tempest-SnapshotDependencyTests-1228523502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34fb25d7-19a1-4719-942d-21cfbd3d7eeb -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-34fb25d7-19a1-4719-942d-21cfbd3d7eeb.9955308c-56b6-4c45-97fe-8fd5d13a4484 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:18 devstack sudo[104188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34fb25d7-19a1-4719-942d-21cfbd3d7eeb -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-34fb25d7-19a1-4719-942d-21cfbd3d7eeb.9955308c-56b6-4c45-97fe-8fd5d13a4484 Sep 08 06:53:18 devstack sudo[104188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:19 devstack sudo[104178]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [req-4dc3ab46-a218-42f7-88c4-d92ef7611017 req-352085ab-7e7f-443a-bab3-dfc5227f517d tempest-VolumesSnapshotsTestJSON-1473847660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ac6c7704-ec6f-4cca-bea2-e1b935446c3d" returned: 0 in 0.464s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [req-4dc3ab46-a218-42f7-88c4-d92ef7611017 req-352085ab-7e7f-443a-bab3-dfc5227f517d tempest-VolumesSnapshotsTestJSON-1473847660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ac6c7704-ec6f-4cca-bea2-e1b935446c3d {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:19 devstack sudo[104202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ac6c7704-ec6f-4cca-bea2-e1b935446c3d Sep 08 06:53:19 devstack sudo[104202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:19 devstack sudo[104188]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-94f678b4-e27e-4a3c-8d22-92982389fd9b tempest-SnapshotDependencyTests-1228523502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34fb25d7-19a1-4719-942d-21cfbd3d7eeb -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-34fb25d7-19a1-4719-942d-21cfbd3d7eeb.9955308c-56b6-4c45-97fe-8fd5d13a4484" returned: 0 in 0.391s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:19 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-94f678b4-e27e-4a3c-8d22-92982389fd9b tempest-SnapshotDependencyTests-1228523502 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-34fb25d7-19a1-4719-942d-21cfbd3d7eeb.9955308c-56b6-4c45-97fe-8fd5d13a4484 is being set with open permissions: ugo+rw Sep 08 06:53:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-94f678b4-e27e-4a3c-8d22-92982389fd9b tempest-SnapshotDependencyTests-1228523502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-34fb25d7-19a1-4719-942d-21cfbd3d7eeb.9955308c-56b6-4c45-97fe-8fd5d13a4484 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:19 devstack sudo[104210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-34fb25d7-19a1-4719-942d-21cfbd3d7eeb.9955308c-56b6-4c45-97fe-8fd5d13a4484 Sep 08 06:53:19 devstack sudo[104210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:19 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:53:19 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] Flow 'volume_create_manager' (b77e9b3e-5a7a-40e2-8b5b-be108e682745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:53:19 devstack sudo[104202]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:19 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa15e5e5-554c-4b79-97d2-c862b086267b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [req-4dc3ab46-a218-42f7-88c4-d92ef7611017 req-352085ab-7e7f-443a-bab3-dfc5227f517d tempest-VolumesSnapshotsTestJSON-1473847660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ac6c7704-ec6f-4cca-bea2-e1b935446c3d" returned: 0 in 0.456s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:19 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa15e5e5-554c-4b79-97d2-c862b086267b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:53:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2125863184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66a2d426-56a4-4aaf-871e-a558b34caf83,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d485bed2a56746eebce00d898e0d496c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:53:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=420a03f4-8808-47e4-b770-db5bbb69492c,status='creating',terminated_at=None,updated_at=2026-09-08T04:53:19Z,use_quota=True,user_id='eb60e87e5f514c66b1b8c39892da34fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:19 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c7de31e-418f-4f23-89ab-093731100029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:19 devstack sudo[104210]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:19 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c7de31e-418f-4f23-89ab-093731100029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:19 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (385971f1-9e59-4996-bca2-92355a7efca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:19 devstack cinder-volume[87507]: DEBUG cinder.coordination [req-4dc3ab46-a218-42f7-88c4-d92ef7611017 req-352085ab-7e7f-443a-bab3-dfc5227f517d tempest-VolumesSnapshotsTestJSON-1473847660 None] Lock "cinder-quobyte-ac6c7704-ec6f-4cca-bea2-e1b935446c3d" released by "delete_volume" :: held 1.013s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:53:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-94f678b4-e27e-4a3c-8d22-92982389fd9b tempest-SnapshotDependencyTests-1228523502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-34fb25d7-19a1-4719-942d-21cfbd3d7eeb.9955308c-56b6-4c45-97fe-8fd5d13a4484" returned: 0 in 0.344s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:19 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (385971f1-9e59-4996-bca2-92355a7efca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '66a2d426-56a4-4aaf-871e-a558b34caf83', 'volume_name': 'volume-66a2d426-56a4-4aaf-871e-a558b34caf83', 'volume_size': 1, 'source_volid': '420a03f4-8808-47e4-b770-db5bbb69492c', 'source_volstatus': 'available'}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:19 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c273dd64-7f4a-49db-80ca-161f244aa23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:19 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c273dd64-7f4a-49db-80ca-161f244aa23e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:19 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f20043cc-8f5f-4f60-90c2-ca69bcfc7a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:19 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] Volume 66a2d426-56a4-4aaf-871e-a558b34caf83: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-66a2d426-56a4-4aaf-871e-a558b34caf83', 'volume_size': 1, 'source_volid': '420a03f4-8808-47e4-b770-db5bbb69492c', 'source_volstatus': 'available'} Sep 08 06:53:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:53:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-94f678b4-e27e-4a3c-8d22-92982389fd9b tempest-SnapshotDependencyTests-1228523502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-34fb25d7-19a1-4719-942d-21cfbd3d7eeb.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:19 devstack sudo[104228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-34fb25d7-19a1-4719-942d-21cfbd3d7eeb.info Sep 08 06:53:19 devstack sudo[104228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:19 devstack cinder-volume[87507]: DEBUG cinder.quota [req-4dc3ab46-a218-42f7-88c4-d92ef7611017 req-352085ab-7e7f-443a-bab3-dfc5227f517d tempest-VolumesSnapshotsTestJSON-1473847660 None] Created reservations ['181baae0-bf34-4cd0-a60f-3f74c4d20404', 'd2288475-4790-4300-9b46-32908f58a94d', '98e053a8-6a5c-4f48-8a7f-672960233f56', 'baa51727-5dc2-4cfb-a4e6-b699875e296f'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:53:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-4dc3ab46-a218-42f7-88c4-d92ef7611017 req-352085ab-7e7f-443a-bab3-dfc5227f517d tempest-VolumesSnapshotsTestJSON-1473847660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:53:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-4dc3ab46-a218-42f7-88c4-d92ef7611017 req-352085ab-7e7f-443a-bab3-dfc5227f517d tempest-VolumesSnapshotsTestJSON-1473847660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:53:19 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [req-4dc3ab46-a218-42f7-88c4-d92ef7611017 req-352085ab-7e7f-443a-bab3-dfc5227f517d tempest-VolumesSnapshotsTestJSON-1473847660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:53:19 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [req-4dc3ab46-a218-42f7-88c4-d92ef7611017 req-352085ab-7e7f-443a-bab3-dfc5227f517d tempest-VolumesSnapshotsTestJSON-1473847660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:53:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-4dc3ab46-a218-42f7-88c4-d92ef7611017 req-352085ab-7e7f-443a-bab3-dfc5227f517d tempest-VolumesSnapshotsTestJSON-1473847660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:53:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [req-4dc3ab46-a218-42f7-88c4-d92ef7611017 req-352085ab-7e7f-443a-bab3-dfc5227f517d tempest-VolumesSnapshotsTestJSON-1473847660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:19 devstack sudo[104234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:53:19 devstack sudo[104234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:20 devstack sudo[104228]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-94f678b4-e27e-4a3c-8d22-92982389fd9b tempest-SnapshotDependencyTests-1228523502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-34fb25d7-19a1-4719-942d-21cfbd3d7eeb.info" returned: 0 in 0.296s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:20 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-94f678b4-e27e-4a3c-8d22-92982389fd9b tempest-SnapshotDependencyTests-1228523502 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-34fb25d7-19a1-4719-942d-21cfbd3d7eeb.info is being set with open permissions: ugo+rw Sep 08 06:53:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-94f678b4-e27e-4a3c-8d22-92982389fd9b tempest-SnapshotDependencyTests-1228523502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-34fb25d7-19a1-4719-942d-21cfbd3d7eeb.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:20 devstack cinder-volume[87507]: DEBUG oslo_service.periodic_task [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87507) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 06:53:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:53:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:53:20 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:53:20 devstack sudo[104242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-34fb25d7-19a1-4719-942d-21cfbd3d7eeb.info Sep 08 06:53:20 devstack sudo[104242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:20 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:53:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:53:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:20 devstack sudo[104245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:53:20 devstack sudo[104245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:20 devstack sudo[104234]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [req-4dc3ab46-a218-42f7-88c4-d92ef7611017 req-352085ab-7e7f-443a-bab3-dfc5227f517d tempest-VolumesSnapshotsTestJSON-1473847660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.301s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:20 devstack cinder-volume[87507]: DEBUG cinder.manager [req-4dc3ab46-a218-42f7-88c4-d92ef7611017 req-352085ab-7e7f-443a-bab3-dfc5227f517d tempest-VolumesSnapshotsTestJSON-1473847660 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:53:20 devstack cinder-volume[87507]: INFO cinder.volume.manager [req-4dc3ab46-a218-42f7-88c4-d92ef7611017 req-352085ab-7e7f-443a-bab3-dfc5227f517d tempest-VolumesSnapshotsTestJSON-1473847660 None] Deleted volume successfully. Sep 08 06:53:20 devstack cinder-volume[87507]: DEBUG cinder.coordination [req-4dc3ab46-a218-42f7-88c4-d92ef7611017 req-352085ab-7e7f-443a-bab3-dfc5227f517d tempest-VolumesSnapshotsTestJSON-1473847660 None] Lock "cinder-ac6c7704-ec6f-4cca-bea2-e1b935446c3d-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:53:20 devstack sudo[104242]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-94f678b4-e27e-4a3c-8d22-92982389fd9b tempest-SnapshotDependencyTests-1228523502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-34fb25d7-19a1-4719-942d-21cfbd3d7eeb.info" returned: 0 in 0.316s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-94f678b4-e27e-4a3c-8d22-92982389fd9b tempest-SnapshotDependencyTests-1228523502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.481s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:53:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.659s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:53:20 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] Cloning volume 420a03f4-8808-47e4-b770-db5bbb69492c to volume 66a2d426-56a4-4aaf-871e-a558b34caf83 Sep 08 06:53:20 devstack sudo[104245]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.339s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:20 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:53:20 devstack cinder-volume[87507]: DEBUG oslo_service.periodic_task [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Running periodic task VolumeManager._thread_info {{(pid=87507) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 06:53:20 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] thread count: 29 {{(pid=87507) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 06:53:20 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] thread info: [<_MainThread(MainThread, started 127913129345152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87507) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 06:53:20 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-94f678b4-e27e-4a3c-8d22-92982389fd9b tempest-SnapshotDependencyTests-1228523502 None] Create snapshot completed successfully Sep 08 06:53:20 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] Creating offline snapshot bffd4395-4fe6-4752-a81e-9503304b2204 of volume 420a03f4-8808-47e4-b770-db5bbb69492c {{(pid=87507) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 06:53:20 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d77041d-d3ec-4c1f-a6fd-5ec93d821b0c]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:53:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-420a03f4-8808-47e4-b770-db5bbb69492c {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:20 devstack sudo[104263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-420a03f4-8808-47e4-b770-db5bbb69492c Sep 08 06:53:20 devstack sudo[104263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:20 devstack sudo[104263]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-420a03f4-8808-47e4-b770-db5bbb69492c" returned: 0 in 0.423s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-420a03f4-8808-47e4-b770-db5bbb69492c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-420a03f4-8808-47e4-b770-db5bbb69492c.bffd4395-4fe6-4752-a81e-9503304b2204 1G {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:20 devstack sudo[104280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-420a03f4-8808-47e4-b770-db5bbb69492c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-420a03f4-8808-47e4-b770-db5bbb69492c.bffd4395-4fe6-4752-a81e-9503304b2204 1G Sep 08 06:53:20 devstack sudo[104280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:21 devstack sudo[104280]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:21 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-420a03f4-8808-47e4-b770-db5bbb69492c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-420a03f4-8808-47e4-b770-db5bbb69492c.bffd4395-4fe6-4752-a81e-9503304b2204 1G" returned: 0 in 0.506s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:21 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-420a03f4-8808-47e4-b770-db5bbb69492c -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-420a03f4-8808-47e4-b770-db5bbb69492c.bffd4395-4fe6-4752-a81e-9503304b2204 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:21 devstack sudo[104335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-420a03f4-8808-47e4-b770-db5bbb69492c -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-420a03f4-8808-47e4-b770-db5bbb69492c.bffd4395-4fe6-4752-a81e-9503304b2204 Sep 08 06:53:21 devstack sudo[104335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:21 devstack sudo[104335]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:21 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-420a03f4-8808-47e4-b770-db5bbb69492c -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-420a03f4-8808-47e4-b770-db5bbb69492c.bffd4395-4fe6-4752-a81e-9503304b2204" returned: 0 in 0.483s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:21 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-420a03f4-8808-47e4-b770-db5bbb69492c.bffd4395-4fe6-4752-a81e-9503304b2204 is being set with open permissions: ugo+rw Sep 08 06:53:21 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-420a03f4-8808-47e4-b770-db5bbb69492c.bffd4395-4fe6-4752-a81e-9503304b2204 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:21 devstack sudo[104355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-420a03f4-8808-47e4-b770-db5bbb69492c.bffd4395-4fe6-4752-a81e-9503304b2204 Sep 08 06:53:21 devstack sudo[104355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:22 devstack sudo[104355]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:22 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-420a03f4-8808-47e4-b770-db5bbb69492c.bffd4395-4fe6-4752-a81e-9503304b2204" returned: 0 in 0.494s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:22 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4d246ec-49f3-4c54-be37-b3fef0e99d59 tempest-SnapshotDependencyTests-1228523502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:53:22 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-420a03f4-8808-47e4-b770-db5bbb69492c.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:22 devstack sudo[104377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-420a03f4-8808-47e4-b770-db5bbb69492c.info Sep 08 06:53:22 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a4d246ec-49f3-4c54-be37-b3fef0e99d59 tempest-SnapshotDependencyTests-1228523502 None] Flow 'volume_create_manager' (faa86c88-7ccb-44de-8348-32883b1ed41b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:53:22 devstack sudo[104377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:22 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a4d246ec-49f3-4c54-be37-b3fef0e99d59 tempest-SnapshotDependencyTests-1228523502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad79bd78-f67a-4fb0-9416-cd94d9e09213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:22 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a4d246ec-49f3-4c54-be37-b3fef0e99d59 tempest-SnapshotDependencyTests-1228523502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad79bd78-f67a-4fb0-9416-cd94d9e09213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:53:22Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13558b60-dd02-47d6-a34e-2ac36ebaa558,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3cb00c6bffd401c9f4b4360affd6dce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:53:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9955308c-56b6-4c45-97fe-8fd5d13a4484,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:53:22Z,use_quota=True,user_id='59ce6b1a7feb41d096026bdc9e457cd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:22 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a4d246ec-49f3-4c54-be37-b3fef0e99d59 tempest-SnapshotDependencyTests-1228523502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44aebd77-8bdc-4526-99a3-358c60d177b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:22 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a4d246ec-49f3-4c54-be37-b3fef0e99d59 tempest-SnapshotDependencyTests-1228523502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44aebd77-8bdc-4526-99a3-358c60d177b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:22 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a4d246ec-49f3-4c54-be37-b3fef0e99d59 tempest-SnapshotDependencyTests-1228523502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1e25afd-59b9-413f-8e90-84169ce2f325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:22 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a4d246ec-49f3-4c54-be37-b3fef0e99d59 tempest-SnapshotDependencyTests-1228523502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1e25afd-59b9-413f-8e90-84169ce2f325) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '13558b60-dd02-47d6-a34e-2ac36ebaa558', 'volume_name': 'volume-13558b60-dd02-47d6-a34e-2ac36ebaa558', 'volume_size': 1, 'snapshot_id': '9955308c-56b6-4c45-97fe-8fd5d13a4484'}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:22 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a4d246ec-49f3-4c54-be37-b3fef0e99d59 tempest-SnapshotDependencyTests-1228523502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cab77ef-0526-4cad-a2b7-530738d9f664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:22 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a4d246ec-49f3-4c54-be37-b3fef0e99d59 tempest-SnapshotDependencyTests-1228523502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cab77ef-0526-4cad-a2b7-530738d9f664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:22 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a4d246ec-49f3-4c54-be37-b3fef0e99d59 tempest-SnapshotDependencyTests-1228523502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93a20586-9f9e-4d92-b863-4afd21f40aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:22 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-a4d246ec-49f3-4c54-be37-b3fef0e99d59 tempest-SnapshotDependencyTests-1228523502 None] Volume 13558b60-dd02-47d6-a34e-2ac36ebaa558: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-13558b60-dd02-47d6-a34e-2ac36ebaa558', 'volume_size': 1, 'snapshot_id': '9955308c-56b6-4c45-97fe-8fd5d13a4484'} Sep 08 06:53:22 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a4d246ec-49f3-4c54-be37-b3fef0e99d59 tempest-SnapshotDependencyTests-1228523502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:53:22 devstack sudo[104377]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:22 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-420a03f4-8808-47e4-b770-db5bbb69492c.info" returned: 0 in 0.353s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:22 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-420a03f4-8808-47e4-b770-db5bbb69492c.info is being set with open permissions: ugo+rw Sep 08 06:53:22 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-420a03f4-8808-47e4-b770-db5bbb69492c.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:22 devstack sudo[104391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-420a03f4-8808-47e4-b770-db5bbb69492c.info Sep 08 06:53:22 devstack sudo[104391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:23 devstack sudo[104391]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-420a03f4-8808-47e4-b770-db5bbb69492c.info" returned: 0 in 0.284s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:23 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] Acquiring lock "cinder-quobyte-66a2d426-56a4-4aaf-871e-a558b34caf83" by "_copy_volume_from_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:53:23 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] Lock "cinder-quobyte-66a2d426-56a4-4aaf-871e-a558b34caf83" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:53:23 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] snapshot: bffd4395-4fe6-4752-a81e-9503304b2204, volume: 66a2d426-56a4-4aaf-871e-a558b34caf83, {{(pid=87507) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 08 06:53:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:53:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:53:23 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:53:23 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:53:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:53:23 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8567061f-ad63-4002-b2d8-84fd1622bf03]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:53:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-420a03f4-8808-47e4-b770-db5bbb69492c.bffd4395-4fe6-4752-a81e-9503304b2204 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:23 devstack sudo[104406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-420a03f4-8808-47e4-b770-db5bbb69492c.bffd4395-4fe6-4752-a81e-9503304b2204 Sep 08 06:53:23 devstack sudo[104406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:23 devstack sudo[104406]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-420a03f4-8808-47e4-b770-db5bbb69492c.bffd4395-4fe6-4752-a81e-9503304b2204" returned: 0 in 0.409s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:23 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-420a03f4-8808-47e4-b770-db5bbb69492c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 06:53:23 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d09f3a55-2743-4c3e-8054-4ee7b25b5836]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:53:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-420a03f4-8808-47e4-b770-db5bbb69492c {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:23 devstack sudo[104423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-420a03f4-8808-47e4-b770-db5bbb69492c Sep 08 06:53:23 devstack sudo[104423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:24 devstack sudo[104423]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-420a03f4-8808-47e4-b770-db5bbb69492c" returned: 0 in 0.473s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:24 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] will copy from snapshot at /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-420a03f4-8808-47e4-b770-db5bbb69492c {{(pid=87507) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 08 06:53:24 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] Creating direct copy from snapshot {{(pid=87507) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 08 06:53:24 devstack cinder-volume[87507]: DEBUG cinder.utils [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] Path /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-66a2d426-56a4-4aaf-871e-a558b34caf83 not found in is_blk_device check {{(pid=87507) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 08 06:53:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-420a03f4-8808-47e4-b770-db5bbb69492c /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-66a2d426-56a4-4aaf-871e-a558b34caf83 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:24 devstack sudo[104443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-420a03f4-8808-47e4-b770-db5bbb69492c /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-66a2d426-56a4-4aaf-871e-a558b34caf83 Sep 08 06:53:24 devstack sudo[104443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:24 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4eadcdf-fbfe-44d7-9246-fbcd7e67809a tempest-VolumesCloneNegativeTest-228118752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:53:24 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b4eadcdf-fbfe-44d7-9246-fbcd7e67809a tempest-VolumesCloneNegativeTest-228118752 None] Flow 'volume_create_manager' (fb733af7-b562-434b-84ca-e3d2c627c505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:53:24 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b4eadcdf-fbfe-44d7-9246-fbcd7e67809a tempest-VolumesCloneNegativeTest-228118752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f059356-7dee-4dd0-a899-b709e9b6041f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:24 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b4eadcdf-fbfe-44d7-9246-fbcd7e67809a tempest-VolumesCloneNegativeTest-228118752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f059356-7dee-4dd0-a899-b709e9b6041f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:53:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-929375796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ead529b1-e599-4079-94ce-28de781b24af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35426c595f394c06ae93c23a9e03e7da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:53:24Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:53:24Z,use_quota=True,user_id='937332a28a764ffba350471a913418e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:24 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b4eadcdf-fbfe-44d7-9246-fbcd7e67809a tempest-VolumesCloneNegativeTest-228118752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b52ca9e7-7691-4f02-ba07-bc11718388a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:24 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b4eadcdf-fbfe-44d7-9246-fbcd7e67809a tempest-VolumesCloneNegativeTest-228118752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b52ca9e7-7691-4f02-ba07-bc11718388a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:24 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b4eadcdf-fbfe-44d7-9246-fbcd7e67809a tempest-VolumesCloneNegativeTest-228118752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06b00715-2844-49ee-8042-00596ca2ab31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:24 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b4eadcdf-fbfe-44d7-9246-fbcd7e67809a tempest-VolumesCloneNegativeTest-228118752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06b00715-2844-49ee-8042-00596ca2ab31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ead529b1-e599-4079-94ce-28de781b24af', 'volume_name': 'volume-ead529b1-e599-4079-94ce-28de781b24af', 'volume_size': 2}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:24 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b4eadcdf-fbfe-44d7-9246-fbcd7e67809a tempest-VolumesCloneNegativeTest-228118752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f826e057-2b06-42fd-b55c-5de2c76bb840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:24 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b4eadcdf-fbfe-44d7-9246-fbcd7e67809a tempest-VolumesCloneNegativeTest-228118752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f826e057-2b06-42fd-b55c-5de2c76bb840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:24 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b4eadcdf-fbfe-44d7-9246-fbcd7e67809a tempest-VolumesCloneNegativeTest-228118752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c124dab-dd17-42b4-8fb6-bbcdade88ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:24 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-b4eadcdf-fbfe-44d7-9246-fbcd7e67809a tempest-VolumesCloneNegativeTest-228118752 None] Volume ead529b1-e599-4079-94ce-28de781b24af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ead529b1-e599-4079-94ce-28de781b24af', 'volume_size': 2} Sep 08 06:53:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b4eadcdf-fbfe-44d7-9246-fbcd7e67809a tempest-VolumesCloneNegativeTest-228118752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:53:27 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-98c12817-b17c-4b10-b687-212c9893281d tempest-GroupSnapshotsV319Test-2145241500 None] Group tempest-GroupSnapshotsV319Test-Group-635137488: creating Sep 08 06:53:27 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-98c12817-b17c-4b10-b687-212c9893281d tempest-GroupSnapshotsV319Test-2145241500 None] Group tempest-GroupSnapshotsV319Test-Group-635137488: created successfully Sep 08 06:53:27 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-98c12817-b17c-4b10-b687-212c9893281d tempest-GroupSnapshotsV319Test-2145241500 None] Create group completed successfully. Sep 08 06:53:29 devstack sudo[104443]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:29 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-420a03f4-8808-47e4-b770-db5bbb69492c /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-66a2d426-56a4-4aaf-871e-a558b34caf83" returned: 0 in 5.044s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:29 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] Image conversion details: src /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-420a03f4-8808-47e4-b770-db5bbb69492c, size 1024.00 MB, duration 5.04 sec, destination /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-66a2d426-56a4-4aaf-871e-a558b34caf83 {{(pid=87507) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 06:53:29 devstack cinder-volume[87507]: INFO cinder.image.image_utils [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] Converted 1024.00 MB image at 202.98 MB/s Sep 08 06:53:29 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-66a2d426-56a4-4aaf-871e-a558b34caf83 is being set with open permissions: ugo+rw Sep 08 06:53:29 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-66a2d426-56a4-4aaf-871e-a558b34caf83 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:29 devstack sudo[104607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-66a2d426-56a4-4aaf-871e-a558b34caf83 Sep 08 06:53:29 devstack sudo[104607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:29 devstack sudo[104607]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:29 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-66a2d426-56a4-4aaf-871e-a558b34caf83" returned: 0 in 0.269s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:29 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] Lock "cinder-quobyte-66a2d426-56a4-4aaf-871e-a558b34caf83" released by "_copy_volume_from_snapshot" :: held 6.290s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:53:29 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] Acquiring lock "cinder-quobyte-bffd4395-4fe6-4752-a81e-9503304b2204" by "_delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:53:29 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] Lock "cinder-quobyte-bffd4395-4fe6-4752-a81e-9503304b2204" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:53:29 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] Deleting offline snapshot bffd4395-4fe6-4752-a81e-9503304b2204 of volume 420a03f4-8808-47e4-b770-db5bbb69492c {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 06:53:29 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] snapshot_file for this snap is: volume-420a03f4-8808-47e4-b770-db5bbb69492c.bffd4395-4fe6-4752-a81e-9503304b2204 {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 06:53:29 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad37a78-cbd8-4a4f-ace8-2db0fe0228fd]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:53:29 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-420a03f4-8808-47e4-b770-db5bbb69492c.bffd4395-4fe6-4752-a81e-9503304b2204 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:29 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc9cbfa7-01f1-4ab9-aa02-9315548eca5c tempest-GroupSnapshotsV319Test-2145241500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:53:29 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-cc9cbfa7-01f1-4ab9-aa02-9315548eca5c tempest-GroupSnapshotsV319Test-2145241500 None] Flow 'volume_create_manager' (9d0a8858-20b0-4227-98b2-c731a1e8d4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:53:29 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-cc9cbfa7-01f1-4ab9-aa02-9315548eca5c tempest-GroupSnapshotsV319Test-2145241500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ddccca1-d4e2-4820-8de3-c590dcbc01d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:29 devstack sudo[104619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-420a03f4-8808-47e4-b770-db5bbb69492c.bffd4395-4fe6-4752-a81e-9503304b2204 Sep 08 06:53:29 devstack sudo[104619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:29 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-cc9cbfa7-01f1-4ab9-aa02-9315548eca5c tempest-GroupSnapshotsV319Test-2145241500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ddccca1-d4e2-4820-8de3-c590dcbc01d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:53:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-469953987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5dd7ce15-9db1-48f9-ba13-35684046567f,host='devstack@QuobyteHD#QuobyteHD',id=4d08dbe7-a278-4e56-8745-e8e3473f87a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a650cd560878481db61bddf282d8500d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:53:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:53:30Z,use_quota=True,user_id='9ae6dad7e0534b4aa3d368a131c9a4a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a46c8069-e231-4593-808a-8a6e2cf6e939),volume_type_id=a46c8069-e231-4593-808a-8a6e2cf6e939)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:29 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-cc9cbfa7-01f1-4ab9-aa02-9315548eca5c tempest-GroupSnapshotsV319Test-2145241500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2c99068-9b2f-41a9-a40e-2b0cc74b9ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:29 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-cc9cbfa7-01f1-4ab9-aa02-9315548eca5c tempest-GroupSnapshotsV319Test-2145241500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2c99068-9b2f-41a9-a40e-2b0cc74b9ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:29 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-cc9cbfa7-01f1-4ab9-aa02-9315548eca5c tempest-GroupSnapshotsV319Test-2145241500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c50f4623-289c-42f2-a45d-89b3d1a5bb48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:29 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-cc9cbfa7-01f1-4ab9-aa02-9315548eca5c tempest-GroupSnapshotsV319Test-2145241500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c50f4623-289c-42f2-a45d-89b3d1a5bb48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d08dbe7-a278-4e56-8745-e8e3473f87a6', 'volume_name': 'volume-4d08dbe7-a278-4e56-8745-e8e3473f87a6', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:29 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-cc9cbfa7-01f1-4ab9-aa02-9315548eca5c tempest-GroupSnapshotsV319Test-2145241500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0efb395b-b3bf-4f88-99cf-853a54bececd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:29 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-cc9cbfa7-01f1-4ab9-aa02-9315548eca5c tempest-GroupSnapshotsV319Test-2145241500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0efb395b-b3bf-4f88-99cf-853a54bececd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:29 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-cc9cbfa7-01f1-4ab9-aa02-9315548eca5c tempest-GroupSnapshotsV319Test-2145241500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bca748d3-b9ce-4b17-9c82-56942aace9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:29 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-cc9cbfa7-01f1-4ab9-aa02-9315548eca5c tempest-GroupSnapshotsV319Test-2145241500 None] Volume 4d08dbe7-a278-4e56-8745-e8e3473f87a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d08dbe7-a278-4e56-8745-e8e3473f87a6', 'volume_size': 1} Sep 08 06:53:29 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-cc9cbfa7-01f1-4ab9-aa02-9315548eca5c tempest-GroupSnapshotsV319Test-2145241500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:53:29 devstack sudo[104619]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:29 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-420a03f4-8808-47e4-b770-db5bbb69492c.bffd4395-4fe6-4752-a81e-9503304b2204" returned: 0 in 0.380s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:29 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-420a03f4-8808-47e4-b770-db5bbb69492c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 06:53:29 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f3e25e-4a17-456e-8c72-33cbd47502a2]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:53:29 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-420a03f4-8808-47e4-b770-db5bbb69492c {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:30 devstack sudo[104636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-420a03f4-8808-47e4-b770-db5bbb69492c Sep 08 06:53:30 devstack sudo[104636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:30 devstack sudo[104636]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:30 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-420a03f4-8808-47e4-b770-db5bbb69492c" returned: 0 in 0.524s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:30 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-420a03f4-8808-47e4-b770-db5bbb69492c.bffd4395-4fe6-4752-a81e-9503304b2204 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:30 devstack sudo[104656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-420a03f4-8808-47e4-b770-db5bbb69492c.bffd4395-4fe6-4752-a81e-9503304b2204 Sep 08 06:53:30 devstack sudo[104656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:30 devstack sudo[104656]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:30 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-420a03f4-8808-47e4-b770-db5bbb69492c.bffd4395-4fe6-4752-a81e-9503304b2204" returned: 0 in 0.330s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:30 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-420a03f4-8808-47e4-b770-db5bbb69492c.bffd4395-4fe6-4752-a81e-9503304b2204 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:30 devstack sudo[104673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-420a03f4-8808-47e4-b770-db5bbb69492c.bffd4395-4fe6-4752-a81e-9503304b2204 Sep 08 06:53:30 devstack sudo[104673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:30 devstack sudo[104673]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:30 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-420a03f4-8808-47e4-b770-db5bbb69492c.bffd4395-4fe6-4752-a81e-9503304b2204" returned: 0 in 0.242s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:31 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] Lock "cinder-quobyte-bffd4395-4fe6-4752-a81e-9503304b2204" released by "_delete_snapshot" :: held 1.573s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:53:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.686s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:53:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a4d246ec-49f3-4c54-be37-b3fef0e99d59 tempest-SnapshotDependencyTests-1228523502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 8.486s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:53:31 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-a4d246ec-49f3-4c54-be37-b3fef0e99d59 tempest-SnapshotDependencyTests-1228523502 None] Acquiring lock "cinder-quobyte-9955308c-56b6-4c45-97fe-8fd5d13a4484-13558b60-dd02-47d6-a34e-2ac36ebaa558" by "_create_volume_from_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:53:31 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f20043cc-8f5f-4f60-90c2-ca69bcfc7a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66a2d426-56a4-4aaf-871e-a558b34caf83', 'volume_size': 1, 'source_volid': '420a03f4-8808-47e4-b770-db5bbb69492c', 'source_volstatus': 'available'}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:31 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f17aabee-9063-4e8f-9a0a-f5dded27912b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:31 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-a4d246ec-49f3-4c54-be37-b3fef0e99d59 tempest-SnapshotDependencyTests-1228523502 None] Lock "cinder-quobyte-9955308c-56b6-4c45-97fe-8fd5d13a4484-13558b60-dd02-47d6-a34e-2ac36ebaa558" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:53:31 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-a4d246ec-49f3-4c54-be37-b3fef0e99d59 tempest-SnapshotDependencyTests-1228523502 None] Creating volume 13558b60-dd02-47d6-a34e-2ac36ebaa558 from snapshot 9955308c-56b6-4c45-97fe-8fd5d13a4484 {{(pid=87507) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 08 06:53:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a4d246ec-49f3-4c54-be37-b3fef0e99d59 tempest-SnapshotDependencyTests-1228523502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:53:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a4d246ec-49f3-4c54-be37-b3fef0e99d59 tempest-SnapshotDependencyTests-1228523502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:53:31 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-a4d246ec-49f3-4c54-be37-b3fef0e99d59 tempest-SnapshotDependencyTests-1228523502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:53:31 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-a4d246ec-49f3-4c54-be37-b3fef0e99d59 tempest-SnapshotDependencyTests-1228523502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:53:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a4d246ec-49f3-4c54-be37-b3fef0e99d59 tempest-SnapshotDependencyTests-1228523502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:53:31 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-a4d246ec-49f3-4c54-be37-b3fef0e99d59 tempest-SnapshotDependencyTests-1228523502 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:53:31 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-a4d246ec-49f3-4c54-be37-b3fef0e99d59 tempest-SnapshotDependencyTests-1228523502 None] Acquiring lock "cinder-quobyte-13558b60-dd02-47d6-a34e-2ac36ebaa558" by "_copy_volume_from_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:53:31 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] Volume volume-66a2d426-56a4-4aaf-871e-a558b34caf83 (66a2d426-56a4-4aaf-871e-a558b34caf83): created successfully Sep 08 06:53:31 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f17aabee-9063-4e8f-9a0a-f5dded27912b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:31 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] Flow 'volume_create_manager' (b77e9b3e-5a7a-40e2-8b5b-be108e682745) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:53:31 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-a4d246ec-49f3-4c54-be37-b3fef0e99d59 tempest-SnapshotDependencyTests-1228523502 None] Lock "cinder-quobyte-13558b60-dd02-47d6-a34e-2ac36ebaa558" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:53:31 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-a4d246ec-49f3-4c54-be37-b3fef0e99d59 tempest-SnapshotDependencyTests-1228523502 None] snapshot: 9955308c-56b6-4c45-97fe-8fd5d13a4484, volume: 13558b60-dd02-47d6-a34e-2ac36ebaa558, {{(pid=87507) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 08 06:53:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a4d246ec-49f3-4c54-be37-b3fef0e99d59 tempest-SnapshotDependencyTests-1228523502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:53:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a4d246ec-49f3-4c54-be37-b3fef0e99d59 tempest-SnapshotDependencyTests-1228523502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:53:31 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-a4d246ec-49f3-4c54-be37-b3fef0e99d59 tempest-SnapshotDependencyTests-1228523502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:53:31 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-a4d246ec-49f3-4c54-be37-b3fef0e99d59 tempest-SnapshotDependencyTests-1228523502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:53:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a4d246ec-49f3-4c54-be37-b3fef0e99d59 tempest-SnapshotDependencyTests-1228523502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:53:31 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-3724ec6a-c59c-4821-baee-9b95cdfa7bb2 tempest-VolumesGetTest-1169103151 None] Created volume successfully. Sep 08 06:53:31 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb9fc8e-c0d8-4402-a20f-f2550da671ac]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:53:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a4d246ec-49f3-4c54-be37-b3fef0e99d59 tempest-SnapshotDependencyTests-1228523502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-34fb25d7-19a1-4719-942d-21cfbd3d7eeb.9955308c-56b6-4c45-97fe-8fd5d13a4484 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:31 devstack sudo[104688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-34fb25d7-19a1-4719-942d-21cfbd3d7eeb.9955308c-56b6-4c45-97fe-8fd5d13a4484 Sep 08 06:53:31 devstack sudo[104688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:31 devstack sudo[104688]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a4d246ec-49f3-4c54-be37-b3fef0e99d59 tempest-SnapshotDependencyTests-1228523502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-34fb25d7-19a1-4719-942d-21cfbd3d7eeb.9955308c-56b6-4c45-97fe-8fd5d13a4484" returned: 0 in 0.359s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:31 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-a4d246ec-49f3-4c54-be37-b3fef0e99d59 tempest-SnapshotDependencyTests-1228523502 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34fb25d7-19a1-4719-942d-21cfbd3d7eeb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 06:53:31 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[58bd92ff-37d1-49b5-a1ca-1d3d8acc13c3]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:53:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a4d246ec-49f3-4c54-be37-b3fef0e99d59 tempest-SnapshotDependencyTests-1228523502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-34fb25d7-19a1-4719-942d-21cfbd3d7eeb {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:31 devstack sudo[104705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-34fb25d7-19a1-4719-942d-21cfbd3d7eeb Sep 08 06:53:31 devstack sudo[104705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:31 devstack sudo[104705]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a4d246ec-49f3-4c54-be37-b3fef0e99d59 tempest-SnapshotDependencyTests-1228523502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-34fb25d7-19a1-4719-942d-21cfbd3d7eeb" returned: 0 in 0.390s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:31 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-a4d246ec-49f3-4c54-be37-b3fef0e99d59 tempest-SnapshotDependencyTests-1228523502 None] will copy from snapshot at /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-34fb25d7-19a1-4719-942d-21cfbd3d7eeb {{(pid=87507) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 08 06:53:31 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-a4d246ec-49f3-4c54-be37-b3fef0e99d59 tempest-SnapshotDependencyTests-1228523502 None] Creating direct copy from snapshot {{(pid=87507) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 08 06:53:31 devstack cinder-volume[87507]: DEBUG cinder.utils [None req-a4d246ec-49f3-4c54-be37-b3fef0e99d59 tempest-SnapshotDependencyTests-1228523502 None] Path /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-13558b60-dd02-47d6-a34e-2ac36ebaa558 not found in is_blk_device check {{(pid=87507) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 08 06:53:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a4d246ec-49f3-4c54-be37-b3fef0e99d59 tempest-SnapshotDependencyTests-1228523502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-34fb25d7-19a1-4719-942d-21cfbd3d7eeb /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-13558b60-dd02-47d6-a34e-2ac36ebaa558 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:31 devstack sudo[104723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-34fb25d7-19a1-4719-942d-21cfbd3d7eeb /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-13558b60-dd02-47d6-a34e-2ac36ebaa558 Sep 08 06:53:31 devstack sudo[104723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:32 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-567828e4-4e23-4559-a54e-988d2daba84a tempest-VolumesGetTest-1169103151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:53:32 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-567828e4-4e23-4559-a54e-988d2daba84a tempest-VolumesGetTest-1169103151 None] Flow 'volume_create_manager' (5b2baae1-b17f-403e-82ec-693db14a30af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:53:32 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-567828e4-4e23-4559-a54e-988d2daba84a tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c11b014-4614-4fb4-ade8-8d9a76b8cba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:32 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-567828e4-4e23-4559-a54e-988d2daba84a tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c11b014-4614-4fb4-ade8-8d9a76b8cba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:53:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-896996670',display_name='tempest-VolumesGetTest-Volume-1033025204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f600330-9684-4a30-9599-52e2fa37ae01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d485bed2a56746eebce00d898e0d496c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:53:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:53:32Z,use_quota=True,user_id='eb60e87e5f514c66b1b8c39892da34fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:32 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-567828e4-4e23-4559-a54e-988d2daba84a tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a45bc1f2-635e-434e-be4a-bdad34dd209a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:32 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-567828e4-4e23-4559-a54e-988d2daba84a tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a45bc1f2-635e-434e-be4a-bdad34dd209a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:32 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-567828e4-4e23-4559-a54e-988d2daba84a tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7df64644-9cc4-46ed-b22e-348c770b7205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:32 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-567828e4-4e23-4559-a54e-988d2daba84a tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7df64644-9cc4-46ed-b22e-348c770b7205) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f600330-9684-4a30-9599-52e2fa37ae01', 'volume_name': 'volume-5f600330-9684-4a30-9599-52e2fa37ae01', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:32 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-567828e4-4e23-4559-a54e-988d2daba84a tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0942240-6a72-46f6-972a-85c9fe976040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:32 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-567828e4-4e23-4559-a54e-988d2daba84a tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0942240-6a72-46f6-972a-85c9fe976040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:32 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-567828e4-4e23-4559-a54e-988d2daba84a tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d92ae67-7224-4db6-a254-66145216b470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:32 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-567828e4-4e23-4559-a54e-988d2daba84a tempest-VolumesGetTest-1169103151 None] Volume 5f600330-9684-4a30-9599-52e2fa37ae01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f600330-9684-4a30-9599-52e2fa37ae01', 'volume_size': 1} Sep 08 06:53:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-567828e4-4e23-4559-a54e-988d2daba84a tempest-VolumesGetTest-1169103151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:53:36 devstack sudo[104723]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a4d246ec-49f3-4c54-be37-b3fef0e99d59 tempest-SnapshotDependencyTests-1228523502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-34fb25d7-19a1-4719-942d-21cfbd3d7eeb /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-13558b60-dd02-47d6-a34e-2ac36ebaa558" returned: 0 in 4.517s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:36 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-a4d246ec-49f3-4c54-be37-b3fef0e99d59 tempest-SnapshotDependencyTests-1228523502 None] Image conversion details: src /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-34fb25d7-19a1-4719-942d-21cfbd3d7eeb, size 1024.00 MB, duration 4.52 sec, destination /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-13558b60-dd02-47d6-a34e-2ac36ebaa558 {{(pid=87507) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 06:53:36 devstack cinder-volume[87507]: INFO cinder.image.image_utils [None req-a4d246ec-49f3-4c54-be37-b3fef0e99d59 tempest-SnapshotDependencyTests-1228523502 None] Converted 1024.00 MB image at 226.64 MB/s Sep 08 06:53:36 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-a4d246ec-49f3-4c54-be37-b3fef0e99d59 tempest-SnapshotDependencyTests-1228523502 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-13558b60-dd02-47d6-a34e-2ac36ebaa558 is being set with open permissions: ugo+rw Sep 08 06:53:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a4d246ec-49f3-4c54-be37-b3fef0e99d59 tempest-SnapshotDependencyTests-1228523502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-13558b60-dd02-47d6-a34e-2ac36ebaa558 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:36 devstack sudo[104874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-13558b60-dd02-47d6-a34e-2ac36ebaa558 Sep 08 06:53:36 devstack sudo[104874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:36 devstack sudo[104874]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a4d246ec-49f3-4c54-be37-b3fef0e99d59 tempest-SnapshotDependencyTests-1228523502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-13558b60-dd02-47d6-a34e-2ac36ebaa558" returned: 0 in 0.252s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:36 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-a4d246ec-49f3-4c54-be37-b3fef0e99d59 tempest-SnapshotDependencyTests-1228523502 None] Lock "cinder-quobyte-13558b60-dd02-47d6-a34e-2ac36ebaa558" released by "_copy_volume_from_snapshot" :: held 5.623s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:53:36 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-a4d246ec-49f3-4c54-be37-b3fef0e99d59 tempest-SnapshotDependencyTests-1228523502 None] Lock "cinder-quobyte-9955308c-56b6-4c45-97fe-8fd5d13a4484-13558b60-dd02-47d6-a34e-2ac36ebaa558" released by "_create_volume_from_snapshot" :: held 5.700s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:53:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a4d246ec-49f3-4c54-be37-b3fef0e99d59 tempest-SnapshotDependencyTests-1228523502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.734s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:53:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b4eadcdf-fbfe-44d7-9246-fbcd7e67809a tempest-VolumesCloneNegativeTest-228118752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.514s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:53:36 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-b4eadcdf-fbfe-44d7-9246-fbcd7e67809a tempest-VolumesCloneNegativeTest-228118752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:53:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-929375796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ead529b1-e599-4079-94ce-28de781b24af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35426c595f394c06ae93c23a9e03e7da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:53:24Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:53:24Z,use_quota=True,user_id='937332a28a764ffba350471a913418e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:53:36 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-b4eadcdf-fbfe-44d7-9246-fbcd7e67809a tempest-VolumesCloneNegativeTest-228118752 None] Creating volume ead529b1-e599-4079-94ce-28de781b24af {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:53:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b4eadcdf-fbfe-44d7-9246-fbcd7e67809a tempest-VolumesCloneNegativeTest-228118752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:53:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b4eadcdf-fbfe-44d7-9246-fbcd7e67809a tempest-VolumesCloneNegativeTest-228118752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:53:36 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-b4eadcdf-fbfe-44d7-9246-fbcd7e67809a tempest-VolumesCloneNegativeTest-228118752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:53:36 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-b4eadcdf-fbfe-44d7-9246-fbcd7e67809a tempest-VolumesCloneNegativeTest-228118752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:53:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b4eadcdf-fbfe-44d7-9246-fbcd7e67809a tempest-VolumesCloneNegativeTest-228118752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:53:36 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-b4eadcdf-fbfe-44d7-9246-fbcd7e67809a tempest-VolumesCloneNegativeTest-228118752 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:53:36 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-b4eadcdf-fbfe-44d7-9246-fbcd7e67809a tempest-VolumesCloneNegativeTest-228118752 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:53:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b4eadcdf-fbfe-44d7-9246-fbcd7e67809a tempest-VolumesCloneNegativeTest-228118752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ead529b1-e599-4079-94ce-28de781b24af 2147483648 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:36 devstack sudo[104889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ead529b1-e599-4079-94ce-28de781b24af 2147483648 Sep 08 06:53:36 devstack sudo[104889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:36 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a4d246ec-49f3-4c54-be37-b3fef0e99d59 tempest-SnapshotDependencyTests-1228523502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93a20586-9f9e-4d92-b863-4afd21f40aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13558b60-dd02-47d6-a34e-2ac36ebaa558', 'volume_size': 1, 'snapshot_id': '9955308c-56b6-4c45-97fe-8fd5d13a4484'}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:36 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a4d246ec-49f3-4c54-be37-b3fef0e99d59 tempest-SnapshotDependencyTests-1228523502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe92e0e2-6f06-4a72-8341-7a8380368fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:36 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-a4d246ec-49f3-4c54-be37-b3fef0e99d59 tempest-SnapshotDependencyTests-1228523502 None] Volume volume-13558b60-dd02-47d6-a34e-2ac36ebaa558 (13558b60-dd02-47d6-a34e-2ac36ebaa558): created successfully Sep 08 06:53:36 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a4d246ec-49f3-4c54-be37-b3fef0e99d59 tempest-SnapshotDependencyTests-1228523502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe92e0e2-6f06-4a72-8341-7a8380368fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:36 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a4d246ec-49f3-4c54-be37-b3fef0e99d59 tempest-SnapshotDependencyTests-1228523502 None] Flow 'volume_create_manager' (faa86c88-7ccb-44de-8348-32883b1ed41b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:53:36 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-a4d246ec-49f3-4c54-be37-b3fef0e99d59 tempest-SnapshotDependencyTests-1228523502 None] Created volume successfully. Sep 08 06:53:37 devstack sudo[104889]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b4eadcdf-fbfe-44d7-9246-fbcd7e67809a tempest-VolumesCloneNegativeTest-228118752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ead529b1-e599-4079-94ce-28de781b24af 2147483648" returned: 0 in 0.440s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b4eadcdf-fbfe-44d7-9246-fbcd7e67809a tempest-VolumesCloneNegativeTest-228118752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ead529b1-e599-4079-94ce-28de781b24af {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:37 devstack sudo[104907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ead529b1-e599-4079-94ce-28de781b24af Sep 08 06:53:37 devstack sudo[104907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:37 devstack sudo[104907]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b4eadcdf-fbfe-44d7-9246-fbcd7e67809a tempest-VolumesCloneNegativeTest-228118752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ead529b1-e599-4079-94ce-28de781b24af" returned: 0 in 0.246s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:37 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-b4eadcdf-fbfe-44d7-9246-fbcd7e67809a tempest-VolumesCloneNegativeTest-228118752 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:53:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b4eadcdf-fbfe-44d7-9246-fbcd7e67809a tempest-VolumesCloneNegativeTest-228118752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:53:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-cc9cbfa7-01f1-4ab9-aa02-9315548eca5c tempest-GroupSnapshotsV319Test-2145241500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.867s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:53:37 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-cc9cbfa7-01f1-4ab9-aa02-9315548eca5c tempest-GroupSnapshotsV319Test-2145241500 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5dd7ce15-9db1-48f9-ba13-35684046567f,created_at=2026-09-08T04:53:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-469953987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5dd7ce15-9db1-48f9-ba13-35684046567f,host='devstack@QuobyteHD#QuobyteHD',id=4d08dbe7-a278-4e56-8745-e8e3473f87a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a650cd560878481db61bddf282d8500d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:53:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:53:30Z,use_quota=True,user_id='9ae6dad7e0534b4aa3d368a131c9a4a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a46c8069-e231-4593-808a-8a6e2cf6e939),volume_type_id=a46c8069-e231-4593-808a-8a6e2cf6e939)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:53:37 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-cc9cbfa7-01f1-4ab9-aa02-9315548eca5c tempest-GroupSnapshotsV319Test-2145241500 None] Creating volume 4d08dbe7-a278-4e56-8745-e8e3473f87a6 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:53:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-cc9cbfa7-01f1-4ab9-aa02-9315548eca5c tempest-GroupSnapshotsV319Test-2145241500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:53:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-cc9cbfa7-01f1-4ab9-aa02-9315548eca5c tempest-GroupSnapshotsV319Test-2145241500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:53:37 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-cc9cbfa7-01f1-4ab9-aa02-9315548eca5c tempest-GroupSnapshotsV319Test-2145241500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:53:37 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-cc9cbfa7-01f1-4ab9-aa02-9315548eca5c tempest-GroupSnapshotsV319Test-2145241500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:53:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-cc9cbfa7-01f1-4ab9-aa02-9315548eca5c tempest-GroupSnapshotsV319Test-2145241500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:53:37 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-cc9cbfa7-01f1-4ab9-aa02-9315548eca5c tempest-GroupSnapshotsV319Test-2145241500 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:53:37 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-cc9cbfa7-01f1-4ab9-aa02-9315548eca5c tempest-GroupSnapshotsV319Test-2145241500 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:53:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-cc9cbfa7-01f1-4ab9-aa02-9315548eca5c tempest-GroupSnapshotsV319Test-2145241500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d08dbe7-a278-4e56-8745-e8e3473f87a6 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:37 devstack sudo[104919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d08dbe7-a278-4e56-8745-e8e3473f87a6 1073741824 Sep 08 06:53:37 devstack sudo[104919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:37 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b4eadcdf-fbfe-44d7-9246-fbcd7e67809a tempest-VolumesCloneNegativeTest-228118752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c124dab-dd17-42b4-8fb6-bbcdade88ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ead529b1-e599-4079-94ce-28de781b24af', 'volume_size': 2}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:37 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b4eadcdf-fbfe-44d7-9246-fbcd7e67809a tempest-VolumesCloneNegativeTest-228118752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f6b6869-e351-451a-b78b-e1435a2d6fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:37 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-b4eadcdf-fbfe-44d7-9246-fbcd7e67809a tempest-VolumesCloneNegativeTest-228118752 None] Volume volume-ead529b1-e599-4079-94ce-28de781b24af (ead529b1-e599-4079-94ce-28de781b24af): created successfully Sep 08 06:53:37 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b4eadcdf-fbfe-44d7-9246-fbcd7e67809a tempest-VolumesCloneNegativeTest-228118752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f6b6869-e351-451a-b78b-e1435a2d6fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:37 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b4eadcdf-fbfe-44d7-9246-fbcd7e67809a tempest-VolumesCloneNegativeTest-228118752 None] Flow 'volume_create_manager' (fb733af7-b562-434b-84ca-e3d2c627c505) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:53:37 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-b4eadcdf-fbfe-44d7-9246-fbcd7e67809a tempest-VolumesCloneNegativeTest-228118752 None] Created volume successfully. Sep 08 06:53:37 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-990ca34b-7fd2-42dd-9eca-2765569940a4 tempest-SnapshotDependencyTests-1228523502 None] Acquiring lock "cinder-9955308c-56b6-4c45-97fe-8fd5d13a4484-delete_snapshot" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:53:37 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-990ca34b-7fd2-42dd-9eca-2765569940a4 tempest-SnapshotDependencyTests-1228523502 None] Lock "cinder-9955308c-56b6-4c45-97fe-8fd5d13a4484-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:53:37 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-990ca34b-7fd2-42dd-9eca-2765569940a4 tempest-SnapshotDependencyTests-1228523502 None] Acquiring lock "cinder-quobyte-34fb25d7-19a1-4719-942d-21cfbd3d7eeb" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:53:37 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-990ca34b-7fd2-42dd-9eca-2765569940a4 tempest-SnapshotDependencyTests-1228523502 None] Lock "cinder-quobyte-34fb25d7-19a1-4719-942d-21cfbd3d7eeb" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:53:37 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-990ca34b-7fd2-42dd-9eca-2765569940a4 tempest-SnapshotDependencyTests-1228523502 None] Acquiring lock "cinder-quobyte-9955308c-56b6-4c45-97fe-8fd5d13a4484" by "_delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:53:37 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-990ca34b-7fd2-42dd-9eca-2765569940a4 tempest-SnapshotDependencyTests-1228523502 None] Lock "cinder-quobyte-9955308c-56b6-4c45-97fe-8fd5d13a4484" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:53:37 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-990ca34b-7fd2-42dd-9eca-2765569940a4 tempest-SnapshotDependencyTests-1228523502 None] Deleting offline snapshot 9955308c-56b6-4c45-97fe-8fd5d13a4484 of volume 34fb25d7-19a1-4719-942d-21cfbd3d7eeb {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 06:53:37 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-990ca34b-7fd2-42dd-9eca-2765569940a4 tempest-SnapshotDependencyTests-1228523502 None] snapshot_file for this snap is: volume-34fb25d7-19a1-4719-942d-21cfbd3d7eeb.9955308c-56b6-4c45-97fe-8fd5d13a4484 {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 06:53:37 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5858de7f-73aa-4e73-952d-12ba02647245]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:53:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-990ca34b-7fd2-42dd-9eca-2765569940a4 tempest-SnapshotDependencyTests-1228523502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-34fb25d7-19a1-4719-942d-21cfbd3d7eeb.9955308c-56b6-4c45-97fe-8fd5d13a4484 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:38 devstack sudo[104919]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-cc9cbfa7-01f1-4ab9-aa02-9315548eca5c tempest-GroupSnapshotsV319Test-2145241500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d08dbe7-a278-4e56-8745-e8e3473f87a6 1073741824" returned: 0 in 0.476s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-cc9cbfa7-01f1-4ab9-aa02-9315548eca5c tempest-GroupSnapshotsV319Test-2145241500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d08dbe7-a278-4e56-8745-e8e3473f87a6 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:38 devstack sudo[104941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d08dbe7-a278-4e56-8745-e8e3473f87a6 Sep 08 06:53:38 devstack sudo[104941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:38 devstack sudo[104937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-34fb25d7-19a1-4719-942d-21cfbd3d7eeb.9955308c-56b6-4c45-97fe-8fd5d13a4484 Sep 08 06:53:38 devstack sudo[104937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:38 devstack sudo[104941]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-cc9cbfa7-01f1-4ab9-aa02-9315548eca5c tempest-GroupSnapshotsV319Test-2145241500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d08dbe7-a278-4e56-8745-e8e3473f87a6" returned: 0 in 0.245s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:38 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-cc9cbfa7-01f1-4ab9-aa02-9315548eca5c tempest-GroupSnapshotsV319Test-2145241500 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:53:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-cc9cbfa7-01f1-4ab9-aa02-9315548eca5c tempest-GroupSnapshotsV319Test-2145241500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:53:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-567828e4-4e23-4559-a54e-988d2daba84a tempest-VolumesGetTest-1169103151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.839s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:53:38 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-567828e4-4e23-4559-a54e-988d2daba84a tempest-VolumesGetTest-1169103151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:53:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-896996670',display_name='tempest-VolumesGetTest-Volume-1033025204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f600330-9684-4a30-9599-52e2fa37ae01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d485bed2a56746eebce00d898e0d496c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:53:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:53:32Z,use_quota=True,user_id='eb60e87e5f514c66b1b8c39892da34fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:53:38 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-567828e4-4e23-4559-a54e-988d2daba84a tempest-VolumesGetTest-1169103151 None] Creating volume 5f600330-9684-4a30-9599-52e2fa37ae01 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:53:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-567828e4-4e23-4559-a54e-988d2daba84a tempest-VolumesGetTest-1169103151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:53:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-567828e4-4e23-4559-a54e-988d2daba84a tempest-VolumesGetTest-1169103151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:53:38 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-567828e4-4e23-4559-a54e-988d2daba84a tempest-VolumesGetTest-1169103151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:53:38 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-567828e4-4e23-4559-a54e-988d2daba84a tempest-VolumesGetTest-1169103151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:53:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-567828e4-4e23-4559-a54e-988d2daba84a tempest-VolumesGetTest-1169103151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:53:38 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-567828e4-4e23-4559-a54e-988d2daba84a tempest-VolumesGetTest-1169103151 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:53:38 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-567828e4-4e23-4559-a54e-988d2daba84a tempest-VolumesGetTest-1169103151 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:53:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-567828e4-4e23-4559-a54e-988d2daba84a tempest-VolumesGetTest-1169103151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5f600330-9684-4a30-9599-52e2fa37ae01 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:38 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-cc9cbfa7-01f1-4ab9-aa02-9315548eca5c tempest-GroupSnapshotsV319Test-2145241500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bca748d3-b9ce-4b17-9c82-56942aace9da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d08dbe7-a278-4e56-8745-e8e3473f87a6', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:38 devstack sudo[104955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5f600330-9684-4a30-9599-52e2fa37ae01 1073741824 Sep 08 06:53:38 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-cc9cbfa7-01f1-4ab9-aa02-9315548eca5c tempest-GroupSnapshotsV319Test-2145241500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f264cb4d-7a24-46da-b576-30c687ebef02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:38 devstack sudo[104955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:38 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-cc9cbfa7-01f1-4ab9-aa02-9315548eca5c tempest-GroupSnapshotsV319Test-2145241500 None] Volume volume-4d08dbe7-a278-4e56-8745-e8e3473f87a6 (4d08dbe7-a278-4e56-8745-e8e3473f87a6): created successfully Sep 08 06:53:38 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-cc9cbfa7-01f1-4ab9-aa02-9315548eca5c tempest-GroupSnapshotsV319Test-2145241500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f264cb4d-7a24-46da-b576-30c687ebef02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:38 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-cc9cbfa7-01f1-4ab9-aa02-9315548eca5c tempest-GroupSnapshotsV319Test-2145241500 None] Flow 'volume_create_manager' (9d0a8858-20b0-4227-98b2-c731a1e8d4ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:53:38 devstack sudo[104937]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-990ca34b-7fd2-42dd-9eca-2765569940a4 tempest-SnapshotDependencyTests-1228523502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-34fb25d7-19a1-4719-942d-21cfbd3d7eeb.9955308c-56b6-4c45-97fe-8fd5d13a4484" returned: 0 in 0.391s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:38 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-990ca34b-7fd2-42dd-9eca-2765569940a4 tempest-SnapshotDependencyTests-1228523502 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34fb25d7-19a1-4719-942d-21cfbd3d7eeb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 06:53:38 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-cc9cbfa7-01f1-4ab9-aa02-9315548eca5c tempest-GroupSnapshotsV319Test-2145241500 None] Created volume successfully. Sep 08 06:53:38 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe016947-5db9-4fbd-bc34-0cbf78c671ba]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:53:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-990ca34b-7fd2-42dd-9eca-2765569940a4 tempest-SnapshotDependencyTests-1228523502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-34fb25d7-19a1-4719-942d-21cfbd3d7eeb {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:38 devstack sudo[104959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-34fb25d7-19a1-4719-942d-21cfbd3d7eeb Sep 08 06:53:38 devstack sudo[104959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:38 devstack sudo[104955]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-567828e4-4e23-4559-a54e-988d2daba84a tempest-VolumesGetTest-1169103151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5f600330-9684-4a30-9599-52e2fa37ae01 1073741824" returned: 0 in 0.463s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-567828e4-4e23-4559-a54e-988d2daba84a tempest-VolumesGetTest-1169103151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5f600330-9684-4a30-9599-52e2fa37ae01 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:38 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-7307e189-5a1d-413a-b143-bdc6afff751f tempest-VolumesCloneNegativeTest-228118752 None] Acquiring lock "cinder-ead529b1-e599-4079-94ce-28de781b24af-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:53:38 devstack sudo[104981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5f600330-9684-4a30-9599-52e2fa37ae01 Sep 08 06:53:38 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-7307e189-5a1d-413a-b143-bdc6afff751f tempest-VolumesCloneNegativeTest-228118752 None] Lock "cinder-ead529b1-e599-4079-94ce-28de781b24af-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:53:38 devstack sudo[104981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:38 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-7307e189-5a1d-413a-b143-bdc6afff751f tempest-VolumesCloneNegativeTest-228118752 None] Acquiring lock "cinder-quobyte-ead529b1-e599-4079-94ce-28de781b24af" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:53:38 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-7307e189-5a1d-413a-b143-bdc6afff751f tempest-VolumesCloneNegativeTest-228118752 None] Lock "cinder-quobyte-ead529b1-e599-4079-94ce-28de781b24af" acquired by "delete_volume" :: waited 0.017s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:53:38 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25c776b-fc69-4557-b588-c698b988041d]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:53:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7307e189-5a1d-413a-b143-bdc6afff751f tempest-VolumesCloneNegativeTest-228118752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ead529b1-e599-4079-94ce-28de781b24af {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:39 devstack sudo[104959]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-990ca34b-7fd2-42dd-9eca-2765569940a4 tempest-SnapshotDependencyTests-1228523502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-34fb25d7-19a1-4719-942d-21cfbd3d7eeb" returned: 0 in 0.618s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-990ca34b-7fd2-42dd-9eca-2765569940a4 tempest-SnapshotDependencyTests-1228523502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-34fb25d7-19a1-4719-942d-21cfbd3d7eeb.9955308c-56b6-4c45-97fe-8fd5d13a4484 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:39 devstack sudo[104993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-34fb25d7-19a1-4719-942d-21cfbd3d7eeb.9955308c-56b6-4c45-97fe-8fd5d13a4484 Sep 08 06:53:39 devstack sudo[104993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:39 devstack sudo[104989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ead529b1-e599-4079-94ce-28de781b24af Sep 08 06:53:39 devstack sudo[104989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:39 devstack sudo[104981]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-567828e4-4e23-4559-a54e-988d2daba84a tempest-VolumesGetTest-1169103151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5f600330-9684-4a30-9599-52e2fa37ae01" returned: 0 in 0.334s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:39 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-567828e4-4e23-4559-a54e-988d2daba84a tempest-VolumesGetTest-1169103151 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:53:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-567828e4-4e23-4559-a54e-988d2daba84a tempest-VolumesGetTest-1169103151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:53:39 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-567828e4-4e23-4559-a54e-988d2daba84a tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d92ae67-7224-4db6-a254-66145216b470) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f600330-9684-4a30-9599-52e2fa37ae01', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:39 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-567828e4-4e23-4559-a54e-988d2daba84a tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76e3ac16-b597-448a-9f2b-af45d34906cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:39 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-567828e4-4e23-4559-a54e-988d2daba84a tempest-VolumesGetTest-1169103151 None] Volume volume-5f600330-9684-4a30-9599-52e2fa37ae01 (5f600330-9684-4a30-9599-52e2fa37ae01): created successfully Sep 08 06:53:39 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-567828e4-4e23-4559-a54e-988d2daba84a tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76e3ac16-b597-448a-9f2b-af45d34906cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:39 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-567828e4-4e23-4559-a54e-988d2daba84a tempest-VolumesGetTest-1169103151 None] Flow 'volume_create_manager' (5b2baae1-b17f-403e-82ec-693db14a30af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:53:39 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-567828e4-4e23-4559-a54e-988d2daba84a tempest-VolumesGetTest-1169103151 None] Created volume successfully. Sep 08 06:53:39 devstack sudo[104989]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7307e189-5a1d-413a-b143-bdc6afff751f tempest-VolumesCloneNegativeTest-228118752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ead529b1-e599-4079-94ce-28de781b24af" returned: 0 in 0.416s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7307e189-5a1d-413a-b143-bdc6afff751f tempest-VolumesCloneNegativeTest-228118752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ead529b1-e599-4079-94ce-28de781b24af {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:39 devstack sudo[104993]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-990ca34b-7fd2-42dd-9eca-2765569940a4 tempest-SnapshotDependencyTests-1228523502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-34fb25d7-19a1-4719-942d-21cfbd3d7eeb.9955308c-56b6-4c45-97fe-8fd5d13a4484" returned: 0 in 0.380s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-990ca34b-7fd2-42dd-9eca-2765569940a4 tempest-SnapshotDependencyTests-1228523502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-34fb25d7-19a1-4719-942d-21cfbd3d7eeb.9955308c-56b6-4c45-97fe-8fd5d13a4484 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:39 devstack sudo[105012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ead529b1-e599-4079-94ce-28de781b24af Sep 08 06:53:39 devstack sudo[105012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:39 devstack sudo[105014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-34fb25d7-19a1-4719-942d-21cfbd3d7eeb.9955308c-56b6-4c45-97fe-8fd5d13a4484 Sep 08 06:53:39 devstack sudo[105014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:39 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-9dfca830-0fa5-44f2-b289-ea8923ad4805 tempest-GroupSnapshotsV319Test-2145241500 None] GroupSnapshot 570de893-9131-4686-ae11-6d968eb48a14: creating. Sep 08 06:53:39 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9dfca830-0fa5-44f2-b289-ea8923ad4805 tempest-GroupSnapshotsV319Test-2145241500 None] Group snapshot 570de893-9131-4686-ae11-6d968eb48a14: creating. {{(pid=87507) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 08 06:53:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-9dfca830-0fa5-44f2-b289-ea8923ad4805 tempest-GroupSnapshotsV319Test-2145241500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:53:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-9dfca830-0fa5-44f2-b289-ea8923ad4805 tempest-GroupSnapshotsV319Test-2145241500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:53:39 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-9dfca830-0fa5-44f2-b289-ea8923ad4805 tempest-GroupSnapshotsV319Test-2145241500 None] Creating offline snapshot c7994b93-6a01-4081-bf9c-74fe54380865 of volume 4d08dbe7-a278-4e56-8745-e8e3473f87a6 {{(pid=87507) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 06:53:39 devstack sudo[105012]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7307e189-5a1d-413a-b143-bdc6afff751f tempest-VolumesCloneNegativeTest-228118752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ead529b1-e599-4079-94ce-28de781b24af" returned: 0 in 0.282s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:39 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[187d85a7-f05c-4c15-b540-c0153bfcb17f]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:53:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9dfca830-0fa5-44f2-b289-ea8923ad4805 tempest-GroupSnapshotsV319Test-2145241500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d08dbe7-a278-4e56-8745-e8e3473f87a6 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:39 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-7307e189-5a1d-413a-b143-bdc6afff751f tempest-VolumesCloneNegativeTest-228118752 None] Lock "cinder-quobyte-ead529b1-e599-4079-94ce-28de781b24af" released by "delete_volume" :: held 0.756s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:53:39 devstack sudo[105014]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-990ca34b-7fd2-42dd-9eca-2765569940a4 tempest-SnapshotDependencyTests-1228523502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-34fb25d7-19a1-4719-942d-21cfbd3d7eeb.9955308c-56b6-4c45-97fe-8fd5d13a4484" returned: 0 in 0.282s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:39 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-990ca34b-7fd2-42dd-9eca-2765569940a4 tempest-SnapshotDependencyTests-1228523502 None] Lock "cinder-quobyte-9955308c-56b6-4c45-97fe-8fd5d13a4484" released by "_delete_snapshot" :: held 1.782s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:53:39 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-990ca34b-7fd2-42dd-9eca-2765569940a4 tempest-SnapshotDependencyTests-1228523502 None] Lock "cinder-quobyte-34fb25d7-19a1-4719-942d-21cfbd3d7eeb" released by "delete_snapshot" :: held 1.807s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:53:39 devstack sudo[105027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d08dbe7-a278-4e56-8745-e8e3473f87a6 Sep 08 06:53:39 devstack sudo[105027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:39 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-7307e189-5a1d-413a-b143-bdc6afff751f tempest-VolumesCloneNegativeTest-228118752 None] Created reservations ['a9705027-2bce-4045-92cd-2da7e45c72f3', 'bff0262e-3602-449a-8b2a-de40c38f0621', 'f2adb4e5-261a-4a55-acc6-932592e7a0b1', '23f308df-c63d-47b5-936d-d38acd5f9657'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:53:39 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-990ca34b-7fd2-42dd-9eca-2765569940a4 tempest-SnapshotDependencyTests-1228523502 None] Created reservations ['ab99d241-8a05-4e00-92ac-7a21c79a6e6c', 'b6683645-8a69-46f3-8842-426deb99f212', '359ef05e-d5f8-4183-aa06-fae765188a36', '542af1c7-9d6e-47a5-84ef-b9389ce1918f'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:53:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-7307e189-5a1d-413a-b143-bdc6afff751f tempest-VolumesCloneNegativeTest-228118752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:53:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-7307e189-5a1d-413a-b143-bdc6afff751f tempest-VolumesCloneNegativeTest-228118752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:53:39 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-7307e189-5a1d-413a-b143-bdc6afff751f tempest-VolumesCloneNegativeTest-228118752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:53:39 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-7307e189-5a1d-413a-b143-bdc6afff751f tempest-VolumesCloneNegativeTest-228118752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:53:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-7307e189-5a1d-413a-b143-bdc6afff751f tempest-VolumesCloneNegativeTest-228118752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:53:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7307e189-5a1d-413a-b143-bdc6afff751f tempest-VolumesCloneNegativeTest-228118752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:39 devstack sudo[105035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:53:39 devstack sudo[105035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:39 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-990ca34b-7fd2-42dd-9eca-2765569940a4 tempest-SnapshotDependencyTests-1228523502 None] Delete snapshot completed successfully. Sep 08 06:53:39 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-990ca34b-7fd2-42dd-9eca-2765569940a4 tempest-SnapshotDependencyTests-1228523502 None] Lock "cinder-9955308c-56b6-4c45-97fe-8fd5d13a4484-delete_snapshot" released by "delete_snapshot" :: held 2.025s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:53:40 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-85d4e934-243b-4da6-94ba-f1a451bd4e44 tempest-SnapshotDependencyTests-1228523502 None] Acquiring lock "cinder-34fb25d7-19a1-4719-942d-21cfbd3d7eeb-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:53:40 devstack sudo[105035]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:40 devstack sudo[105027]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7307e189-5a1d-413a-b143-bdc6afff751f tempest-VolumesCloneNegativeTest-228118752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.335s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:40 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-7307e189-5a1d-413a-b143-bdc6afff751f tempest-VolumesCloneNegativeTest-228118752 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:53:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9dfca830-0fa5-44f2-b289-ea8923ad4805 tempest-GroupSnapshotsV319Test-2145241500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d08dbe7-a278-4e56-8745-e8e3473f87a6" returned: 0 in 0.561s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9dfca830-0fa5-44f2-b289-ea8923ad4805 tempest-GroupSnapshotsV319Test-2145241500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d08dbe7-a278-4e56-8745-e8e3473f87a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d08dbe7-a278-4e56-8745-e8e3473f87a6.c7994b93-6a01-4081-bf9c-74fe54380865 1G {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:40 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-7307e189-5a1d-413a-b143-bdc6afff751f tempest-VolumesCloneNegativeTest-228118752 None] Deleted volume successfully. Sep 08 06:53:40 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-85d4e934-243b-4da6-94ba-f1a451bd4e44 tempest-SnapshotDependencyTests-1228523502 None] Lock "cinder-34fb25d7-19a1-4719-942d-21cfbd3d7eeb-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:53:40 devstack sudo[105053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d08dbe7-a278-4e56-8745-e8e3473f87a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d08dbe7-a278-4e56-8745-e8e3473f87a6.c7994b93-6a01-4081-bf9c-74fe54380865 1G Sep 08 06:53:40 devstack sudo[105053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:40 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-7307e189-5a1d-413a-b143-bdc6afff751f tempest-VolumesCloneNegativeTest-228118752 None] Lock "cinder-ead529b1-e599-4079-94ce-28de781b24af-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:53:40 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-85d4e934-243b-4da6-94ba-f1a451bd4e44 tempest-SnapshotDependencyTests-1228523502 None] Acquiring lock "cinder-quobyte-34fb25d7-19a1-4719-942d-21cfbd3d7eeb" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:53:40 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-85d4e934-243b-4da6-94ba-f1a451bd4e44 tempest-SnapshotDependencyTests-1228523502 None] Lock "cinder-quobyte-34fb25d7-19a1-4719-942d-21cfbd3d7eeb" acquired by "delete_volume" :: waited 0.027s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:53:40 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64d00dc-87bb-4c05-9c59-cf9b67a200cc]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:53:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-85d4e934-243b-4da6-94ba-f1a451bd4e44 tempest-SnapshotDependencyTests-1228523502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-34fb25d7-19a1-4719-942d-21cfbd3d7eeb {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:40 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-2955ebc2-06f2-4bfa-84b8-68e465616155 tempest-VolumesGetTest-1169103151 None] Acquiring lock "cinder-5f600330-9684-4a30-9599-52e2fa37ae01-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:53:40 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-2955ebc2-06f2-4bfa-84b8-68e465616155 tempest-VolumesGetTest-1169103151 None] Lock "cinder-5f600330-9684-4a30-9599-52e2fa37ae01-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:53:40 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-2955ebc2-06f2-4bfa-84b8-68e465616155 tempest-VolumesGetTest-1169103151 None] Acquiring lock "cinder-quobyte-5f600330-9684-4a30-9599-52e2fa37ae01" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:53:40 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-2955ebc2-06f2-4bfa-84b8-68e465616155 tempest-VolumesGetTest-1169103151 None] Lock "cinder-quobyte-5f600330-9684-4a30-9599-52e2fa37ae01" acquired by "delete_volume" :: waited 0.015s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:53:40 devstack sudo[105058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-34fb25d7-19a1-4719-942d-21cfbd3d7eeb Sep 08 06:53:40 devstack sudo[105058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:40 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[09026f77-9ba2-4e47-8700-5bd5ee8e5752]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:53:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2955ebc2-06f2-4bfa-84b8-68e465616155 tempest-VolumesGetTest-1169103151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5f600330-9684-4a30-9599-52e2fa37ae01 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:40 devstack sudo[105072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5f600330-9684-4a30-9599-52e2fa37ae01 Sep 08 06:53:40 devstack sudo[105072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:40 devstack sudo[105053]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9dfca830-0fa5-44f2-b289-ea8923ad4805 tempest-GroupSnapshotsV319Test-2145241500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d08dbe7-a278-4e56-8745-e8e3473f87a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d08dbe7-a278-4e56-8745-e8e3473f87a6.c7994b93-6a01-4081-bf9c-74fe54380865 1G" returned: 0 in 0.581s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9dfca830-0fa5-44f2-b289-ea8923ad4805 tempest-GroupSnapshotsV319Test-2145241500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d08dbe7-a278-4e56-8745-e8e3473f87a6 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d08dbe7-a278-4e56-8745-e8e3473f87a6.c7994b93-6a01-4081-bf9c-74fe54380865 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:40 devstack sudo[105079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d08dbe7-a278-4e56-8745-e8e3473f87a6 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d08dbe7-a278-4e56-8745-e8e3473f87a6.c7994b93-6a01-4081-bf9c-74fe54380865 Sep 08 06:53:40 devstack sudo[105079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:40 devstack sudo[105058]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-85d4e934-243b-4da6-94ba-f1a451bd4e44 tempest-SnapshotDependencyTests-1228523502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-34fb25d7-19a1-4719-942d-21cfbd3d7eeb" returned: 0 in 0.564s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-85d4e934-243b-4da6-94ba-f1a451bd4e44 tempest-SnapshotDependencyTests-1228523502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-34fb25d7-19a1-4719-942d-21cfbd3d7eeb {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:41 devstack sudo[105091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-34fb25d7-19a1-4719-942d-21cfbd3d7eeb Sep 08 06:53:41 devstack sudo[105091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:41 devstack sudo[105072]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2955ebc2-06f2-4bfa-84b8-68e465616155 tempest-VolumesGetTest-1169103151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5f600330-9684-4a30-9599-52e2fa37ae01" returned: 0 in 0.465s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2955ebc2-06f2-4bfa-84b8-68e465616155 tempest-VolumesGetTest-1169103151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5f600330-9684-4a30-9599-52e2fa37ae01 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:41 devstack sudo[105102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5f600330-9684-4a30-9599-52e2fa37ae01 Sep 08 06:53:41 devstack sudo[105102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:41 devstack sudo[105079]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9dfca830-0fa5-44f2-b289-ea8923ad4805 tempest-GroupSnapshotsV319Test-2145241500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d08dbe7-a278-4e56-8745-e8e3473f87a6 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d08dbe7-a278-4e56-8745-e8e3473f87a6.c7994b93-6a01-4081-bf9c-74fe54380865" returned: 0 in 0.354s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:41 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-9dfca830-0fa5-44f2-b289-ea8923ad4805 tempest-GroupSnapshotsV319Test-2145241500 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d08dbe7-a278-4e56-8745-e8e3473f87a6.c7994b93-6a01-4081-bf9c-74fe54380865 is being set with open permissions: ugo+rw: NotImplementedError Sep 08 06:53:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9dfca830-0fa5-44f2-b289-ea8923ad4805 tempest-GroupSnapshotsV319Test-2145241500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d08dbe7-a278-4e56-8745-e8e3473f87a6.c7994b93-6a01-4081-bf9c-74fe54380865 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:41 devstack sudo[105107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d08dbe7-a278-4e56-8745-e8e3473f87a6.c7994b93-6a01-4081-bf9c-74fe54380865 Sep 08 06:53:41 devstack sudo[105107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:41 devstack sudo[105091]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-85d4e934-243b-4da6-94ba-f1a451bd4e44 tempest-SnapshotDependencyTests-1228523502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-34fb25d7-19a1-4719-942d-21cfbd3d7eeb" returned: 0 in 0.324s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:41 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-85d4e934-243b-4da6-94ba-f1a451bd4e44 tempest-SnapshotDependencyTests-1228523502 None] Lock "cinder-quobyte-34fb25d7-19a1-4719-942d-21cfbd3d7eeb" released by "delete_volume" :: held 0.975s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:53:41 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-85d4e934-243b-4da6-94ba-f1a451bd4e44 tempest-SnapshotDependencyTests-1228523502 None] Created reservations ['cef1da4a-17fa-48cd-9b61-40743fe6bf6d', '7364d887-b07d-474e-bed9-3e49d56833c0', 'bde8c6c2-e8f1-45ed-9a8b-23d79c737a09', '1eb2dd75-1422-4002-a0bc-3e456b7608b4'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:53:41 devstack sudo[105102]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2955ebc2-06f2-4bfa-84b8-68e465616155 tempest-VolumesGetTest-1169103151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5f600330-9684-4a30-9599-52e2fa37ae01" returned: 0 in 0.352s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:41 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-2955ebc2-06f2-4bfa-84b8-68e465616155 tempest-VolumesGetTest-1169103151 None] Lock "cinder-quobyte-5f600330-9684-4a30-9599-52e2fa37ae01" released by "delete_volume" :: held 0.877s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:53:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-85d4e934-243b-4da6-94ba-f1a451bd4e44 tempest-SnapshotDependencyTests-1228523502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:53:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-85d4e934-243b-4da6-94ba-f1a451bd4e44 tempest-SnapshotDependencyTests-1228523502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:53:41 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-85d4e934-243b-4da6-94ba-f1a451bd4e44 tempest-SnapshotDependencyTests-1228523502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:53:41 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-85d4e934-243b-4da6-94ba-f1a451bd4e44 tempest-SnapshotDependencyTests-1228523502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:53:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-85d4e934-243b-4da6-94ba-f1a451bd4e44 tempest-SnapshotDependencyTests-1228523502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:53:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-85d4e934-243b-4da6-94ba-f1a451bd4e44 tempest-SnapshotDependencyTests-1228523502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:41 devstack sudo[105107]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9dfca830-0fa5-44f2-b289-ea8923ad4805 tempest-GroupSnapshotsV319Test-2145241500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d08dbe7-a278-4e56-8745-e8e3473f87a6.c7994b93-6a01-4081-bf9c-74fe54380865" returned: 0 in 0.428s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:41 devstack sudo[105125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:53:41 devstack sudo[105125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:41 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-2955ebc2-06f2-4bfa-84b8-68e465616155 tempest-VolumesGetTest-1169103151 None] Created reservations ['1306578b-2b96-4783-bbaf-b73303ccd2cf', '8297589d-2268-4ce5-855d-d9b11c704f65', 'a82d08df-e749-47af-8b60-1a2f0c428845', '0fce9a61-7c18-44e2-b146-98c6c21b35be'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:53:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9dfca830-0fa5-44f2-b289-ea8923ad4805 tempest-GroupSnapshotsV319Test-2145241500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d08dbe7-a278-4e56-8745-e8e3473f87a6.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:41 devstack sudo[105128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d08dbe7-a278-4e56-8745-e8e3473f87a6.info Sep 08 06:53:41 devstack sudo[105128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-2955ebc2-06f2-4bfa-84b8-68e465616155 tempest-VolumesGetTest-1169103151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:53:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-2955ebc2-06f2-4bfa-84b8-68e465616155 tempest-VolumesGetTest-1169103151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:53:41 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-2955ebc2-06f2-4bfa-84b8-68e465616155 tempest-VolumesGetTest-1169103151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:53:41 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-2955ebc2-06f2-4bfa-84b8-68e465616155 tempest-VolumesGetTest-1169103151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:53:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-2955ebc2-06f2-4bfa-84b8-68e465616155 tempest-VolumesGetTest-1169103151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:53:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2955ebc2-06f2-4bfa-84b8-68e465616155 tempest-VolumesGetTest-1169103151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:41 devstack sudo[105135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:53:41 devstack sudo[105135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:41 devstack sudo[105125]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-85d4e934-243b-4da6-94ba-f1a451bd4e44 tempest-SnapshotDependencyTests-1228523502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.362s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:41 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-85d4e934-243b-4da6-94ba-f1a451bd4e44 tempest-SnapshotDependencyTests-1228523502 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:53:41 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-85d4e934-243b-4da6-94ba-f1a451bd4e44 tempest-SnapshotDependencyTests-1228523502 None] Deleted volume successfully. Sep 08 06:53:41 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-85d4e934-243b-4da6-94ba-f1a451bd4e44 tempest-SnapshotDependencyTests-1228523502 None] Lock "cinder-34fb25d7-19a1-4719-942d-21cfbd3d7eeb-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:53:41 devstack sudo[105128]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9dfca830-0fa5-44f2-b289-ea8923ad4805 tempest-GroupSnapshotsV319Test-2145241500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d08dbe7-a278-4e56-8745-e8e3473f87a6.info" returned: 0 in 0.331s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:41 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-9dfca830-0fa5-44f2-b289-ea8923ad4805 tempest-GroupSnapshotsV319Test-2145241500 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d08dbe7-a278-4e56-8745-e8e3473f87a6.info is being set with open permissions: ugo+rw: NotImplementedError Sep 08 06:53:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9dfca830-0fa5-44f2-b289-ea8923ad4805 tempest-GroupSnapshotsV319Test-2145241500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d08dbe7-a278-4e56-8745-e8e3473f87a6.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:41 devstack sudo[105145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d08dbe7-a278-4e56-8745-e8e3473f87a6.info Sep 08 06:53:41 devstack sudo[105145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:42 devstack sudo[105135]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2955ebc2-06f2-4bfa-84b8-68e465616155 tempest-VolumesGetTest-1169103151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.356s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:42 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-2955ebc2-06f2-4bfa-84b8-68e465616155 tempest-VolumesGetTest-1169103151 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:53:42 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-2955ebc2-06f2-4bfa-84b8-68e465616155 tempest-VolumesGetTest-1169103151 None] Deleted volume successfully. Sep 08 06:53:42 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-2955ebc2-06f2-4bfa-84b8-68e465616155 tempest-VolumesGetTest-1169103151 None] Lock "cinder-5f600330-9684-4a30-9599-52e2fa37ae01-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:53:42 devstack sudo[105145]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9dfca830-0fa5-44f2-b289-ea8923ad4805 tempest-GroupSnapshotsV319Test-2145241500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d08dbe7-a278-4e56-8745-e8e3473f87a6.info" returned: 0 in 0.289s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-9dfca830-0fa5-44f2-b289-ea8923ad4805 tempest-GroupSnapshotsV319Test-2145241500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.648s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:53:42 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-9dfca830-0fa5-44f2-b289-ea8923ad4805 tempest-GroupSnapshotsV319Test-2145241500 None] group_snapshot 570de893-9131-4686-ae11-6d968eb48a14: created successfully Sep 08 06:53:42 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-12ec1609-3f51-4876-820c-8d711becf8a2 tempest-SnapshotDependencyTests-1228523502 None] Acquiring lock "cinder-13558b60-dd02-47d6-a34e-2ac36ebaa558-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:53:42 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-12ec1609-3f51-4876-820c-8d711becf8a2 tempest-SnapshotDependencyTests-1228523502 None] Lock "cinder-13558b60-dd02-47d6-a34e-2ac36ebaa558-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:53:42 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-12ec1609-3f51-4876-820c-8d711becf8a2 tempest-SnapshotDependencyTests-1228523502 None] Acquiring lock "cinder-quobyte-13558b60-dd02-47d6-a34e-2ac36ebaa558" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:53:42 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-12ec1609-3f51-4876-820c-8d711becf8a2 tempest-SnapshotDependencyTests-1228523502 None] Lock "cinder-quobyte-13558b60-dd02-47d6-a34e-2ac36ebaa558" acquired by "delete_volume" :: waited 0.015s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:53:42 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe200e19-59cf-4650-be1f-a13baa6210e6]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:53:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-12ec1609-3f51-4876-820c-8d711becf8a2 tempest-SnapshotDependencyTests-1228523502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-13558b60-dd02-47d6-a34e-2ac36ebaa558 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:42 devstack sudo[105167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-13558b60-dd02-47d6-a34e-2ac36ebaa558 Sep 08 06:53:42 devstack sudo[105167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:42 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-6601e66d-1969-4ca7-954f-1f8d8d6c51f7 tempest-VolumesGetTest-1169103151 None] Acquiring lock "cinder-66a2d426-56a4-4aaf-871e-a558b34caf83-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:53:42 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-6601e66d-1969-4ca7-954f-1f8d8d6c51f7 tempest-VolumesGetTest-1169103151 None] Lock "cinder-66a2d426-56a4-4aaf-871e-a558b34caf83-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:53:42 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-6601e66d-1969-4ca7-954f-1f8d8d6c51f7 tempest-VolumesGetTest-1169103151 None] Acquiring lock "cinder-quobyte-66a2d426-56a4-4aaf-871e-a558b34caf83" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:53:42 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-6601e66d-1969-4ca7-954f-1f8d8d6c51f7 tempest-VolumesGetTest-1169103151 None] Lock "cinder-quobyte-66a2d426-56a4-4aaf-871e-a558b34caf83" acquired by "delete_volume" :: waited 0.037s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:53:43 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54bb5ce-a88f-4fc1-9fdf-1905302b0073]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:53:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6601e66d-1969-4ca7-954f-1f8d8d6c51f7 tempest-VolumesGetTest-1169103151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-66a2d426-56a4-4aaf-871e-a558b34caf83 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:43 devstack sudo[105167]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-12ec1609-3f51-4876-820c-8d711becf8a2 tempest-SnapshotDependencyTests-1228523502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-13558b60-dd02-47d6-a34e-2ac36ebaa558" returned: 0 in 0.459s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-12ec1609-3f51-4876-820c-8d711becf8a2 tempest-SnapshotDependencyTests-1228523502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-13558b60-dd02-47d6-a34e-2ac36ebaa558 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:43 devstack sudo[105187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-13558b60-dd02-47d6-a34e-2ac36ebaa558 Sep 08 06:53:43 devstack sudo[105187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:43 devstack sudo[105184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-66a2d426-56a4-4aaf-871e-a558b34caf83 Sep 08 06:53:43 devstack sudo[105184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:43 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-446f20f6-107f-47d7-ac3e-59657e368543 tempest-GroupSnapshotsV319Test-2145241500 None] group_snapshot 570de893-9131-4686-ae11-6d968eb48a14: deleting Sep 08 06:53:43 devstack sudo[105187]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-12ec1609-3f51-4876-820c-8d711becf8a2 tempest-SnapshotDependencyTests-1228523502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-13558b60-dd02-47d6-a34e-2ac36ebaa558" returned: 0 in 0.337s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:43 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-446f20f6-107f-47d7-ac3e-59657e368543 tempest-GroupSnapshotsV319Test-2145241500 None] group_snapshot 570de893-9131-4686-ae11-6d968eb48a14: deleting {{(pid=87507) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 08 06:53:43 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-12ec1609-3f51-4876-820c-8d711becf8a2 tempest-SnapshotDependencyTests-1228523502 None] Lock "cinder-quobyte-13558b60-dd02-47d6-a34e-2ac36ebaa558" released by "delete_volume" :: held 0.847s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:53:43 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-446f20f6-107f-47d7-ac3e-59657e368543 tempest-GroupSnapshotsV319Test-2145241500 None] Acquiring lock "cinder-quobyte-4d08dbe7-a278-4e56-8745-e8e3473f87a6" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:53:43 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-446f20f6-107f-47d7-ac3e-59657e368543 tempest-GroupSnapshotsV319Test-2145241500 None] Lock "cinder-quobyte-4d08dbe7-a278-4e56-8745-e8e3473f87a6" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:53:43 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-446f20f6-107f-47d7-ac3e-59657e368543 tempest-GroupSnapshotsV319Test-2145241500 None] Acquiring lock "cinder-quobyte-c7994b93-6a01-4081-bf9c-74fe54380865" by "_delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:53:43 devstack sudo[105184]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6601e66d-1969-4ca7-954f-1f8d8d6c51f7 tempest-VolumesGetTest-1169103151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-66a2d426-56a4-4aaf-871e-a558b34caf83" returned: 0 in 0.471s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6601e66d-1969-4ca7-954f-1f8d8d6c51f7 tempest-VolumesGetTest-1169103151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-66a2d426-56a4-4aaf-871e-a558b34caf83 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:43 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-446f20f6-107f-47d7-ac3e-59657e368543 tempest-GroupSnapshotsV319Test-2145241500 None] Lock "cinder-quobyte-c7994b93-6a01-4081-bf9c-74fe54380865" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:53:43 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-446f20f6-107f-47d7-ac3e-59657e368543 tempest-GroupSnapshotsV319Test-2145241500 None] Deleting offline snapshot c7994b93-6a01-4081-bf9c-74fe54380865 of volume 4d08dbe7-a278-4e56-8745-e8e3473f87a6 {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 06:53:43 devstack sudo[105208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-66a2d426-56a4-4aaf-871e-a558b34caf83 Sep 08 06:53:43 devstack sudo[105208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:43 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-446f20f6-107f-47d7-ac3e-59657e368543 tempest-GroupSnapshotsV319Test-2145241500 None] snapshot_file for this snap is: volume-4d08dbe7-a278-4e56-8745-e8e3473f87a6.c7994b93-6a01-4081-bf9c-74fe54380865 {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 06:53:43 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1cb97c9-ff08-4abd-af04-28f3615be2a9]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:53:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-446f20f6-107f-47d7-ac3e-59657e368543 tempest-GroupSnapshotsV319Test-2145241500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d08dbe7-a278-4e56-8745-e8e3473f87a6.c7994b93-6a01-4081-bf9c-74fe54380865 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:43 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-12ec1609-3f51-4876-820c-8d711becf8a2 tempest-SnapshotDependencyTests-1228523502 None] Created reservations ['af2eace2-f175-4240-ae0b-6f869fd1a976', 'bfa7100e-dbac-4406-9051-97df5f5f1276', '985a0cc8-ec2d-4b6d-92a7-dc7456590d6c', '4a97768c-28ac-4593-bcb2-057dd634c3ca'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:53:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-12ec1609-3f51-4876-820c-8d711becf8a2 tempest-SnapshotDependencyTests-1228523502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:53:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-12ec1609-3f51-4876-820c-8d711becf8a2 tempest-SnapshotDependencyTests-1228523502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:53:43 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-12ec1609-3f51-4876-820c-8d711becf8a2 tempest-SnapshotDependencyTests-1228523502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:53:43 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-12ec1609-3f51-4876-820c-8d711becf8a2 tempest-SnapshotDependencyTests-1228523502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:53:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-12ec1609-3f51-4876-820c-8d711becf8a2 tempest-SnapshotDependencyTests-1228523502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:53:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-12ec1609-3f51-4876-820c-8d711becf8a2 tempest-SnapshotDependencyTests-1228523502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:43 devstack sudo[105217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:53:43 devstack sudo[105217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:43 devstack sudo[105213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d08dbe7-a278-4e56-8745-e8e3473f87a6.c7994b93-6a01-4081-bf9c-74fe54380865 Sep 08 06:53:43 devstack sudo[105213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:43 devstack sudo[105208]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6601e66d-1969-4ca7-954f-1f8d8d6c51f7 tempest-VolumesGetTest-1169103151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-66a2d426-56a4-4aaf-871e-a558b34caf83" returned: 0 in 0.336s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:43 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-6601e66d-1969-4ca7-954f-1f8d8d6c51f7 tempest-VolumesGetTest-1169103151 None] Lock "cinder-quobyte-66a2d426-56a4-4aaf-871e-a558b34caf83" released by "delete_volume" :: held 0.871s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:53:43 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-6601e66d-1969-4ca7-954f-1f8d8d6c51f7 tempest-VolumesGetTest-1169103151 None] Created reservations ['9c7e0a37-c6c6-4ade-8696-d514ed113c45', '7d18e9dd-2a2d-4f0a-a4b3-1f48c2b35141', '68cadd1c-6456-4c4b-a295-6ab2b5b44e40', '72ab6b95-a6c4-42a0-a2f8-093a4bc4742f'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:53:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-6601e66d-1969-4ca7-954f-1f8d8d6c51f7 tempest-VolumesGetTest-1169103151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:53:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-6601e66d-1969-4ca7-954f-1f8d8d6c51f7 tempest-VolumesGetTest-1169103151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:53:44 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-6601e66d-1969-4ca7-954f-1f8d8d6c51f7 tempest-VolumesGetTest-1169103151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:53:44 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-6601e66d-1969-4ca7-954f-1f8d8d6c51f7 tempest-VolumesGetTest-1169103151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:53:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-6601e66d-1969-4ca7-954f-1f8d8d6c51f7 tempest-VolumesGetTest-1169103151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:53:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6601e66d-1969-4ca7-954f-1f8d8d6c51f7 tempest-VolumesGetTest-1169103151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:44 devstack sudo[105217]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-12ec1609-3f51-4876-820c-8d711becf8a2 tempest-SnapshotDependencyTests-1228523502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.354s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:44 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-12ec1609-3f51-4876-820c-8d711becf8a2 tempest-SnapshotDependencyTests-1228523502 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:53:44 devstack sudo[105231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:53:44 devstack sudo[105231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:44 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-12ec1609-3f51-4876-820c-8d711becf8a2 tempest-SnapshotDependencyTests-1228523502 None] Deleted volume successfully. Sep 08 06:53:44 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-12ec1609-3f51-4876-820c-8d711becf8a2 tempest-SnapshotDependencyTests-1228523502 None] Lock "cinder-13558b60-dd02-47d6-a34e-2ac36ebaa558-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:53:44 devstack sudo[105213]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:44 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-a69199e7-160b-47c8-ac98-24db5337a93f tempest-VolumesGetTest-1169103151 None] Acquiring lock "cinder-420a03f4-8808-47e4-b770-db5bbb69492c-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:53:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-446f20f6-107f-47d7-ac3e-59657e368543 tempest-GroupSnapshotsV319Test-2145241500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d08dbe7-a278-4e56-8745-e8e3473f87a6.c7994b93-6a01-4081-bf9c-74fe54380865" returned: 0 in 0.607s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:44 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-446f20f6-107f-47d7-ac3e-59657e368543 tempest-GroupSnapshotsV319Test-2145241500 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d08dbe7-a278-4e56-8745-e8e3473f87a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 06:53:44 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3e3f08-bb30-4956-8124-71bfba488e78]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:53:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-446f20f6-107f-47d7-ac3e-59657e368543 tempest-GroupSnapshotsV319Test-2145241500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d08dbe7-a278-4e56-8745-e8e3473f87a6 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:44 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-a69199e7-160b-47c8-ac98-24db5337a93f tempest-VolumesGetTest-1169103151 None] Lock "cinder-420a03f4-8808-47e4-b770-db5bbb69492c-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:53:44 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-a69199e7-160b-47c8-ac98-24db5337a93f tempest-VolumesGetTest-1169103151 None] Acquiring lock "cinder-quobyte-420a03f4-8808-47e4-b770-db5bbb69492c" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:53:44 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-a69199e7-160b-47c8-ac98-24db5337a93f tempest-VolumesGetTest-1169103151 None] Lock "cinder-quobyte-420a03f4-8808-47e4-b770-db5bbb69492c" acquired by "delete_volume" :: waited 0.021s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:53:44 devstack sudo[105231]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6601e66d-1969-4ca7-954f-1f8d8d6c51f7 tempest-VolumesGetTest-1169103151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.324s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:44 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-6601e66d-1969-4ca7-954f-1f8d8d6c51f7 tempest-VolumesGetTest-1169103151 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:53:44 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-6601e66d-1969-4ca7-954f-1f8d8d6c51f7 tempest-VolumesGetTest-1169103151 None] Deleted volume successfully. Sep 08 06:53:44 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a80bfbe-6bc2-49aa-b4be-5c0476513fcb]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:53:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a69199e7-160b-47c8-ac98-24db5337a93f tempest-VolumesGetTest-1169103151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-420a03f4-8808-47e4-b770-db5bbb69492c {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:44 devstack sudo[105242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d08dbe7-a278-4e56-8745-e8e3473f87a6 Sep 08 06:53:44 devstack sudo[105242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:44 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-6601e66d-1969-4ca7-954f-1f8d8d6c51f7 tempest-VolumesGetTest-1169103151 None] Lock "cinder-66a2d426-56a4-4aaf-871e-a558b34caf83-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:53:44 devstack sudo[105248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-420a03f4-8808-47e4-b770-db5bbb69492c Sep 08 06:53:44 devstack sudo[105248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:44 devstack sudo[105242]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-446f20f6-107f-47d7-ac3e-59657e368543 tempest-GroupSnapshotsV319Test-2145241500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d08dbe7-a278-4e56-8745-e8e3473f87a6" returned: 0 in 0.422s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-446f20f6-107f-47d7-ac3e-59657e368543 tempest-GroupSnapshotsV319Test-2145241500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d08dbe7-a278-4e56-8745-e8e3473f87a6.c7994b93-6a01-4081-bf9c-74fe54380865 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:44 devstack sudo[105262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d08dbe7-a278-4e56-8745-e8e3473f87a6.c7994b93-6a01-4081-bf9c-74fe54380865 Sep 08 06:53:44 devstack sudo[105262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:44 devstack sudo[105248]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a69199e7-160b-47c8-ac98-24db5337a93f tempest-VolumesGetTest-1169103151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-420a03f4-8808-47e4-b770-db5bbb69492c" returned: 0 in 0.473s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a69199e7-160b-47c8-ac98-24db5337a93f tempest-VolumesGetTest-1169103151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-420a03f4-8808-47e4-b770-db5bbb69492c {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:44 devstack sudo[105274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-420a03f4-8808-47e4-b770-db5bbb69492c Sep 08 06:53:44 devstack sudo[105274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:45 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-019ddf15-1541-447c-ad42-230fbb1fbfe2 tempest-VolumesListTestJSON-1911911712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:53:45 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-019ddf15-1541-447c-ad42-230fbb1fbfe2 tempest-VolumesListTestJSON-1911911712 None] Flow 'volume_create_manager' (383d991c-6804-4aee-929a-d5eb512c3760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:53:45 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-019ddf15-1541-447c-ad42-230fbb1fbfe2 tempest-VolumesListTestJSON-1911911712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5807e9d8-24cf-490f-90bb-e9f88e9abc39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:45 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-019ddf15-1541-447c-ad42-230fbb1fbfe2 tempest-VolumesListTestJSON-1911911712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5807e9d8-24cf-490f-90bb-e9f88e9abc39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:53:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-591157867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=074637c8-b45f-4e6c-8cc9-f3d078313588,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0ca6841680ca45eb9be94b5c845ae281',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:53:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:53:45Z,use_quota=True,user_id='10ea20944088440e80740ea05515a885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:45 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-019ddf15-1541-447c-ad42-230fbb1fbfe2 tempest-VolumesListTestJSON-1911911712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c131352f-590a-474f-8776-530248f499e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:45 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-019ddf15-1541-447c-ad42-230fbb1fbfe2 tempest-VolumesListTestJSON-1911911712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c131352f-590a-474f-8776-530248f499e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:45 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-019ddf15-1541-447c-ad42-230fbb1fbfe2 tempest-VolumesListTestJSON-1911911712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aba6ff78-9c2c-4bf9-a8ad-c804d0766a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:45 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-019ddf15-1541-447c-ad42-230fbb1fbfe2 tempest-VolumesListTestJSON-1911911712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aba6ff78-9c2c-4bf9-a8ad-c804d0766a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '074637c8-b45f-4e6c-8cc9-f3d078313588', 'volume_name': 'volume-074637c8-b45f-4e6c-8cc9-f3d078313588', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:45 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-019ddf15-1541-447c-ad42-230fbb1fbfe2 tempest-VolumesListTestJSON-1911911712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d50541ed-b1e7-437d-a928-ece2bb089893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:45 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-019ddf15-1541-447c-ad42-230fbb1fbfe2 tempest-VolumesListTestJSON-1911911712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d50541ed-b1e7-437d-a928-ece2bb089893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:45 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-019ddf15-1541-447c-ad42-230fbb1fbfe2 tempest-VolumesListTestJSON-1911911712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a009abf7-26cc-43bf-bc2b-933b85686baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:45 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-019ddf15-1541-447c-ad42-230fbb1fbfe2 tempest-VolumesListTestJSON-1911911712 None] Volume 074637c8-b45f-4e6c-8cc9-f3d078313588: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-074637c8-b45f-4e6c-8cc9-f3d078313588', 'volume_size': 1} Sep 08 06:53:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-019ddf15-1541-447c-ad42-230fbb1fbfe2 tempest-VolumesListTestJSON-1911911712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:53:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-019ddf15-1541-447c-ad42-230fbb1fbfe2 tempest-VolumesListTestJSON-1911911712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:53:45 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-019ddf15-1541-447c-ad42-230fbb1fbfe2 tempest-VolumesListTestJSON-1911911712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:53:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-591157867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=074637c8-b45f-4e6c-8cc9-f3d078313588,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0ca6841680ca45eb9be94b5c845ae281',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:53:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:53:45Z,use_quota=True,user_id='10ea20944088440e80740ea05515a885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:53:45 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-019ddf15-1541-447c-ad42-230fbb1fbfe2 tempest-VolumesListTestJSON-1911911712 None] Creating volume 074637c8-b45f-4e6c-8cc9-f3d078313588 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:53:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-019ddf15-1541-447c-ad42-230fbb1fbfe2 tempest-VolumesListTestJSON-1911911712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:53:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-019ddf15-1541-447c-ad42-230fbb1fbfe2 tempest-VolumesListTestJSON-1911911712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:53:45 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-019ddf15-1541-447c-ad42-230fbb1fbfe2 tempest-VolumesListTestJSON-1911911712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:53:45 devstack sudo[105262]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:45 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-019ddf15-1541-447c-ad42-230fbb1fbfe2 tempest-VolumesListTestJSON-1911911712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:53:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-019ddf15-1541-447c-ad42-230fbb1fbfe2 tempest-VolumesListTestJSON-1911911712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:53:45 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-019ddf15-1541-447c-ad42-230fbb1fbfe2 tempest-VolumesListTestJSON-1911911712 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:53:45 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-019ddf15-1541-447c-ad42-230fbb1fbfe2 tempest-VolumesListTestJSON-1911911712 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:53:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-019ddf15-1541-447c-ad42-230fbb1fbfe2 tempest-VolumesListTestJSON-1911911712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-074637c8-b45f-4e6c-8cc9-f3d078313588 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-446f20f6-107f-47d7-ac3e-59657e368543 tempest-GroupSnapshotsV319Test-2145241500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d08dbe7-a278-4e56-8745-e8e3473f87a6.c7994b93-6a01-4081-bf9c-74fe54380865" returned: 0 in 0.534s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-446f20f6-107f-47d7-ac3e-59657e368543 tempest-GroupSnapshotsV319Test-2145241500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d08dbe7-a278-4e56-8745-e8e3473f87a6.c7994b93-6a01-4081-bf9c-74fe54380865 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:45 devstack sudo[105274]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a69199e7-160b-47c8-ac98-24db5337a93f tempest-VolumesGetTest-1169103151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-420a03f4-8808-47e4-b770-db5bbb69492c" returned: 0 in 0.368s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:45 devstack sudo[105292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-074637c8-b45f-4e6c-8cc9-f3d078313588 1073741824 Sep 08 06:53:45 devstack sudo[105292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:45 devstack sudo[105293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d08dbe7-a278-4e56-8745-e8e3473f87a6.c7994b93-6a01-4081-bf9c-74fe54380865 Sep 08 06:53:45 devstack sudo[105293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:45 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-a69199e7-160b-47c8-ac98-24db5337a93f tempest-VolumesGetTest-1169103151 None] Lock "cinder-quobyte-420a03f4-8808-47e4-b770-db5bbb69492c" released by "delete_volume" :: held 0.920s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:53:45 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-a69199e7-160b-47c8-ac98-24db5337a93f tempest-VolumesGetTest-1169103151 None] Created reservations ['9fe62473-dd5e-446b-bd63-74ca9206826f', 'd697dad9-a706-433f-bbfd-5eb3ab961205', '456549fd-c72f-4691-b37a-cd3f5f85815f', '778c7625-9217-4c06-b0a5-0533c59e4f57'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:53:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a69199e7-160b-47c8-ac98-24db5337a93f tempest-VolumesGetTest-1169103151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:53:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a69199e7-160b-47c8-ac98-24db5337a93f tempest-VolumesGetTest-1169103151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:53:45 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-a69199e7-160b-47c8-ac98-24db5337a93f tempest-VolumesGetTest-1169103151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:53:45 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-a69199e7-160b-47c8-ac98-24db5337a93f tempest-VolumesGetTest-1169103151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:53:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a69199e7-160b-47c8-ac98-24db5337a93f tempest-VolumesGetTest-1169103151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:53:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a69199e7-160b-47c8-ac98-24db5337a93f tempest-VolumesGetTest-1169103151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:45 devstack sudo[105302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:53:45 devstack sudo[105302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:45 devstack sudo[105293]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-446f20f6-107f-47d7-ac3e-59657e368543 tempest-GroupSnapshotsV319Test-2145241500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d08dbe7-a278-4e56-8745-e8e3473f87a6.c7994b93-6a01-4081-bf9c-74fe54380865" returned: 0 in 0.327s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:45 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-446f20f6-107f-47d7-ac3e-59657e368543 tempest-GroupSnapshotsV319Test-2145241500 None] Lock "cinder-quobyte-c7994b93-6a01-4081-bf9c-74fe54380865" released by "_delete_snapshot" :: held 2.042s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:53:45 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-446f20f6-107f-47d7-ac3e-59657e368543 tempest-GroupSnapshotsV319Test-2145241500 None] Lock "cinder-quobyte-4d08dbe7-a278-4e56-8745-e8e3473f87a6" released by "delete_snapshot" :: held 2.100s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:53:45 devstack cinder-volume[87507]: WARNING cinder.quota [None req-446f20f6-107f-47d7-ac3e-59657e368543 tempest-GroupSnapshotsV319Test-2145241500 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-89088910 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-89088910, it is now deprecated. Please use the default quota class for default quota. Sep 08 06:53:45 devstack cinder-volume[87507]: WARNING cinder.quota [None req-446f20f6-107f-47d7-ac3e-59657e368543 tempest-GroupSnapshotsV319Test-2145241500 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-89088910 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-89088910, it is now deprecated. Please use the default quota class for default quota. Sep 08 06:53:45 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-446f20f6-107f-47d7-ac3e-59657e368543 tempest-GroupSnapshotsV319Test-2145241500 None] Created reservations ['841958b0-6c0c-46a6-a0bd-802b4b67c5de', 'f8ff37da-8a3c-4fd4-81a2-981f530706d7', '4fbca028-7697-4844-85f9-b8152d76443e', '3c6cf049-1370-4828-a903-00fc825ee6c9'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:53:45 devstack sudo[105292]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-019ddf15-1541-447c-ad42-230fbb1fbfe2 tempest-VolumesListTestJSON-1911911712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-074637c8-b45f-4e6c-8cc9-f3d078313588 1073741824" returned: 0 in 0.531s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:45 devstack sudo[105302]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a69199e7-160b-47c8-ac98-24db5337a93f tempest-VolumesGetTest-1169103151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.313s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:45 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-a69199e7-160b-47c8-ac98-24db5337a93f tempest-VolumesGetTest-1169103151 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:53:45 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-a69199e7-160b-47c8-ac98-24db5337a93f tempest-VolumesGetTest-1169103151 None] Deleted volume successfully. Sep 08 06:53:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-019ddf15-1541-447c-ad42-230fbb1fbfe2 tempest-VolumesListTestJSON-1911911712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-074637c8-b45f-4e6c-8cc9-f3d078313588 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:45 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-a69199e7-160b-47c8-ac98-24db5337a93f tempest-VolumesGetTest-1169103151 None] Lock "cinder-420a03f4-8808-47e4-b770-db5bbb69492c-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:53:45 devstack sudo[105319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-074637c8-b45f-4e6c-8cc9-f3d078313588 Sep 08 06:53:45 devstack sudo[105319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:45 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-446f20f6-107f-47d7-ac3e-59657e368543 tempest-GroupSnapshotsV319Test-2145241500 None] group_snapshot 570de893-9131-4686-ae11-6d968eb48a14: deleted successfully Sep 08 06:53:46 devstack sudo[105319]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-019ddf15-1541-447c-ad42-230fbb1fbfe2 tempest-VolumesListTestJSON-1911911712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-074637c8-b45f-4e6c-8cc9-f3d078313588" returned: 0 in 0.298s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:46 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-019ddf15-1541-447c-ad42-230fbb1fbfe2 tempest-VolumesListTestJSON-1911911712 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:53:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-019ddf15-1541-447c-ad42-230fbb1fbfe2 tempest-VolumesListTestJSON-1911911712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:53:46 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-019ddf15-1541-447c-ad42-230fbb1fbfe2 tempest-VolumesListTestJSON-1911911712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a009abf7-26cc-43bf-bc2b-933b85686baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-074637c8-b45f-4e6c-8cc9-f3d078313588', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:46 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-019ddf15-1541-447c-ad42-230fbb1fbfe2 tempest-VolumesListTestJSON-1911911712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e9c8164-4b3f-419f-8517-fb7653157874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:46 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-019ddf15-1541-447c-ad42-230fbb1fbfe2 tempest-VolumesListTestJSON-1911911712 None] Volume volume-074637c8-b45f-4e6c-8cc9-f3d078313588 (074637c8-b45f-4e6c-8cc9-f3d078313588): created successfully Sep 08 06:53:46 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-019ddf15-1541-447c-ad42-230fbb1fbfe2 tempest-VolumesListTestJSON-1911911712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e9c8164-4b3f-419f-8517-fb7653157874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:46 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-019ddf15-1541-447c-ad42-230fbb1fbfe2 tempest-VolumesListTestJSON-1911911712 None] Flow 'volume_create_manager' (383d991c-6804-4aee-929a-d5eb512c3760) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:53:46 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-019ddf15-1541-447c-ad42-230fbb1fbfe2 tempest-VolumesListTestJSON-1911911712 None] Created volume successfully. Sep 08 06:53:47 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-5dd364ab-5f05-47f5-90b6-5b59024df874 tempest-GroupSnapshotsV319Test-2145241500 None] Acquiring lock "cinder-quobyte-4d08dbe7-a278-4e56-8745-e8e3473f87a6" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:53:47 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-5dd364ab-5f05-47f5-90b6-5b59024df874 tempest-GroupSnapshotsV319Test-2145241500 None] Lock "cinder-quobyte-4d08dbe7-a278-4e56-8745-e8e3473f87a6" acquired by "delete_volume" :: waited 0.027s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:53:47 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fca51e5-5056-41a3-b837-36efcadaeed7]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:53:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5dd364ab-5f05-47f5-90b6-5b59024df874 tempest-GroupSnapshotsV319Test-2145241500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d08dbe7-a278-4e56-8745-e8e3473f87a6 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:47 devstack sudo[105370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d08dbe7-a278-4e56-8745-e8e3473f87a6 Sep 08 06:53:47 devstack sudo[105370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:47 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5045c0b-3a8d-4793-91ff-7ce901e4a44f tempest-VolumesGetTest-1169103151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:53:47 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-c5045c0b-3a8d-4793-91ff-7ce901e4a44f tempest-VolumesGetTest-1169103151 None] Flow 'volume_create_manager' (cd964343-6a7f-4b17-8c9c-048b67de0312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:53:47 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-c5045c0b-3a8d-4793-91ff-7ce901e4a44f tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0804f3d1-f3f8-4688-a517-a5f58c3e3480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:47 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-c5045c0b-3a8d-4793-91ff-7ce901e4a44f tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0804f3d1-f3f8-4688-a517-a5f58c3e3480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:53:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-758448650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=962d92b0-474c-4d9e-87c0-5b460d4541ae,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d485bed2a56746eebce00d898e0d496c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:53:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:53:47Z,use_quota=True,user_id='eb60e87e5f514c66b1b8c39892da34fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:47 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-c5045c0b-3a8d-4793-91ff-7ce901e4a44f tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1984be4e-181b-4222-8e98-966082b0dab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:47 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-c5045c0b-3a8d-4793-91ff-7ce901e4a44f tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1984be4e-181b-4222-8e98-966082b0dab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:47 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-c5045c0b-3a8d-4793-91ff-7ce901e4a44f tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5356a2c1-778f-4407-bd5d-b71713f46ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:47 devstack cinder-volume[87507]: DEBUG cinder.image.glance [None req-c5045c0b-3a8d-4793-91ff-7ce901e4a44f tempest-VolumesGetTest-1169103151 None] Creating Keystone auth plugin from conf {{(pid=87507) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 08 06:53:47 devstack sudo[105370]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5dd364ab-5f05-47f5-90b6-5b59024df874 tempest-GroupSnapshotsV319Test-2145241500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d08dbe7-a278-4e56-8745-e8e3473f87a6" returned: 0 in 0.542s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5dd364ab-5f05-47f5-90b6-5b59024df874 tempest-GroupSnapshotsV319Test-2145241500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d08dbe7-a278-4e56-8745-e8e3473f87a6 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:47 devstack sudo[105391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d08dbe7-a278-4e56-8745-e8e3473f87a6 Sep 08 06:53:47 devstack sudo[105391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:47 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-67a470d4-171c-455a-9c63-fcdc3405ad96 tempest-VolumesListTestJSON-1911911712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:53:47 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-67a470d4-171c-455a-9c63-fcdc3405ad96 tempest-VolumesListTestJSON-1911911712 None] Flow 'volume_create_manager' (75b98b63-3cf5-4888-9f52-8b374f9adec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:53:47 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-67a470d4-171c-455a-9c63-fcdc3405ad96 tempest-VolumesListTestJSON-1911911712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (494b17ac-3890-41d1-8c79-c02b3ab29f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:47 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-c5045c0b-3a8d-4793-91ff-7ce901e4a44f tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5356a2c1-778f-4407-bd5d-b71713f46ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '962d92b0-474c-4d9e-87c0-5b460d4541ae', 'volume_name': 'volume-962d92b0-474c-4d9e-87c0-5b460d4541ae', 'volume_size': 1, 'image_id': '69da6bac-8b7b-48c5-af3b-29466563452a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/69da6bac-8b7b-48c5-af3b-29466563452a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '95d2d5dbb3e04d74b8da31fc6ee47f98', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '69da6bac-8b7b-48c5-af3b-29466563452a', 'created_at': datetime.datetime(2026, 9, 8, 4, 36, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 4, 36, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/69da6bac-8b7b-48c5-af3b-29466563452a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:47 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-c5045c0b-3a8d-4793-91ff-7ce901e4a44f tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f820d39-b869-458a-8f1b-b0c12bc1c748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:47 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-c5045c0b-3a8d-4793-91ff-7ce901e4a44f tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f820d39-b869-458a-8f1b-b0c12bc1c748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:47 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-c5045c0b-3a8d-4793-91ff-7ce901e4a44f tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a37e2201-664d-47bf-91cf-d164a255e25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:47 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-c5045c0b-3a8d-4793-91ff-7ce901e4a44f tempest-VolumesGetTest-1169103151 None] Volume 962d92b0-474c-4d9e-87c0-5b460d4541ae: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-962d92b0-474c-4d9e-87c0-5b460d4541ae', 'volume_size': 1, 'image_id': '69da6bac-8b7b-48c5-af3b-29466563452a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/69da6bac-8b7b-48c5-af3b-29466563452a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '95d2d5dbb3e04d74b8da31fc6ee47f98', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '69da6bac-8b7b-48c5-af3b-29466563452a', 'created_at': datetime.datetime(2026, 9, 8, 4, 36, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 4, 36, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/69da6bac-8b7b-48c5-af3b-29466563452a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 08 06:53:47 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5045c0b-3a8d-4793-91ff-7ce901e4a44f tempest-VolumesGetTest-1169103151 None] Trying to clone 962d92b0-474c-4d9e-87c0-5b460d4541ae from image 69da6bac-8b7b-48c5-af3b-29466563452a at location (None, [{'url': 'file:///opt/stack/data/glance/images/69da6bac-8b7b-48c5-af3b-29466563452a', 'metadata': {}}]). {{(pid=87507) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 08 06:53:48 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-67a470d4-171c-455a-9c63-fcdc3405ad96 tempest-VolumesListTestJSON-1911911712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (494b17ac-3890-41d1-8c79-c02b3ab29f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:53:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1638846148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3761bf6-9393-44d5-a3b2-68b13535dca4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0ca6841680ca45eb9be94b5c845ae281',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:53:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:53:48Z,use_quota=True,user_id='10ea20944088440e80740ea05515a885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:48 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-67a470d4-171c-455a-9c63-fcdc3405ad96 tempest-VolumesListTestJSON-1911911712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b15eebd-97ab-4696-962a-ab8260d735a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:48 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-67a470d4-171c-455a-9c63-fcdc3405ad96 tempest-VolumesListTestJSON-1911911712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b15eebd-97ab-4696-962a-ab8260d735a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:48 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-67a470d4-171c-455a-9c63-fcdc3405ad96 tempest-VolumesListTestJSON-1911911712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d499dc39-0c8a-49a5-a863-a5b27b9dd6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:48 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-67a470d4-171c-455a-9c63-fcdc3405ad96 tempest-VolumesListTestJSON-1911911712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d499dc39-0c8a-49a5-a863-a5b27b9dd6df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3761bf6-9393-44d5-a3b2-68b13535dca4', 'volume_name': 'volume-b3761bf6-9393-44d5-a3b2-68b13535dca4', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:48 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-67a470d4-171c-455a-9c63-fcdc3405ad96 tempest-VolumesListTestJSON-1911911712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07efed75-9ab4-40af-b662-77b84fb576e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:48 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-67a470d4-171c-455a-9c63-fcdc3405ad96 tempest-VolumesListTestJSON-1911911712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07efed75-9ab4-40af-b662-77b84fb576e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:48 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-67a470d4-171c-455a-9c63-fcdc3405ad96 tempest-VolumesListTestJSON-1911911712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ae014cb-5472-4983-9f86-3ab80cde7d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:48 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-67a470d4-171c-455a-9c63-fcdc3405ad96 tempest-VolumesListTestJSON-1911911712 None] Volume b3761bf6-9393-44d5-a3b2-68b13535dca4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3761bf6-9393-44d5-a3b2-68b13535dca4', 'volume_size': 1} Sep 08 06:53:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-67a470d4-171c-455a-9c63-fcdc3405ad96 tempest-VolumesListTestJSON-1911911712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:53:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-67a470d4-171c-455a-9c63-fcdc3405ad96 tempest-VolumesListTestJSON-1911911712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:53:48 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-67a470d4-171c-455a-9c63-fcdc3405ad96 tempest-VolumesListTestJSON-1911911712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:53:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1638846148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3761bf6-9393-44d5-a3b2-68b13535dca4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0ca6841680ca45eb9be94b5c845ae281',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:53:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:53:48Z,use_quota=True,user_id='10ea20944088440e80740ea05515a885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:53:48 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-67a470d4-171c-455a-9c63-fcdc3405ad96 tempest-VolumesListTestJSON-1911911712 None] Creating volume b3761bf6-9393-44d5-a3b2-68b13535dca4 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:53:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-67a470d4-171c-455a-9c63-fcdc3405ad96 tempest-VolumesListTestJSON-1911911712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:53:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-67a470d4-171c-455a-9c63-fcdc3405ad96 tempest-VolumesListTestJSON-1911911712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:53:48 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-67a470d4-171c-455a-9c63-fcdc3405ad96 tempest-VolumesListTestJSON-1911911712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:53:48 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-67a470d4-171c-455a-9c63-fcdc3405ad96 tempest-VolumesListTestJSON-1911911712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:53:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-67a470d4-171c-455a-9c63-fcdc3405ad96 tempest-VolumesListTestJSON-1911911712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:53:48 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-67a470d4-171c-455a-9c63-fcdc3405ad96 tempest-VolumesListTestJSON-1911911712 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:53:48 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-67a470d4-171c-455a-9c63-fcdc3405ad96 tempest-VolumesListTestJSON-1911911712 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:53:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-67a470d4-171c-455a-9c63-fcdc3405ad96 tempest-VolumesListTestJSON-1911911712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b3761bf6-9393-44d5-a3b2-68b13535dca4 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:48 devstack sudo[105399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b3761bf6-9393-44d5-a3b2-68b13535dca4 1073741824 Sep 08 06:53:48 devstack sudo[105399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:48 devstack sudo[105391]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5dd364ab-5f05-47f5-90b6-5b59024df874 tempest-GroupSnapshotsV319Test-2145241500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d08dbe7-a278-4e56-8745-e8e3473f87a6" returned: 0 in 0.337s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:48 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-5dd364ab-5f05-47f5-90b6-5b59024df874 tempest-GroupSnapshotsV319Test-2145241500 None] Lock "cinder-quobyte-4d08dbe7-a278-4e56-8745-e8e3473f87a6" released by "delete_volume" :: held 0.978s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:53:48 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-5dd364ab-5f05-47f5-90b6-5b59024df874 tempest-GroupSnapshotsV319Test-2145241500 None] Created reservations ['0a6909ba-c34b-4703-a8ce-eabf4ce0cc25'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:53:48 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-c5045c0b-3a8d-4793-91ff-7ce901e4a44f tempest-VolumesGetTest-1169103151 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_fwt0yue1devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87507) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 08 06:53:48 devstack cinder-volume[87507]: INFO cinder.image.image_utils [None req-c5045c0b-3a8d-4793-91ff-7ce901e4a44f tempest-VolumesGetTest-1169103151 None] Image download 20.69 MB at 20.69 MB/s Sep 08 06:53:48 devstack cinder-volume[87507]: WARNING cinder.quota [None req-5dd364ab-5f05-47f5-90b6-5b59024df874 tempest-GroupSnapshotsV319Test-2145241500 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-89088910 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-89088910, it is now deprecated. Please use the default quota class for default quota. Sep 08 06:53:48 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-5dd364ab-5f05-47f5-90b6-5b59024df874 tempest-GroupSnapshotsV319Test-2145241500 None] Created reservations ['6f2d5619-4002-46e5-995a-9563f324fc78', '85962186-def4-46d2-b0b8-72bb3c46de60', '250bd76e-7d97-48ea-be16-64803ab8d002', 'b67a4d24-4eb7-4363-8163-1782243263ad'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:53:48 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae19f13-dc9f-4dd0-aeab-b583afc68a7f]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:53:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-c5045c0b-3a8d-4793-91ff-7ce901e4a44f tempest-VolumesGetTest-1169103151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_fwt0yue1devstack@QuobyteHD {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-5dd364ab-5f05-47f5-90b6-5b59024df874 tempest-GroupSnapshotsV319Test-2145241500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:53:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-5dd364ab-5f05-47f5-90b6-5b59024df874 tempest-GroupSnapshotsV319Test-2145241500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:53:48 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-5dd364ab-5f05-47f5-90b6-5b59024df874 tempest-GroupSnapshotsV319Test-2145241500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:53:48 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-5dd364ab-5f05-47f5-90b6-5b59024df874 tempest-GroupSnapshotsV319Test-2145241500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:53:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-5dd364ab-5f05-47f5-90b6-5b59024df874 tempest-GroupSnapshotsV319Test-2145241500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:53:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5dd364ab-5f05-47f5-90b6-5b59024df874 tempest-GroupSnapshotsV319Test-2145241500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:48 devstack sudo[105399]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:48 devstack sudo[105421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_fwt0yue1devstack@QuobyteHD Sep 08 06:53:48 devstack sudo[105421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-67a470d4-171c-455a-9c63-fcdc3405ad96 tempest-VolumesListTestJSON-1911911712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b3761bf6-9393-44d5-a3b2-68b13535dca4 1073741824" returned: 0 in 0.568s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:48 devstack sudo[105426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:53:48 devstack sudo[105426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-67a470d4-171c-455a-9c63-fcdc3405ad96 tempest-VolumesListTestJSON-1911911712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b3761bf6-9393-44d5-a3b2-68b13535dca4 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:48 devstack sudo[105429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b3761bf6-9393-44d5-a3b2-68b13535dca4 Sep 08 06:53:48 devstack sudo[105429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:48 devstack sudo[105421]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-c5045c0b-3a8d-4793-91ff-7ce901e4a44f tempest-VolumesGetTest-1169103151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_fwt0yue1devstack@QuobyteHD" returned: 0 in 0.465s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:48 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-c5045c0b-3a8d-4793-91ff-7ce901e4a44f tempest-VolumesGetTest-1169103151 None] Temporary image 69da6bac-8b7b-48c5-af3b-29466563452a is fetched for user eb60e87e5f514c66b1b8c39892da34fd. {{(pid=87507) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 08 06:53:49 devstack sudo[105426]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5dd364ab-5f05-47f5-90b6-5b59024df874 tempest-GroupSnapshotsV319Test-2145241500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.443s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:49 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-5dd364ab-5f05-47f5-90b6-5b59024df874 tempest-GroupSnapshotsV319Test-2145241500 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:53:49 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-5dd364ab-5f05-47f5-90b6-5b59024df874 tempest-GroupSnapshotsV319Test-2145241500 None] Delete group completed successfully. Sep 08 06:53:49 devstack sudo[105429]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-67a470d4-171c-455a-9c63-fcdc3405ad96 tempest-VolumesListTestJSON-1911911712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b3761bf6-9393-44d5-a3b2-68b13535dca4" returned: 0 in 0.420s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:49 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-67a470d4-171c-455a-9c63-fcdc3405ad96 tempest-VolumesListTestJSON-1911911712 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:53:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-67a470d4-171c-455a-9c63-fcdc3405ad96 tempest-VolumesListTestJSON-1911911712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:53:49 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[194b0951-c004-4ea5-afd8-3c47755156b0]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:53:49 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-67a470d4-171c-455a-9c63-fcdc3405ad96 tempest-VolumesListTestJSON-1911911712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ae014cb-5472-4983-9f86-3ab80cde7d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3761bf6-9393-44d5-a3b2-68b13535dca4', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:49 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-67a470d4-171c-455a-9c63-fcdc3405ad96 tempest-VolumesListTestJSON-1911911712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebbffe41-1e1a-4cc2-8d8e-1628f1575ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-c5045c0b-3a8d-4793-91ff-7ce901e4a44f tempest-VolumesGetTest-1169103151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_fwt0yue1devstack@QuobyteHD {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:49 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-67a470d4-171c-455a-9c63-fcdc3405ad96 tempest-VolumesListTestJSON-1911911712 None] Volume volume-b3761bf6-9393-44d5-a3b2-68b13535dca4 (b3761bf6-9393-44d5-a3b2-68b13535dca4): created successfully Sep 08 06:53:49 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-67a470d4-171c-455a-9c63-fcdc3405ad96 tempest-VolumesListTestJSON-1911911712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebbffe41-1e1a-4cc2-8d8e-1628f1575ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:49 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-67a470d4-171c-455a-9c63-fcdc3405ad96 tempest-VolumesListTestJSON-1911911712 None] Flow 'volume_create_manager' (75b98b63-3cf5-4888-9f52-8b374f9adec7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:53:49 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-67a470d4-171c-455a-9c63-fcdc3405ad96 tempest-VolumesListTestJSON-1911911712 None] Created volume successfully. Sep 08 06:53:49 devstack sudo[105452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_fwt0yue1devstack@QuobyteHD Sep 08 06:53:49 devstack sudo[105452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:49 devstack sudo[105452]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-c5045c0b-3a8d-4793-91ff-7ce901e4a44f tempest-VolumesGetTest-1169103151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_fwt0yue1devstack@QuobyteHD" returned: 0 in 0.355s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-c5045c0b-3a8d-4793-91ff-7ce901e4a44f tempest-VolumesGetTest-1169103151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:53:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-c5045c0b-3a8d-4793-91ff-7ce901e4a44f tempest-VolumesGetTest-1169103151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:53:49 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-c5045c0b-3a8d-4793-91ff-7ce901e4a44f tempest-VolumesGetTest-1169103151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:53:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-758448650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=962d92b0-474c-4d9e-87c0-5b460d4541ae,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d485bed2a56746eebce00d898e0d496c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:53:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:53:47Z,use_quota=True,user_id='eb60e87e5f514c66b1b8c39892da34fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:53:49 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-c5045c0b-3a8d-4793-91ff-7ce901e4a44f tempest-VolumesGetTest-1169103151 None] Creating volume 962d92b0-474c-4d9e-87c0-5b460d4541ae {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:53:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-c5045c0b-3a8d-4793-91ff-7ce901e4a44f tempest-VolumesGetTest-1169103151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:53:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-c5045c0b-3a8d-4793-91ff-7ce901e4a44f tempest-VolumesGetTest-1169103151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:53:49 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-c5045c0b-3a8d-4793-91ff-7ce901e4a44f tempest-VolumesGetTest-1169103151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:53:49 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-c5045c0b-3a8d-4793-91ff-7ce901e4a44f tempest-VolumesGetTest-1169103151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:53:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-c5045c0b-3a8d-4793-91ff-7ce901e4a44f tempest-VolumesGetTest-1169103151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:53:49 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-c5045c0b-3a8d-4793-91ff-7ce901e4a44f tempest-VolumesGetTest-1169103151 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:53:49 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-c5045c0b-3a8d-4793-91ff-7ce901e4a44f tempest-VolumesGetTest-1169103151 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:53:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-c5045c0b-3a8d-4793-91ff-7ce901e4a44f tempest-VolumesGetTest-1169103151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-962d92b0-474c-4d9e-87c0-5b460d4541ae 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:49 devstack sudo[105466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-962d92b0-474c-4d9e-87c0-5b460d4541ae 1073741824 Sep 08 06:53:49 devstack sudo[105466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:50 devstack sudo[105466]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-c5045c0b-3a8d-4793-91ff-7ce901e4a44f tempest-VolumesGetTest-1169103151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-962d92b0-474c-4d9e-87c0-5b460d4541ae 1073741824" returned: 0 in 0.585s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-c5045c0b-3a8d-4793-91ff-7ce901e4a44f tempest-VolumesGetTest-1169103151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-962d92b0-474c-4d9e-87c0-5b460d4541ae {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:50 devstack sudo[105495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-962d92b0-474c-4d9e-87c0-5b460d4541ae Sep 08 06:53:50 devstack sudo[105495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:50 devstack sudo[105495]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-c5045c0b-3a8d-4793-91ff-7ce901e4a44f tempest-VolumesGetTest-1169103151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-962d92b0-474c-4d9e-87c0-5b460d4541ae" returned: 0 in 0.320s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:50 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-c5045c0b-3a8d-4793-91ff-7ce901e4a44f tempest-VolumesGetTest-1169103151 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:53:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-c5045c0b-3a8d-4793-91ff-7ce901e4a44f tempest-VolumesGetTest-1169103151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:53:50 devstack cinder-volume[87507]: DEBUG cinder.volume.volume_utils [None req-c5045c0b-3a8d-4793-91ff-7ce901e4a44f tempest-VolumesGetTest-1169103151 None] Attempting download of 69da6bac-8b7b-48c5-af3b-29466563452a ((None, [{'url': 'file:///opt/stack/data/glance/images/69da6bac-8b7b-48c5-af3b-29466563452a', 'metadata': {}}])) to volume 962d92b0-474c-4d9e-87c0-5b460d4541ae. {{(pid=87507) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 08 06:53:50 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04b8d29-ed86-42fb-bedb-62ea4d0d0ba8]: (4, 'raw') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:53:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-c5045c0b-3a8d-4793-91ff-7ce901e4a44f tempest-VolumesGetTest-1169103151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_69da6bac-8b7b-48c5-af3b-29466563452a_bu7xxc5o {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:50 devstack sudo[105510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_69da6bac-8b7b-48c5-af3b-29466563452a_bu7xxc5o Sep 08 06:53:50 devstack sudo[105510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:50 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca9cea89-bd3e-4970-9528-21cb2ad94d90 tempest-VolumesListTestJSON-1911911712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:53:50 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ca9cea89-bd3e-4970-9528-21cb2ad94d90 tempest-VolumesListTestJSON-1911911712 None] Flow 'volume_create_manager' (3bd470aa-4a62-4572-8fb1-799ad62029aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:53:50 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ca9cea89-bd3e-4970-9528-21cb2ad94d90 tempest-VolumesListTestJSON-1911911712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e73cf95f-c9e8-43af-9fe2-f5ba3251b3bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:50 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ca9cea89-bd3e-4970-9528-21cb2ad94d90 tempest-VolumesListTestJSON-1911911712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e73cf95f-c9e8-43af-9fe2-f5ba3251b3bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-131809520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e276df23-9a72-4b30-afae-e6d5b7c85848,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0ca6841680ca45eb9be94b5c845ae281',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:53:51Z,use_quota=True,user_id='10ea20944088440e80740ea05515a885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:50 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ca9cea89-bd3e-4970-9528-21cb2ad94d90 tempest-VolumesListTestJSON-1911911712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f55bf1e-0c2a-43e3-98da-0fd41e8ce2fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:50 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ca9cea89-bd3e-4970-9528-21cb2ad94d90 tempest-VolumesListTestJSON-1911911712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f55bf1e-0c2a-43e3-98da-0fd41e8ce2fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:50 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ca9cea89-bd3e-4970-9528-21cb2ad94d90 tempest-VolumesListTestJSON-1911911712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21a8fb0f-5ad2-4eb9-9f96-9be31733b913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:51 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ca9cea89-bd3e-4970-9528-21cb2ad94d90 tempest-VolumesListTestJSON-1911911712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21a8fb0f-5ad2-4eb9-9f96-9be31733b913) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e276df23-9a72-4b30-afae-e6d5b7c85848', 'volume_name': 'volume-e276df23-9a72-4b30-afae-e6d5b7c85848', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:51 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ca9cea89-bd3e-4970-9528-21cb2ad94d90 tempest-VolumesListTestJSON-1911911712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6266186d-62e9-46da-baa8-1a00804c28f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:51 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ca9cea89-bd3e-4970-9528-21cb2ad94d90 tempest-VolumesListTestJSON-1911911712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6266186d-62e9-46da-baa8-1a00804c28f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:51 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ca9cea89-bd3e-4970-9528-21cb2ad94d90 tempest-VolumesListTestJSON-1911911712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aca588f-5fbc-45f4-9dd0-10c31c493a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:51 devstack sudo[105510]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:51 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-ca9cea89-bd3e-4970-9528-21cb2ad94d90 tempest-VolumesListTestJSON-1911911712 None] Volume e276df23-9a72-4b30-afae-e6d5b7c85848: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e276df23-9a72-4b30-afae-e6d5b7c85848', 'volume_size': 1} Sep 08 06:53:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-ca9cea89-bd3e-4970-9528-21cb2ad94d90 tempest-VolumesListTestJSON-1911911712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:53:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-ca9cea89-bd3e-4970-9528-21cb2ad94d90 tempest-VolumesListTestJSON-1911911712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:53:51 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-ca9cea89-bd3e-4970-9528-21cb2ad94d90 tempest-VolumesListTestJSON-1911911712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-131809520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e276df23-9a72-4b30-afae-e6d5b7c85848,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0ca6841680ca45eb9be94b5c845ae281',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:53:51Z,use_quota=True,user_id='10ea20944088440e80740ea05515a885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:53:51 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-ca9cea89-bd3e-4970-9528-21cb2ad94d90 tempest-VolumesListTestJSON-1911911712 None] Creating volume e276df23-9a72-4b30-afae-e6d5b7c85848 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:53:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-ca9cea89-bd3e-4970-9528-21cb2ad94d90 tempest-VolumesListTestJSON-1911911712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:53:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-ca9cea89-bd3e-4970-9528-21cb2ad94d90 tempest-VolumesListTestJSON-1911911712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:53:51 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-ca9cea89-bd3e-4970-9528-21cb2ad94d90 tempest-VolumesListTestJSON-1911911712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:53:51 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-ca9cea89-bd3e-4970-9528-21cb2ad94d90 tempest-VolumesListTestJSON-1911911712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:53:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-ca9cea89-bd3e-4970-9528-21cb2ad94d90 tempest-VolumesListTestJSON-1911911712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:53:51 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-ca9cea89-bd3e-4970-9528-21cb2ad94d90 tempest-VolumesListTestJSON-1911911712 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:53:51 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-ca9cea89-bd3e-4970-9528-21cb2ad94d90 tempest-VolumesListTestJSON-1911911712 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:53:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ca9cea89-bd3e-4970-9528-21cb2ad94d90 tempest-VolumesListTestJSON-1911911712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e276df23-9a72-4b30-afae-e6d5b7c85848 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-c5045c0b-3a8d-4793-91ff-7ce901e4a44f tempest-VolumesGetTest-1169103151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_69da6bac-8b7b-48c5-af3b-29466563452a_bu7xxc5o" returned: 0 in 0.497s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-c5045c0b-3a8d-4793-91ff-7ce901e4a44f tempest-VolumesGetTest-1169103151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_69da6bac-8b7b-48c5-af3b-29466563452a_bu7xxc5o {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:51 devstack sudo[105529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e276df23-9a72-4b30-afae-e6d5b7c85848 1073741824 Sep 08 06:53:51 devstack sudo[105529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:51 devstack sudo[105530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_69da6bac-8b7b-48c5-af3b-29466563452a_bu7xxc5o Sep 08 06:53:51 devstack sudo[105530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:51 devstack sudo[105530]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-c5045c0b-3a8d-4793-91ff-7ce901e4a44f tempest-VolumesGetTest-1169103151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_69da6bac-8b7b-48c5-af3b-29466563452a_bu7xxc5o" returned: 1 in 0.384s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-c5045c0b-3a8d-4793-91ff-7ce901e4a44f tempest-VolumesGetTest-1169103151 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_69da6bac-8b7b-48c5-af3b-29466563452a_bu7xxc5o' failed. Not Retrying. {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 06:53:51 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[42bac7e1-e00c-475f-b438-04c195e8017b]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:53:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-c5045c0b-3a8d-4793-91ff-7ce901e4a44f tempest-VolumesGetTest-1169103151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_fwt0yue1devstack@QuobyteHD {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:51 devstack sudo[105552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_fwt0yue1devstack@QuobyteHD Sep 08 06:53:51 devstack sudo[105552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:51 devstack sudo[105529]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ca9cea89-bd3e-4970-9528-21cb2ad94d90 tempest-VolumesListTestJSON-1911911712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e276df23-9a72-4b30-afae-e6d5b7c85848 1073741824" returned: 0 in 0.633s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ca9cea89-bd3e-4970-9528-21cb2ad94d90 tempest-VolumesListTestJSON-1911911712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e276df23-9a72-4b30-afae-e6d5b7c85848 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:51 devstack sudo[105560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e276df23-9a72-4b30-afae-e6d5b7c85848 Sep 08 06:53:51 devstack sudo[105560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:51 devstack sudo[105552]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-c5045c0b-3a8d-4793-91ff-7ce901e4a44f tempest-VolumesGetTest-1169103151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_fwt0yue1devstack@QuobyteHD" returned: 0 in 0.416s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:51 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-c5045c0b-3a8d-4793-91ff-7ce901e4a44f tempest-VolumesGetTest-1169103151 None] 69da6bac-8b7b-48c5-af3b-29466563452a was qcow2, converting to qcow2 {{(pid=87507) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 08 06:53:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-c5045c0b-3a8d-4793-91ff-7ce901e4a44f tempest-VolumesGetTest-1169103151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_fwt0yue1devstack@QuobyteHD /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-962d92b0-474c-4d9e-87c0-5b460d4541ae {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:51 devstack sudo[105573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_fwt0yue1devstack@QuobyteHD /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-962d92b0-474c-4d9e-87c0-5b460d4541ae Sep 08 06:53:51 devstack sudo[105573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:52 devstack sudo[105560]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ca9cea89-bd3e-4970-9528-21cb2ad94d90 tempest-VolumesListTestJSON-1911911712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e276df23-9a72-4b30-afae-e6d5b7c85848" returned: 0 in 0.371s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:52 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-ca9cea89-bd3e-4970-9528-21cb2ad94d90 tempest-VolumesListTestJSON-1911911712 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:53:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-ca9cea89-bd3e-4970-9528-21cb2ad94d90 tempest-VolumesListTestJSON-1911911712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:53:52 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ca9cea89-bd3e-4970-9528-21cb2ad94d90 tempest-VolumesListTestJSON-1911911712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aca588f-5fbc-45f4-9dd0-10c31c493a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e276df23-9a72-4b30-afae-e6d5b7c85848', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:52 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ca9cea89-bd3e-4970-9528-21cb2ad94d90 tempest-VolumesListTestJSON-1911911712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ef90d31-b060-45c1-b19e-6a16e30582bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:52 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-ca9cea89-bd3e-4970-9528-21cb2ad94d90 tempest-VolumesListTestJSON-1911911712 None] Volume volume-e276df23-9a72-4b30-afae-e6d5b7c85848 (e276df23-9a72-4b30-afae-e6d5b7c85848): created successfully Sep 08 06:53:52 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ca9cea89-bd3e-4970-9528-21cb2ad94d90 tempest-VolumesListTestJSON-1911911712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ef90d31-b060-45c1-b19e-6a16e30582bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:52 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ca9cea89-bd3e-4970-9528-21cb2ad94d90 tempest-VolumesListTestJSON-1911911712 None] Flow 'volume_create_manager' (3bd470aa-4a62-4572-8fb1-799ad62029aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:53:52 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-ca9cea89-bd3e-4970-9528-21cb2ad94d90 tempest-VolumesListTestJSON-1911911712 None] Created volume successfully. Sep 08 06:53:54 devstack sudo[105573]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-c5045c0b-3a8d-4793-91ff-7ce901e4a44f tempest-VolumesGetTest-1169103151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_fwt0yue1devstack@QuobyteHD /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-962d92b0-474c-4d9e-87c0-5b460d4541ae" returned: 0 in 2.316s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:54 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-c5045c0b-3a8d-4793-91ff-7ce901e4a44f tempest-VolumesGetTest-1169103151 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_fwt0yue1devstack@QuobyteHD, size 112.00 MB, duration 2.32 sec, destination /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-962d92b0-474c-4d9e-87c0-5b460d4541ae {{(pid=87507) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 06:53:54 devstack cinder-volume[87507]: INFO cinder.image.image_utils [None req-c5045c0b-3a8d-4793-91ff-7ce901e4a44f tempest-VolumesGetTest-1169103151 None] Converted 112.00 MB image at 48.31 MB/s Sep 08 06:53:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-c5045c0b-3a8d-4793-91ff-7ce901e4a44f tempest-VolumesGetTest-1169103151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-962d92b0-474c-4d9e-87c0-5b460d4541ae 1G {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:54 devstack sudo[105651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-962d92b0-474c-4d9e-87c0-5b460d4541ae 1G Sep 08 06:53:54 devstack sudo[105651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:54 devstack sudo[105651]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-c5045c0b-3a8d-4793-91ff-7ce901e4a44f tempest-VolumesGetTest-1169103151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-962d92b0-474c-4d9e-87c0-5b460d4541ae 1G" returned: 0 in 0.348s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:54 devstack cinder-volume[87507]: DEBUG cinder.volume.volume_utils [None req-c5045c0b-3a8d-4793-91ff-7ce901e4a44f tempest-VolumesGetTest-1169103151 None] Downloaded image 69da6bac-8b7b-48c5-af3b-29466563452a ((None, [{'url': 'file:///opt/stack/data/glance/images/69da6bac-8b7b-48c5-af3b-29466563452a', 'metadata': {}}])) to volume 962d92b0-474c-4d9e-87c0-5b460d4541ae successfully. {{(pid=87507) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 08 06:53:54 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-c5045c0b-3a8d-4793-91ff-7ce901e4a44f tempest-VolumesGetTest-1169103151 None] Temporary image 69da6bac-8b7b-48c5-af3b-29466563452a for user eb60e87e5f514c66b1b8c39892da34fd is deleted. {{(pid=87507) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 08 06:53:54 devstack cinder-volume[87507]: DEBUG cinder.volume.volume_utils [None req-c5045c0b-3a8d-4793-91ff-7ce901e4a44f tempest-VolumesGetTest-1169103151 None] Marking volume 962d92b0-474c-4d9e-87c0-5b460d4541ae as bootable. {{(pid=87507) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 08 06:53:54 devstack cinder-volume[87507]: DEBUG dbcounter [-] [87507] Writing DB stats cinder:SELECT=132,cinder:UPDATE=156,cinder:DELETE=10,cinder:INSERT=46 {{(pid=87507) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 06:53:54 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5045c0b-3a8d-4793-91ff-7ce901e4a44f tempest-VolumesGetTest-1169103151 None] Copying metadata from image 69da6bac-8b7b-48c5-af3b-29466563452a to 962d92b0-474c-4d9e-87c0-5b460d4541ae. {{(pid=87507) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 08 06:53:54 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5045c0b-3a8d-4793-91ff-7ce901e4a44f tempest-VolumesGetTest-1169103151 None] Creating volume glance metadata for volume 962d92b0-474c-4d9e-87c0-5b460d4541ae backed by image 69da6bac-8b7b-48c5-af3b-29466563452a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '69da6bac-8b7b-48c5-af3b-29466563452a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87507) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 08 06:53:54 devstack cinder-volume[87507]: DEBUG dbcounter [-] [87507] Writing DB stats cinder:SELECT=121,cinder:UPDATE=161,cinder:INSERT=31,cinder:DELETE=15 {{(pid=87507) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 06:53:54 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-c5045c0b-3a8d-4793-91ff-7ce901e4a44f tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a37e2201-664d-47bf-91cf-d164a255e25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-962d92b0-474c-4d9e-87c0-5b460d4541ae', 'volume_size': 1, 'image_id': '69da6bac-8b7b-48c5-af3b-29466563452a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/69da6bac-8b7b-48c5-af3b-29466563452a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '95d2d5dbb3e04d74b8da31fc6ee47f98', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '69da6bac-8b7b-48c5-af3b-29466563452a', 'created_at': datetime.datetime(2026, 9, 8, 4, 36, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 4, 36, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/69da6bac-8b7b-48c5-af3b-29466563452a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:54 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-c5045c0b-3a8d-4793-91ff-7ce901e4a44f tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8b0933b-6808-4138-b537-e002fbbeb8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:54 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-c5045c0b-3a8d-4793-91ff-7ce901e4a44f tempest-VolumesGetTest-1169103151 None] Volume volume-962d92b0-474c-4d9e-87c0-5b460d4541ae (962d92b0-474c-4d9e-87c0-5b460d4541ae): created successfully Sep 08 06:53:54 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-c5045c0b-3a8d-4793-91ff-7ce901e4a44f tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8b0933b-6808-4138-b537-e002fbbeb8be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:54 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-c5045c0b-3a8d-4793-91ff-7ce901e4a44f tempest-VolumesGetTest-1169103151 None] Flow 'volume_create_manager' (cd964343-6a7f-4b17-8c9c-048b67de0312) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:53:54 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-c5045c0b-3a8d-4793-91ff-7ce901e4a44f tempest-VolumesGetTest-1169103151 None] Created volume successfully. Sep 08 06:53:56 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-08fa2d91-3d2e-4d9d-bb38-bae5f37aceec tempest-VolumesGetTest-1169103151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:53:56 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-08fa2d91-3d2e-4d9d-bb38-bae5f37aceec tempest-VolumesGetTest-1169103151 None] Flow 'volume_create_manager' (c1155736-9028-4624-a671-182350b77f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:53:56 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-08fa2d91-3d2e-4d9d-bb38-bae5f37aceec tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a41973e-2ab0-4433-aa38-14c670719230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:56 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-08fa2d91-3d2e-4d9d-bb38-bae5f37aceec tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a41973e-2ab0-4433-aa38-14c670719230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:53:55Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1360323591',display_name='tempest-VolumesGetTest-Volume-1536534357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae331009-d216-4678-bfe0-84b90aef83ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d485bed2a56746eebce00d898e0d496c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:53:56Z,use_quota=True,user_id='eb60e87e5f514c66b1b8c39892da34fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:56 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-08fa2d91-3d2e-4d9d-bb38-bae5f37aceec tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (273b8154-ac16-42e0-a6dd-4da6bdda7bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:56 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-08fa2d91-3d2e-4d9d-bb38-bae5f37aceec tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (273b8154-ac16-42e0-a6dd-4da6bdda7bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:56 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-08fa2d91-3d2e-4d9d-bb38-bae5f37aceec tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a242e326-b6e4-4cee-80dc-55f7a4545b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:56 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-08fa2d91-3d2e-4d9d-bb38-bae5f37aceec tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a242e326-b6e4-4cee-80dc-55f7a4545b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae331009-d216-4678-bfe0-84b90aef83ea', 'volume_name': 'volume-ae331009-d216-4678-bfe0-84b90aef83ea', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:56 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-08fa2d91-3d2e-4d9d-bb38-bae5f37aceec tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89b5afb4-2dc2-4ae7-ad64-a86ce57aef90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:56 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-08fa2d91-3d2e-4d9d-bb38-bae5f37aceec tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89b5afb4-2dc2-4ae7-ad64-a86ce57aef90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:56 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-08fa2d91-3d2e-4d9d-bb38-bae5f37aceec tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d58ca6d0-91f9-4a8c-b452-cd84d1b1647f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:56 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-08fa2d91-3d2e-4d9d-bb38-bae5f37aceec tempest-VolumesGetTest-1169103151 None] Volume ae331009-d216-4678-bfe0-84b90aef83ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae331009-d216-4678-bfe0-84b90aef83ea', 'volume_size': 1} Sep 08 06:53:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-08fa2d91-3d2e-4d9d-bb38-bae5f37aceec tempest-VolumesGetTest-1169103151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:53:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-08fa2d91-3d2e-4d9d-bb38-bae5f37aceec tempest-VolumesGetTest-1169103151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:53:56 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-08fa2d91-3d2e-4d9d-bb38-bae5f37aceec tempest-VolumesGetTest-1169103151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:53:55Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1360323591',display_name='tempest-VolumesGetTest-Volume-1536534357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae331009-d216-4678-bfe0-84b90aef83ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d485bed2a56746eebce00d898e0d496c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:53:56Z,use_quota=True,user_id='eb60e87e5f514c66b1b8c39892da34fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:53:56 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-08fa2d91-3d2e-4d9d-bb38-bae5f37aceec tempest-VolumesGetTest-1169103151 None] Creating volume ae331009-d216-4678-bfe0-84b90aef83ea {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:53:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-08fa2d91-3d2e-4d9d-bb38-bae5f37aceec tempest-VolumesGetTest-1169103151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:53:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-08fa2d91-3d2e-4d9d-bb38-bae5f37aceec tempest-VolumesGetTest-1169103151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:53:56 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-08fa2d91-3d2e-4d9d-bb38-bae5f37aceec tempest-VolumesGetTest-1169103151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:53:56 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-08fa2d91-3d2e-4d9d-bb38-bae5f37aceec tempest-VolumesGetTest-1169103151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:53:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-08fa2d91-3d2e-4d9d-bb38-bae5f37aceec tempest-VolumesGetTest-1169103151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:53:56 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-08fa2d91-3d2e-4d9d-bb38-bae5f37aceec tempest-VolumesGetTest-1169103151 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:53:56 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-08fa2d91-3d2e-4d9d-bb38-bae5f37aceec tempest-VolumesGetTest-1169103151 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:53:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-08fa2d91-3d2e-4d9d-bb38-bae5f37aceec tempest-VolumesGetTest-1169103151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ae331009-d216-4678-bfe0-84b90aef83ea 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:56 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-a02e369c-74d4-4761-acea-598b3fb445f3 tempest-VolumesListTestJSON-1911911712 None] Acquiring lock "cinder-e276df23-9a72-4b30-afae-e6d5b7c85848-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:53:56 devstack sudo[105718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ae331009-d216-4678-bfe0-84b90aef83ea 1073741824 Sep 08 06:53:56 devstack sudo[105718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:56 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-a02e369c-74d4-4761-acea-598b3fb445f3 tempest-VolumesListTestJSON-1911911712 None] Lock "cinder-e276df23-9a72-4b30-afae-e6d5b7c85848-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:53:56 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-a02e369c-74d4-4761-acea-598b3fb445f3 tempest-VolumesListTestJSON-1911911712 None] Acquiring lock "cinder-quobyte-e276df23-9a72-4b30-afae-e6d5b7c85848" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:53:56 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-a02e369c-74d4-4761-acea-598b3fb445f3 tempest-VolumesListTestJSON-1911911712 None] Lock "cinder-quobyte-e276df23-9a72-4b30-afae-e6d5b7c85848" acquired by "delete_volume" :: waited 0.025s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:53:56 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d3dfd7-620a-4f12-bb86-dfd203366ae9]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:53:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a02e369c-74d4-4761-acea-598b3fb445f3 tempest-VolumesListTestJSON-1911911712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e276df23-9a72-4b30-afae-e6d5b7c85848 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:56 devstack sudo[105726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e276df23-9a72-4b30-afae-e6d5b7c85848 Sep 08 06:53:56 devstack sudo[105726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:56 devstack sudo[105718]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-08fa2d91-3d2e-4d9d-bb38-bae5f37aceec tempest-VolumesGetTest-1169103151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ae331009-d216-4678-bfe0-84b90aef83ea 1073741824" returned: 0 in 0.623s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-08fa2d91-3d2e-4d9d-bb38-bae5f37aceec tempest-VolumesGetTest-1169103151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ae331009-d216-4678-bfe0-84b90aef83ea {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:56 devstack sudo[105726]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:56 devstack sudo[105749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ae331009-d216-4678-bfe0-84b90aef83ea Sep 08 06:53:56 devstack sudo[105749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a02e369c-74d4-4761-acea-598b3fb445f3 tempest-VolumesListTestJSON-1911911712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e276df23-9a72-4b30-afae-e6d5b7c85848" returned: 0 in 0.532s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a02e369c-74d4-4761-acea-598b3fb445f3 tempest-VolumesListTestJSON-1911911712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e276df23-9a72-4b30-afae-e6d5b7c85848 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:56 devstack sudo[105753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e276df23-9a72-4b30-afae-e6d5b7c85848 Sep 08 06:53:56 devstack sudo[105753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:57 devstack sudo[105749]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:57 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-08fa2d91-3d2e-4d9d-bb38-bae5f37aceec tempest-VolumesGetTest-1169103151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ae331009-d216-4678-bfe0-84b90aef83ea" returned: 0 in 0.280s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:57 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-08fa2d91-3d2e-4d9d-bb38-bae5f37aceec tempest-VolumesGetTest-1169103151 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:53:57 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-08fa2d91-3d2e-4d9d-bb38-bae5f37aceec tempest-VolumesGetTest-1169103151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:53:57 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-08fa2d91-3d2e-4d9d-bb38-bae5f37aceec tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d58ca6d0-91f9-4a8c-b452-cd84d1b1647f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae331009-d216-4678-bfe0-84b90aef83ea', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:57 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-08fa2d91-3d2e-4d9d-bb38-bae5f37aceec tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faca3952-68ff-47d5-a4ce-569634bb1b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:53:57 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-08fa2d91-3d2e-4d9d-bb38-bae5f37aceec tempest-VolumesGetTest-1169103151 None] Volume volume-ae331009-d216-4678-bfe0-84b90aef83ea (ae331009-d216-4678-bfe0-84b90aef83ea): created successfully Sep 08 06:53:57 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-08fa2d91-3d2e-4d9d-bb38-bae5f37aceec tempest-VolumesGetTest-1169103151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faca3952-68ff-47d5-a4ce-569634bb1b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:53:57 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-08fa2d91-3d2e-4d9d-bb38-bae5f37aceec tempest-VolumesGetTest-1169103151 None] Flow 'volume_create_manager' (c1155736-9028-4624-a671-182350b77f71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:53:57 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-08fa2d91-3d2e-4d9d-bb38-bae5f37aceec tempest-VolumesGetTest-1169103151 None] Created volume successfully. Sep 08 06:53:57 devstack sudo[105753]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:57 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a02e369c-74d4-4761-acea-598b3fb445f3 tempest-VolumesListTestJSON-1911911712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e276df23-9a72-4b30-afae-e6d5b7c85848" returned: 0 in 0.344s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:57 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-a02e369c-74d4-4761-acea-598b3fb445f3 tempest-VolumesListTestJSON-1911911712 None] Lock "cinder-quobyte-e276df23-9a72-4b30-afae-e6d5b7c85848" released by "delete_volume" :: held 0.933s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:53:57 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-a02e369c-74d4-4761-acea-598b3fb445f3 tempest-VolumesListTestJSON-1911911712 None] Created reservations ['b3e6fa7d-4549-4d41-9425-de5c7f428988', '78e9e707-b594-49e8-9cf9-8315059e8da4', '6f8f415d-ff11-41b5-9151-3077ba8b371f', 'c99899d1-b0b2-45fd-9de7-67cc2b6e9e60'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:53:57 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a02e369c-74d4-4761-acea-598b3fb445f3 tempest-VolumesListTestJSON-1911911712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:53:57 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a02e369c-74d4-4761-acea-598b3fb445f3 tempest-VolumesListTestJSON-1911911712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:53:57 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-a02e369c-74d4-4761-acea-598b3fb445f3 tempest-VolumesListTestJSON-1911911712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:53:57 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-a02e369c-74d4-4761-acea-598b3fb445f3 tempest-VolumesListTestJSON-1911911712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:53:57 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a02e369c-74d4-4761-acea-598b3fb445f3 tempest-VolumesListTestJSON-1911911712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:53:57 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a02e369c-74d4-4761-acea-598b3fb445f3 tempest-VolumesListTestJSON-1911911712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:57 devstack sudo[105772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:53:57 devstack sudo[105772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:57 devstack sudo[105772]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:57 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a02e369c-74d4-4761-acea-598b3fb445f3 tempest-VolumesListTestJSON-1911911712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.277s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:57 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-a02e369c-74d4-4761-acea-598b3fb445f3 tempest-VolumesListTestJSON-1911911712 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:53:57 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-a02e369c-74d4-4761-acea-598b3fb445f3 tempest-VolumesListTestJSON-1911911712 None] Deleted volume successfully. Sep 08 06:53:57 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-a02e369c-74d4-4761-acea-598b3fb445f3 tempest-VolumesListTestJSON-1911911712 None] Lock "cinder-e276df23-9a72-4b30-afae-e6d5b7c85848-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:53:58 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-e4d51b4a-d7fa-4080-bf71-47bcc59ee802 tempest-VolumesGetTest-1169103151 None] Acquiring lock "cinder-ae331009-d216-4678-bfe0-84b90aef83ea-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:53:58 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-e4d51b4a-d7fa-4080-bf71-47bcc59ee802 tempest-VolumesGetTest-1169103151 None] Lock "cinder-ae331009-d216-4678-bfe0-84b90aef83ea-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:53:58 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-e4d51b4a-d7fa-4080-bf71-47bcc59ee802 tempest-VolumesGetTest-1169103151 None] Acquiring lock "cinder-quobyte-ae331009-d216-4678-bfe0-84b90aef83ea" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:53:58 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-e4d51b4a-d7fa-4080-bf71-47bcc59ee802 tempest-VolumesGetTest-1169103151 None] Lock "cinder-quobyte-ae331009-d216-4678-bfe0-84b90aef83ea" acquired by "delete_volume" :: waited 0.022s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:53:58 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8380d9d5-ffc8-4ca4-85c6-05645cc505c8]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:53:58 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e4d51b4a-d7fa-4080-bf71-47bcc59ee802 tempest-VolumesGetTest-1169103151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ae331009-d216-4678-bfe0-84b90aef83ea {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:58 devstack sudo[105802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ae331009-d216-4678-bfe0-84b90aef83ea Sep 08 06:53:58 devstack sudo[105802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:58 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-d983bb3c-e699-4efe-bd1c-54a44e5be875 tempest-VolumesListTestJSON-1911911712 None] Acquiring lock "cinder-b3761bf6-9393-44d5-a3b2-68b13535dca4-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:53:58 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-d983bb3c-e699-4efe-bd1c-54a44e5be875 tempest-VolumesListTestJSON-1911911712 None] Lock "cinder-b3761bf6-9393-44d5-a3b2-68b13535dca4-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:53:58 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-d983bb3c-e699-4efe-bd1c-54a44e5be875 tempest-VolumesListTestJSON-1911911712 None] Acquiring lock "cinder-quobyte-b3761bf6-9393-44d5-a3b2-68b13535dca4" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:53:58 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-d983bb3c-e699-4efe-bd1c-54a44e5be875 tempest-VolumesListTestJSON-1911911712 None] Lock "cinder-quobyte-b3761bf6-9393-44d5-a3b2-68b13535dca4" acquired by "delete_volume" :: waited 0.022s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:53:58 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c8d549-3254-49bd-b601-3a55d17c39e2]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:53:58 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-d983bb3c-e699-4efe-bd1c-54a44e5be875 tempest-VolumesListTestJSON-1911911712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b3761bf6-9393-44d5-a3b2-68b13535dca4 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:58 devstack sudo[105802]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:58 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e4d51b4a-d7fa-4080-bf71-47bcc59ee802 tempest-VolumesGetTest-1169103151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ae331009-d216-4678-bfe0-84b90aef83ea" returned: 0 in 0.505s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:58 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e4d51b4a-d7fa-4080-bf71-47bcc59ee802 tempest-VolumesGetTest-1169103151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ae331009-d216-4678-bfe0-84b90aef83ea {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:58 devstack sudo[105825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ae331009-d216-4678-bfe0-84b90aef83ea Sep 08 06:53:58 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:58 devstack sudo[105821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b3761bf6-9393-44d5-a3b2-68b13535dca4 Sep 08 06:53:58 devstack sudo[105821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:59 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:59 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e4d51b4a-d7fa-4080-bf71-47bcc59ee802 tempest-VolumesGetTest-1169103151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ae331009-d216-4678-bfe0-84b90aef83ea" returned: 0 in 0.344s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:59 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-e4d51b4a-d7fa-4080-bf71-47bcc59ee802 tempest-VolumesGetTest-1169103151 None] Lock "cinder-quobyte-ae331009-d216-4678-bfe0-84b90aef83ea" released by "delete_volume" :: held 0.904s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:53:59 devstack sudo[105821]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:59 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-d983bb3c-e699-4efe-bd1c-54a44e5be875 tempest-VolumesListTestJSON-1911911712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b3761bf6-9393-44d5-a3b2-68b13535dca4" returned: 0 in 0.454s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:59 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-d983bb3c-e699-4efe-bd1c-54a44e5be875 tempest-VolumesListTestJSON-1911911712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b3761bf6-9393-44d5-a3b2-68b13535dca4 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:59 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-e4d51b4a-d7fa-4080-bf71-47bcc59ee802 tempest-VolumesGetTest-1169103151 None] Created reservations ['80db1dc5-a49c-4eeb-8adb-0b3046b39aec', '437deacb-cbc4-425f-bc68-3349f0053814', '16a0f8e1-643e-4e16-a922-3f080a43fe5b', '86927ff0-8e6d-4982-a44d-9b4628444962'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:53:59 devstack sudo[105842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b3761bf6-9393-44d5-a3b2-68b13535dca4 Sep 08 06:53:59 devstack sudo[105842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:59 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-e4d51b4a-d7fa-4080-bf71-47bcc59ee802 tempest-VolumesGetTest-1169103151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:53:59 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-e4d51b4a-d7fa-4080-bf71-47bcc59ee802 tempest-VolumesGetTest-1169103151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:53:59 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-e4d51b4a-d7fa-4080-bf71-47bcc59ee802 tempest-VolumesGetTest-1169103151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:53:59 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-e4d51b4a-d7fa-4080-bf71-47bcc59ee802 tempest-VolumesGetTest-1169103151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:53:59 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-e4d51b4a-d7fa-4080-bf71-47bcc59ee802 tempest-VolumesGetTest-1169103151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:53:59 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e4d51b4a-d7fa-4080-bf71-47bcc59ee802 tempest-VolumesGetTest-1169103151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:59 devstack sudo[105849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:53:59 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:59 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-7f4ac6d9-5125-4f99-a000-495176c3a32c tempest-VolumesGetTest-1169103151 None] Acquiring lock "cinder-962d92b0-474c-4d9e-87c0-5b460d4541ae-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:53:59 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-7f4ac6d9-5125-4f99-a000-495176c3a32c tempest-VolumesGetTest-1169103151 None] Lock "cinder-962d92b0-474c-4d9e-87c0-5b460d4541ae-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:53:59 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-7f4ac6d9-5125-4f99-a000-495176c3a32c tempest-VolumesGetTest-1169103151 None] Acquiring lock "cinder-quobyte-962d92b0-474c-4d9e-87c0-5b460d4541ae" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:53:59 devstack sudo[105842]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:59 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-d983bb3c-e699-4efe-bd1c-54a44e5be875 tempest-VolumesListTestJSON-1911911712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b3761bf6-9393-44d5-a3b2-68b13535dca4" returned: 0 in 0.406s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:59 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-7f4ac6d9-5125-4f99-a000-495176c3a32c tempest-VolumesGetTest-1169103151 None] Lock "cinder-quobyte-962d92b0-474c-4d9e-87c0-5b460d4541ae" acquired by "delete_volume" :: waited 0.025s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:53:59 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-d983bb3c-e699-4efe-bd1c-54a44e5be875 tempest-VolumesListTestJSON-1911911712 None] Lock "cinder-quobyte-b3761bf6-9393-44d5-a3b2-68b13535dca4" released by "delete_volume" :: held 0.939s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:53:59 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b9b17e-c3ca-46b6-83ec-f7e29dfb76e6]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:53:59 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7f4ac6d9-5125-4f99-a000-495176c3a32c tempest-VolumesGetTest-1169103151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-962d92b0-474c-4d9e-87c0-5b460d4541ae {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:59 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root Sep 08 06:53:59 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e4d51b4a-d7fa-4080-bf71-47bcc59ee802 tempest-VolumesGetTest-1169103151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.365s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:53:59 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-e4d51b4a-d7fa-4080-bf71-47bcc59ee802 tempest-VolumesGetTest-1169103151 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:53:59 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-e4d51b4a-d7fa-4080-bf71-47bcc59ee802 tempest-VolumesGetTest-1169103151 None] Deleted volume successfully. Sep 08 06:53:59 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-d983bb3c-e699-4efe-bd1c-54a44e5be875 tempest-VolumesListTestJSON-1911911712 None] Created reservations ['5d77ae4a-4bd5-42f1-bfcf-0de656f54258', 'f74e3bc9-dd92-4127-96cd-f005eca6a562', '94da9e26-e5c7-4bb1-8629-4b2a4722c5c1', '42b370e4-e3e8-4dc7-9a23-772ff4382b33'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:53:59 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-e4d51b4a-d7fa-4080-bf71-47bcc59ee802 tempest-VolumesGetTest-1169103151 None] Lock "cinder-ae331009-d216-4678-bfe0-84b90aef83ea-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:53:59 devstack sudo[105863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-962d92b0-474c-4d9e-87c0-5b460d4541ae Sep 08 06:53:59 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:53:59 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-d983bb3c-e699-4efe-bd1c-54a44e5be875 tempest-VolumesListTestJSON-1911911712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:53:59 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-d983bb3c-e699-4efe-bd1c-54a44e5be875 tempest-VolumesListTestJSON-1911911712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:53:59 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-d983bb3c-e699-4efe-bd1c-54a44e5be875 tempest-VolumesListTestJSON-1911911712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:53:59 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-d983bb3c-e699-4efe-bd1c-54a44e5be875 tempest-VolumesListTestJSON-1911911712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:53:59 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-d983bb3c-e699-4efe-bd1c-54a44e5be875 tempest-VolumesListTestJSON-1911911712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:53:59 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-d983bb3c-e699-4efe-bd1c-54a44e5be875 tempest-VolumesListTestJSON-1911911712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:53:59 devstack sudo[105871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:53:59 devstack sudo[105871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:54:00 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root Sep 08 06:54:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7f4ac6d9-5125-4f99-a000-495176c3a32c tempest-VolumesGetTest-1169103151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-962d92b0-474c-4d9e-87c0-5b460d4541ae" returned: 0 in 0.451s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:54:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7f4ac6d9-5125-4f99-a000-495176c3a32c tempest-VolumesGetTest-1169103151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-962d92b0-474c-4d9e-87c0-5b460d4541ae {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:54:00 devstack sudo[105871]: pam_unix(sudo:session): session closed for user root Sep 08 06:54:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-d983bb3c-e699-4efe-bd1c-54a44e5be875 tempest-VolumesListTestJSON-1911911712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.275s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:54:00 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-d983bb3c-e699-4efe-bd1c-54a44e5be875 tempest-VolumesListTestJSON-1911911712 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:54:00 devstack sudo[105883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-962d92b0-474c-4d9e-87c0-5b460d4541ae Sep 08 06:54:00 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-d983bb3c-e699-4efe-bd1c-54a44e5be875 tempest-VolumesListTestJSON-1911911712 None] Deleted volume successfully. Sep 08 06:54:00 devstack sudo[105883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:54:00 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-d983bb3c-e699-4efe-bd1c-54a44e5be875 tempest-VolumesListTestJSON-1911911712 None] Lock "cinder-b3761bf6-9393-44d5-a3b2-68b13535dca4-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:54:00 devstack sudo[105883]: pam_unix(sudo:session): session closed for user root Sep 08 06:54:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7f4ac6d9-5125-4f99-a000-495176c3a32c tempest-VolumesGetTest-1169103151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-962d92b0-474c-4d9e-87c0-5b460d4541ae" returned: 0 in 0.273s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:54:00 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-7f4ac6d9-5125-4f99-a000-495176c3a32c tempest-VolumesGetTest-1169103151 None] Lock "cinder-quobyte-962d92b0-474c-4d9e-87c0-5b460d4541ae" released by "delete_volume" :: held 0.775s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:54:00 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-7f4ac6d9-5125-4f99-a000-495176c3a32c tempest-VolumesGetTest-1169103151 None] Created reservations ['5647daa5-3c43-4f73-97ce-a85d32184458', 'f29ed3dc-ee08-4e03-9fd8-c7e415ef0fd2', '96c2af9b-7fa8-4aab-8f6a-985691212bfe', 'de67f27a-6954-48ef-a242-5a542ab15720'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:54:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-7f4ac6d9-5125-4f99-a000-495176c3a32c tempest-VolumesGetTest-1169103151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:54:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-7f4ac6d9-5125-4f99-a000-495176c3a32c tempest-VolumesGetTest-1169103151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:54:00 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-7f4ac6d9-5125-4f99-a000-495176c3a32c tempest-VolumesGetTest-1169103151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:54:00 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-7f4ac6d9-5125-4f99-a000-495176c3a32c tempest-VolumesGetTest-1169103151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:54:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-7f4ac6d9-5125-4f99-a000-495176c3a32c tempest-VolumesGetTest-1169103151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:54:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7f4ac6d9-5125-4f99-a000-495176c3a32c tempest-VolumesGetTest-1169103151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:54:00 devstack sudo[105898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:54:00 devstack sudo[105898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:54:00 devstack sudo[105898]: pam_unix(sudo:session): session closed for user root Sep 08 06:54:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7f4ac6d9-5125-4f99-a000-495176c3a32c tempest-VolumesGetTest-1169103151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.284s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:54:00 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-7f4ac6d9-5125-4f99-a000-495176c3a32c tempest-VolumesGetTest-1169103151 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:54:00 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-7f4ac6d9-5125-4f99-a000-495176c3a32c tempest-VolumesGetTest-1169103151 None] Deleted volume successfully. Sep 08 06:54:00 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-7f4ac6d9-5125-4f99-a000-495176c3a32c tempest-VolumesGetTest-1169103151 None] Lock "cinder-962d92b0-474c-4d9e-87c0-5b460d4541ae-delete_volume" released by "delete_volume" :: held 1.275s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:54:01 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-2a222c25-fce1-4110-914b-4ee73ac37da2 tempest-VolumesListTestJSON-1911911712 None] Acquiring lock "cinder-074637c8-b45f-4e6c-8cc9-f3d078313588-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:54:01 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-2a222c25-fce1-4110-914b-4ee73ac37da2 tempest-VolumesListTestJSON-1911911712 None] Lock "cinder-074637c8-b45f-4e6c-8cc9-f3d078313588-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:54:01 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-2a222c25-fce1-4110-914b-4ee73ac37da2 tempest-VolumesListTestJSON-1911911712 None] Acquiring lock "cinder-quobyte-074637c8-b45f-4e6c-8cc9-f3d078313588" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:54:01 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-2a222c25-fce1-4110-914b-4ee73ac37da2 tempest-VolumesListTestJSON-1911911712 None] Lock "cinder-quobyte-074637c8-b45f-4e6c-8cc9-f3d078313588" acquired by "delete_volume" :: waited 0.022s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:54:01 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[24db1eb4-0f24-4bf0-8dfe-574e88084104]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:54:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2a222c25-fce1-4110-914b-4ee73ac37da2 tempest-VolumesListTestJSON-1911911712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-074637c8-b45f-4e6c-8cc9-f3d078313588 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:54:01 devstack sudo[105922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-074637c8-b45f-4e6c-8cc9-f3d078313588 Sep 08 06:54:01 devstack sudo[105922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:54:01 devstack sudo[105922]: pam_unix(sudo:session): session closed for user root Sep 08 06:54:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2a222c25-fce1-4110-914b-4ee73ac37da2 tempest-VolumesListTestJSON-1911911712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-074637c8-b45f-4e6c-8cc9-f3d078313588" returned: 0 in 0.414s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:54:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2a222c25-fce1-4110-914b-4ee73ac37da2 tempest-VolumesListTestJSON-1911911712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-074637c8-b45f-4e6c-8cc9-f3d078313588 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:54:01 devstack sudo[105939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-074637c8-b45f-4e6c-8cc9-f3d078313588 Sep 08 06:54:01 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:54:01 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root Sep 08 06:54:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2a222c25-fce1-4110-914b-4ee73ac37da2 tempest-VolumesListTestJSON-1911911712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-074637c8-b45f-4e6c-8cc9-f3d078313588" returned: 0 in 0.271s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:54:01 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-2a222c25-fce1-4110-914b-4ee73ac37da2 tempest-VolumesListTestJSON-1911911712 None] Lock "cinder-quobyte-074637c8-b45f-4e6c-8cc9-f3d078313588" released by "delete_volume" :: held 0.743s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:54:01 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-2a222c25-fce1-4110-914b-4ee73ac37da2 tempest-VolumesListTestJSON-1911911712 None] Created reservations ['d9cfd127-15d3-47c6-aa80-e3d57e509ddf', '949f897a-35e6-4767-b0e1-4ba6f46946b7', '5f5052cb-9c83-4f61-ae3c-de725343fbb9', '5a8979de-79ff-47a1-9f28-3500f5672c5d'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:54:02 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-2a222c25-fce1-4110-914b-4ee73ac37da2 tempest-VolumesListTestJSON-1911911712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:54:02 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-2a222c25-fce1-4110-914b-4ee73ac37da2 tempest-VolumesListTestJSON-1911911712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:54:02 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-2a222c25-fce1-4110-914b-4ee73ac37da2 tempest-VolumesListTestJSON-1911911712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:54:02 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-2a222c25-fce1-4110-914b-4ee73ac37da2 tempest-VolumesListTestJSON-1911911712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:54:02 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-2a222c25-fce1-4110-914b-4ee73ac37da2 tempest-VolumesListTestJSON-1911911712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:54:02 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2a222c25-fce1-4110-914b-4ee73ac37da2 tempest-VolumesListTestJSON-1911911712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:54:02 devstack sudo[105957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:54:02 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:54:02 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root Sep 08 06:54:02 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2a222c25-fce1-4110-914b-4ee73ac37da2 tempest-VolumesListTestJSON-1911911712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.354s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:54:02 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-2a222c25-fce1-4110-914b-4ee73ac37da2 tempest-VolumesListTestJSON-1911911712 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:54:02 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-2a222c25-fce1-4110-914b-4ee73ac37da2 tempest-VolumesListTestJSON-1911911712 None] Deleted volume successfully. Sep 08 06:54:02 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-2a222c25-fce1-4110-914b-4ee73ac37da2 tempest-VolumesListTestJSON-1911911712 None] Lock "cinder-074637c8-b45f-4e6c-8cc9-f3d078313588-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:54:07 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-79800187-355f-4e83-9d0c-183149adff27 tempest-VolumesNegativeTest-899931976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:54:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-79800187-355f-4e83-9d0c-183149adff27 tempest-VolumesNegativeTest-899931976 None] Flow 'volume_create_manager' (8510c927-bb97-4305-825a-cfe60ac5abd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:54:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-79800187-355f-4e83-9d0c-183149adff27 tempest-VolumesNegativeTest-899931976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58a3456c-01ea-4c52-bfd6-8ced2e7a6d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:54:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-79800187-355f-4e83-9d0c-183149adff27 tempest-VolumesNegativeTest-899931976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58a3456c-01ea-4c52-bfd6-8ced2e7a6d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:54:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-274524645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=524bde1e-abb3-46fa-ad5c-469cf78469cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b52c6f9936c4d1dbc6e59498edcdcea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:54:07Z,use_quota=True,user_id='ff271e5e659746a4baed7cafc87936e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:54:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-79800187-355f-4e83-9d0c-183149adff27 tempest-VolumesNegativeTest-899931976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94c5127c-af84-420f-859d-a53d312d2a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:54:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-79800187-355f-4e83-9d0c-183149adff27 tempest-VolumesNegativeTest-899931976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94c5127c-af84-420f-859d-a53d312d2a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:54:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-79800187-355f-4e83-9d0c-183149adff27 tempest-VolumesNegativeTest-899931976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08a0ba5e-5557-41ef-b6a6-ab2c91df5a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:54:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-79800187-355f-4e83-9d0c-183149adff27 tempest-VolumesNegativeTest-899931976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08a0ba5e-5557-41ef-b6a6-ab2c91df5a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '524bde1e-abb3-46fa-ad5c-469cf78469cc', 'volume_name': 'volume-524bde1e-abb3-46fa-ad5c-469cf78469cc', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:54:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-79800187-355f-4e83-9d0c-183149adff27 tempest-VolumesNegativeTest-899931976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0423ce28-2b29-4a55-8e8e-6cc7ced98c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:54:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-79800187-355f-4e83-9d0c-183149adff27 tempest-VolumesNegativeTest-899931976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0423ce28-2b29-4a55-8e8e-6cc7ced98c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:54:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-79800187-355f-4e83-9d0c-183149adff27 tempest-VolumesNegativeTest-899931976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c36c58d-62a3-410b-b433-1df61a218013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:54:07 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-79800187-355f-4e83-9d0c-183149adff27 tempest-VolumesNegativeTest-899931976 None] Volume 524bde1e-abb3-46fa-ad5c-469cf78469cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-524bde1e-abb3-46fa-ad5c-469cf78469cc', 'volume_size': 1} Sep 08 06:54:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-79800187-355f-4e83-9d0c-183149adff27 tempest-VolumesNegativeTest-899931976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:54:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-79800187-355f-4e83-9d0c-183149adff27 tempest-VolumesNegativeTest-899931976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:54:07 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-79800187-355f-4e83-9d0c-183149adff27 tempest-VolumesNegativeTest-899931976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:54:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-274524645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=524bde1e-abb3-46fa-ad5c-469cf78469cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b52c6f9936c4d1dbc6e59498edcdcea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:54:07Z,use_quota=True,user_id='ff271e5e659746a4baed7cafc87936e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:54:07 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-79800187-355f-4e83-9d0c-183149adff27 tempest-VolumesNegativeTest-899931976 None] Creating volume 524bde1e-abb3-46fa-ad5c-469cf78469cc {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:54:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-79800187-355f-4e83-9d0c-183149adff27 tempest-VolumesNegativeTest-899931976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:54:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-79800187-355f-4e83-9d0c-183149adff27 tempest-VolumesNegativeTest-899931976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:54:07 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-79800187-355f-4e83-9d0c-183149adff27 tempest-VolumesNegativeTest-899931976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:54:07 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-79800187-355f-4e83-9d0c-183149adff27 tempest-VolumesNegativeTest-899931976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:54:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-79800187-355f-4e83-9d0c-183149adff27 tempest-VolumesNegativeTest-899931976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:54:07 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-79800187-355f-4e83-9d0c-183149adff27 tempest-VolumesNegativeTest-899931976 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:54:07 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-79800187-355f-4e83-9d0c-183149adff27 tempest-VolumesNegativeTest-899931976 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:54:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-79800187-355f-4e83-9d0c-183149adff27 tempest-VolumesNegativeTest-899931976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-524bde1e-abb3-46fa-ad5c-469cf78469cc 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:54:07 devstack sudo[106113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-524bde1e-abb3-46fa-ad5c-469cf78469cc 1073741824 Sep 08 06:54:07 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:54:07 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root Sep 08 06:54:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-79800187-355f-4e83-9d0c-183149adff27 tempest-VolumesNegativeTest-899931976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-524bde1e-abb3-46fa-ad5c-469cf78469cc 1073741824" returned: 0 in 0.501s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:54:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-79800187-355f-4e83-9d0c-183149adff27 tempest-VolumesNegativeTest-899931976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-524bde1e-abb3-46fa-ad5c-469cf78469cc {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:54:07 devstack sudo[106134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-524bde1e-abb3-46fa-ad5c-469cf78469cc Sep 08 06:54:07 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:54:08 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root Sep 08 06:54:08 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-79800187-355f-4e83-9d0c-183149adff27 tempest-VolumesNegativeTest-899931976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-524bde1e-abb3-46fa-ad5c-469cf78469cc" returned: 0 in 0.323s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:54:08 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-79800187-355f-4e83-9d0c-183149adff27 tempest-VolumesNegativeTest-899931976 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:54:08 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-79800187-355f-4e83-9d0c-183149adff27 tempest-VolumesNegativeTest-899931976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:54:08 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-79800187-355f-4e83-9d0c-183149adff27 tempest-VolumesNegativeTest-899931976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c36c58d-62a3-410b-b433-1df61a218013) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-524bde1e-abb3-46fa-ad5c-469cf78469cc', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:54:08 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-79800187-355f-4e83-9d0c-183149adff27 tempest-VolumesNegativeTest-899931976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05c5a272-3482-415c-bf39-3a04462c8c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:54:08 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-79800187-355f-4e83-9d0c-183149adff27 tempest-VolumesNegativeTest-899931976 None] Volume volume-524bde1e-abb3-46fa-ad5c-469cf78469cc (524bde1e-abb3-46fa-ad5c-469cf78469cc): created successfully Sep 08 06:54:08 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-79800187-355f-4e83-9d0c-183149adff27 tempest-VolumesNegativeTest-899931976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05c5a272-3482-415c-bf39-3a04462c8c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:54:08 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-79800187-355f-4e83-9d0c-183149adff27 tempest-VolumesNegativeTest-899931976 None] Flow 'volume_create_manager' (8510c927-bb97-4305-825a-cfe60ac5abd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:54:08 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-79800187-355f-4e83-9d0c-183149adff27 tempest-VolumesNegativeTest-899931976 None] Created volume successfully. Sep 08 06:54:16 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ffe7737-a2b5-4e46-9bd1-1ee1546ea5a8 tempest-VolumeQuotasAdminTestJSON-143683903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:54:16 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4ffe7737-a2b5-4e46-9bd1-1ee1546ea5a8 tempest-VolumeQuotasAdminTestJSON-143683903 None] Flow 'volume_create_manager' (938ad34d-0c6e-4f56-a2a9-2e388913d0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:54:16 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4ffe7737-a2b5-4e46-9bd1-1ee1546ea5a8 tempest-VolumeQuotasAdminTestJSON-143683903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c6f70da-f478-4d1b-842b-95007fbff18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:54:16 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4ffe7737-a2b5-4e46-9bd1-1ee1546ea5a8 tempest-VolumeQuotasAdminTestJSON-143683903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c6f70da-f478-4d1b-842b-95007fbff18f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:54:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1684631019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fcc63e8-65e4-4470-8286-a756b1942863,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a14be69e00b417f92258c27bf0d6270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:54:16Z,use_quota=True,user_id='37522f0c657e47c99942f04f089e1159',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:54:16 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4ffe7737-a2b5-4e46-9bd1-1ee1546ea5a8 tempest-VolumeQuotasAdminTestJSON-143683903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d41c224-bfbd-4933-be02-438bf8ad43bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:54:16 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4ffe7737-a2b5-4e46-9bd1-1ee1546ea5a8 tempest-VolumeQuotasAdminTestJSON-143683903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d41c224-bfbd-4933-be02-438bf8ad43bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:54:16 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4ffe7737-a2b5-4e46-9bd1-1ee1546ea5a8 tempest-VolumeQuotasAdminTestJSON-143683903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7da8d998-7556-46b7-b4f4-af0cda454b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:54:16 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4ffe7737-a2b5-4e46-9bd1-1ee1546ea5a8 tempest-VolumeQuotasAdminTestJSON-143683903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7da8d998-7556-46b7-b4f4-af0cda454b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fcc63e8-65e4-4470-8286-a756b1942863', 'volume_name': 'volume-2fcc63e8-65e4-4470-8286-a756b1942863', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:54:16 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4ffe7737-a2b5-4e46-9bd1-1ee1546ea5a8 tempest-VolumeQuotasAdminTestJSON-143683903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7adf3215-df1b-41b2-b9f4-a45a1098abb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:54:16 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4ffe7737-a2b5-4e46-9bd1-1ee1546ea5a8 tempest-VolumeQuotasAdminTestJSON-143683903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7adf3215-df1b-41b2-b9f4-a45a1098abb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:54:16 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4ffe7737-a2b5-4e46-9bd1-1ee1546ea5a8 tempest-VolumeQuotasAdminTestJSON-143683903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21e8cff0-c0ef-4fd0-8330-967ae6f2defb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:54:16 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-4ffe7737-a2b5-4e46-9bd1-1ee1546ea5a8 tempest-VolumeQuotasAdminTestJSON-143683903 None] Volume 2fcc63e8-65e4-4470-8286-a756b1942863: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fcc63e8-65e4-4470-8286-a756b1942863', 'volume_size': 1} Sep 08 06:54:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4ffe7737-a2b5-4e46-9bd1-1ee1546ea5a8 tempest-VolumeQuotasAdminTestJSON-143683903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:54:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4ffe7737-a2b5-4e46-9bd1-1ee1546ea5a8 tempest-VolumeQuotasAdminTestJSON-143683903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:54:16 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-4ffe7737-a2b5-4e46-9bd1-1ee1546ea5a8 tempest-VolumeQuotasAdminTestJSON-143683903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:54:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1684631019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fcc63e8-65e4-4470-8286-a756b1942863,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a14be69e00b417f92258c27bf0d6270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:54:16Z,use_quota=True,user_id='37522f0c657e47c99942f04f089e1159',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:54:16 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-4ffe7737-a2b5-4e46-9bd1-1ee1546ea5a8 tempest-VolumeQuotasAdminTestJSON-143683903 None] Creating volume 2fcc63e8-65e4-4470-8286-a756b1942863 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:54:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4ffe7737-a2b5-4e46-9bd1-1ee1546ea5a8 tempest-VolumeQuotasAdminTestJSON-143683903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:54:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4ffe7737-a2b5-4e46-9bd1-1ee1546ea5a8 tempest-VolumeQuotasAdminTestJSON-143683903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:54:16 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-4ffe7737-a2b5-4e46-9bd1-1ee1546ea5a8 tempest-VolumeQuotasAdminTestJSON-143683903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:54:16 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-4ffe7737-a2b5-4e46-9bd1-1ee1546ea5a8 tempest-VolumeQuotasAdminTestJSON-143683903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:54:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4ffe7737-a2b5-4e46-9bd1-1ee1546ea5a8 tempest-VolumeQuotasAdminTestJSON-143683903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:54:16 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-4ffe7737-a2b5-4e46-9bd1-1ee1546ea5a8 tempest-VolumeQuotasAdminTestJSON-143683903 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:54:16 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-4ffe7737-a2b5-4e46-9bd1-1ee1546ea5a8 tempest-VolumeQuotasAdminTestJSON-143683903 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:54:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4ffe7737-a2b5-4e46-9bd1-1ee1546ea5a8 tempest-VolumeQuotasAdminTestJSON-143683903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2fcc63e8-65e4-4470-8286-a756b1942863 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:54:16 devstack sudo[106411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2fcc63e8-65e4-4470-8286-a756b1942863 1073741824 Sep 08 06:54:16 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:54:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4ffe7737-a2b5-4e46-9bd1-1ee1546ea5a8 tempest-VolumeQuotasAdminTestJSON-143683903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2fcc63e8-65e4-4470-8286-a756b1942863 1073741824" returned: 0 in 0.627s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:54:16 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root Sep 08 06:54:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4ffe7737-a2b5-4e46-9bd1-1ee1546ea5a8 tempest-VolumeQuotasAdminTestJSON-143683903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2fcc63e8-65e4-4470-8286-a756b1942863 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:54:16 devstack sudo[106439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2fcc63e8-65e4-4470-8286-a756b1942863 Sep 08 06:54:16 devstack sudo[106439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:54:17 devstack sudo[106439]: pam_unix(sudo:session): session closed for user root Sep 08 06:54:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4ffe7737-a2b5-4e46-9bd1-1ee1546ea5a8 tempest-VolumeQuotasAdminTestJSON-143683903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2fcc63e8-65e4-4470-8286-a756b1942863" returned: 0 in 0.286s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:54:17 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-4ffe7737-a2b5-4e46-9bd1-1ee1546ea5a8 tempest-VolumeQuotasAdminTestJSON-143683903 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:54:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4ffe7737-a2b5-4e46-9bd1-1ee1546ea5a8 tempest-VolumeQuotasAdminTestJSON-143683903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:54:17 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4ffe7737-a2b5-4e46-9bd1-1ee1546ea5a8 tempest-VolumeQuotasAdminTestJSON-143683903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21e8cff0-c0ef-4fd0-8330-967ae6f2defb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fcc63e8-65e4-4470-8286-a756b1942863', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:54:17 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4ffe7737-a2b5-4e46-9bd1-1ee1546ea5a8 tempest-VolumeQuotasAdminTestJSON-143683903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bea21376-5153-4fa2-a91c-511ded66ccd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:54:17 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-4ffe7737-a2b5-4e46-9bd1-1ee1546ea5a8 tempest-VolumeQuotasAdminTestJSON-143683903 None] Volume volume-2fcc63e8-65e4-4470-8286-a756b1942863 (2fcc63e8-65e4-4470-8286-a756b1942863): created successfully Sep 08 06:54:17 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4ffe7737-a2b5-4e46-9bd1-1ee1546ea5a8 tempest-VolumeQuotasAdminTestJSON-143683903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bea21376-5153-4fa2-a91c-511ded66ccd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:54:17 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4ffe7737-a2b5-4e46-9bd1-1ee1546ea5a8 tempest-VolumeQuotasAdminTestJSON-143683903 None] Flow 'volume_create_manager' (938ad34d-0c6e-4f56-a2a9-2e388913d0fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:54:17 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-4ffe7737-a2b5-4e46-9bd1-1ee1546ea5a8 tempest-VolumeQuotasAdminTestJSON-143683903 None] Created volume successfully. Sep 08 06:54:18 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-f9e5765e-f393-43a2-83b7-c569a557d25c tempest-VolumeQuotasAdminTestJSON-143683903 None] Acquiring lock "cinder-2fcc63e8-65e4-4470-8286-a756b1942863-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:54:18 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-f9e5765e-f393-43a2-83b7-c569a557d25c tempest-VolumeQuotasAdminTestJSON-143683903 None] Lock "cinder-2fcc63e8-65e4-4470-8286-a756b1942863-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:54:18 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-f9e5765e-f393-43a2-83b7-c569a557d25c tempest-VolumeQuotasAdminTestJSON-143683903 None] Acquiring lock "cinder-quobyte-2fcc63e8-65e4-4470-8286-a756b1942863" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:54:18 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-f9e5765e-f393-43a2-83b7-c569a557d25c tempest-VolumeQuotasAdminTestJSON-143683903 None] Lock "cinder-quobyte-2fcc63e8-65e4-4470-8286-a756b1942863" acquired by "delete_volume" :: waited 0.035s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:54:18 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8b5ca4-cced-4a01-839f-61b2d5e5e7e2]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:54:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f9e5765e-f393-43a2-83b7-c569a557d25c tempest-VolumeQuotasAdminTestJSON-143683903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2fcc63e8-65e4-4470-8286-a756b1942863 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:54:18 devstack sudo[106555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2fcc63e8-65e4-4470-8286-a756b1942863 Sep 08 06:54:18 devstack sudo[106555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:54:19 devstack sudo[106555]: pam_unix(sudo:session): session closed for user root Sep 08 06:54:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f9e5765e-f393-43a2-83b7-c569a557d25c tempest-VolumeQuotasAdminTestJSON-143683903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2fcc63e8-65e4-4470-8286-a756b1942863" returned: 0 in 0.481s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:54:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f9e5765e-f393-43a2-83b7-c569a557d25c tempest-VolumeQuotasAdminTestJSON-143683903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2fcc63e8-65e4-4470-8286-a756b1942863 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:54:19 devstack sudo[106579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2fcc63e8-65e4-4470-8286-a756b1942863 Sep 08 06:54:19 devstack sudo[106579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:54:19 devstack sudo[106579]: pam_unix(sudo:session): session closed for user root Sep 08 06:54:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f9e5765e-f393-43a2-83b7-c569a557d25c tempest-VolumeQuotasAdminTestJSON-143683903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2fcc63e8-65e4-4470-8286-a756b1942863" returned: 0 in 0.414s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:54:19 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-f9e5765e-f393-43a2-83b7-c569a557d25c tempest-VolumeQuotasAdminTestJSON-143683903 None] Lock "cinder-quobyte-2fcc63e8-65e4-4470-8286-a756b1942863" released by "delete_volume" :: held 0.980s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:54:19 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-f9e5765e-f393-43a2-83b7-c569a557d25c tempest-VolumeQuotasAdminTestJSON-143683903 None] Created reservations ['f962e2f0-1b45-4263-8509-83ddb821815a', '311bbc83-4dd6-49bf-8573-beb5b0751da0', 'abd16c80-62ac-4b1c-bd7d-ce7f63518f21', '87f70324-b672-4fe2-93df-940c99a41ea1'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:54:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-f9e5765e-f393-43a2-83b7-c569a557d25c tempest-VolumeQuotasAdminTestJSON-143683903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:54:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-f9e5765e-f393-43a2-83b7-c569a557d25c tempest-VolumeQuotasAdminTestJSON-143683903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:54:19 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-f9e5765e-f393-43a2-83b7-c569a557d25c tempest-VolumeQuotasAdminTestJSON-143683903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:54:19 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-f9e5765e-f393-43a2-83b7-c569a557d25c tempest-VolumeQuotasAdminTestJSON-143683903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:54:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-f9e5765e-f393-43a2-83b7-c569a557d25c tempest-VolumeQuotasAdminTestJSON-143683903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:54:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f9e5765e-f393-43a2-83b7-c569a557d25c tempest-VolumeQuotasAdminTestJSON-143683903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:54:19 devstack sudo[106602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:54:19 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:54:20 devstack cinder-volume[87507]: DEBUG oslo_service.periodic_task [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87507) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 06:54:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:54:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:54:20 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:54:20 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:54:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:54:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:54:20 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root Sep 08 06:54:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f9e5765e-f393-43a2-83b7-c569a557d25c tempest-VolumeQuotasAdminTestJSON-143683903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.361s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:54:20 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-f9e5765e-f393-43a2-83b7-c569a557d25c tempest-VolumeQuotasAdminTestJSON-143683903 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:54:20 devstack sudo[106614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:54:20 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:54:20 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-f9e5765e-f393-43a2-83b7-c569a557d25c tempest-VolumeQuotasAdminTestJSON-143683903 None] Deleted volume successfully. Sep 08 06:54:20 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-f9e5765e-f393-43a2-83b7-c569a557d25c tempest-VolumeQuotasAdminTestJSON-143683903 None] Lock "cinder-2fcc63e8-65e4-4470-8286-a756b1942863-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:54:20 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root Sep 08 06:54:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.439s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:54:20 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:54:20 devstack cinder-volume[87507]: DEBUG oslo_service.periodic_task [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Running periodic task VolumeManager._thread_info {{(pid=87507) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 06:54:20 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] thread count: 29 {{(pid=87507) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 06:54:20 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] thread info: [<_MainThread(MainThread, started 127913129345152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87507) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 06:54:21 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba426f76-6643-446c-8f30-e7bb4f2be25f tempest-VolumeQuotasAdminTestJSON-143683903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:54:21 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ba426f76-6643-446c-8f30-e7bb4f2be25f tempest-VolumeQuotasAdminTestJSON-143683903 None] Flow 'volume_create_manager' (45463553-e67f-4a59-8a5b-46b68a93d264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:54:21 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ba426f76-6643-446c-8f30-e7bb4f2be25f tempest-VolumeQuotasAdminTestJSON-143683903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2684527a-6071-4939-ba29-a56e7a0c6fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:54:21 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ba426f76-6643-446c-8f30-e7bb4f2be25f tempest-VolumeQuotasAdminTestJSON-143683903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2684527a-6071-4939-ba29-a56e7a0c6fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:54:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2133095135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0285b014-8b2c-42c3-86a6-a1cfb2ee9db4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a14be69e00b417f92258c27bf0d6270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:54:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:54:22Z,use_quota=True,user_id='37522f0c657e47c99942f04f089e1159',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:54:21 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ba426f76-6643-446c-8f30-e7bb4f2be25f tempest-VolumeQuotasAdminTestJSON-143683903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53bbfb92-7001-46cd-b752-1b698a817c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:54:21 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ba426f76-6643-446c-8f30-e7bb4f2be25f tempest-VolumeQuotasAdminTestJSON-143683903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53bbfb92-7001-46cd-b752-1b698a817c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:54:21 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ba426f76-6643-446c-8f30-e7bb4f2be25f tempest-VolumeQuotasAdminTestJSON-143683903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f2a92c2-0447-44e3-82d9-5e9dcb0424eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:54:21 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ba426f76-6643-446c-8f30-e7bb4f2be25f tempest-VolumeQuotasAdminTestJSON-143683903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f2a92c2-0447-44e3-82d9-5e9dcb0424eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0285b014-8b2c-42c3-86a6-a1cfb2ee9db4', 'volume_name': 'volume-0285b014-8b2c-42c3-86a6-a1cfb2ee9db4', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:54:21 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ba426f76-6643-446c-8f30-e7bb4f2be25f tempest-VolumeQuotasAdminTestJSON-143683903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c8bc5a0-ed71-4464-a56d-cc7b1106968f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:54:21 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ba426f76-6643-446c-8f30-e7bb4f2be25f tempest-VolumeQuotasAdminTestJSON-143683903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c8bc5a0-ed71-4464-a56d-cc7b1106968f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:54:21 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ba426f76-6643-446c-8f30-e7bb4f2be25f tempest-VolumeQuotasAdminTestJSON-143683903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a6075c9-dc07-4e6c-b0a5-3402fbcb65f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:54:21 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-ba426f76-6643-446c-8f30-e7bb4f2be25f tempest-VolumeQuotasAdminTestJSON-143683903 None] Volume 0285b014-8b2c-42c3-86a6-a1cfb2ee9db4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0285b014-8b2c-42c3-86a6-a1cfb2ee9db4', 'volume_size': 1} Sep 08 06:54:21 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-ba426f76-6643-446c-8f30-e7bb4f2be25f tempest-VolumeQuotasAdminTestJSON-143683903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:54:21 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-ba426f76-6643-446c-8f30-e7bb4f2be25f tempest-VolumeQuotasAdminTestJSON-143683903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:54:21 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-ba426f76-6643-446c-8f30-e7bb4f2be25f tempest-VolumeQuotasAdminTestJSON-143683903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:54:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2133095135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0285b014-8b2c-42c3-86a6-a1cfb2ee9db4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a14be69e00b417f92258c27bf0d6270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:54:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:54:22Z,use_quota=True,user_id='37522f0c657e47c99942f04f089e1159',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:54:21 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-ba426f76-6643-446c-8f30-e7bb4f2be25f tempest-VolumeQuotasAdminTestJSON-143683903 None] Creating volume 0285b014-8b2c-42c3-86a6-a1cfb2ee9db4 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:54:21 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-ba426f76-6643-446c-8f30-e7bb4f2be25f tempest-VolumeQuotasAdminTestJSON-143683903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:54:21 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-ba426f76-6643-446c-8f30-e7bb4f2be25f tempest-VolumeQuotasAdminTestJSON-143683903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:54:21 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-ba426f76-6643-446c-8f30-e7bb4f2be25f tempest-VolumeQuotasAdminTestJSON-143683903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:54:21 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-ba426f76-6643-446c-8f30-e7bb4f2be25f tempest-VolumeQuotasAdminTestJSON-143683903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:54:21 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-ba426f76-6643-446c-8f30-e7bb4f2be25f tempest-VolumeQuotasAdminTestJSON-143683903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:54:21 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-ba426f76-6643-446c-8f30-e7bb4f2be25f tempest-VolumeQuotasAdminTestJSON-143683903 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:54:21 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-ba426f76-6643-446c-8f30-e7bb4f2be25f tempest-VolumeQuotasAdminTestJSON-143683903 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:54:21 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ba426f76-6643-446c-8f30-e7bb4f2be25f tempest-VolumeQuotasAdminTestJSON-143683903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0285b014-8b2c-42c3-86a6-a1cfb2ee9db4 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:54:21 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0285b014-8b2c-42c3-86a6-a1cfb2ee9db4 1073741824 Sep 08 06:54:21 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:54:22 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Sep 08 06:54:22 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ba426f76-6643-446c-8f30-e7bb4f2be25f tempest-VolumeQuotasAdminTestJSON-143683903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0285b014-8b2c-42c3-86a6-a1cfb2ee9db4 1073741824" returned: 0 in 0.555s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:54:22 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ba426f76-6643-446c-8f30-e7bb4f2be25f tempest-VolumeQuotasAdminTestJSON-143683903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0285b014-8b2c-42c3-86a6-a1cfb2ee9db4 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:54:22 devstack sudo[106718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0285b014-8b2c-42c3-86a6-a1cfb2ee9db4 Sep 08 06:54:22 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:54:22 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root Sep 08 06:54:22 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ba426f76-6643-446c-8f30-e7bb4f2be25f tempest-VolumeQuotasAdminTestJSON-143683903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0285b014-8b2c-42c3-86a6-a1cfb2ee9db4" returned: 0 in 0.520s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:54:22 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-ba426f76-6643-446c-8f30-e7bb4f2be25f tempest-VolumeQuotasAdminTestJSON-143683903 None] <== create_volume: return (1158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:54:22 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-ba426f76-6643-446c-8f30-e7bb4f2be25f tempest-VolumeQuotasAdminTestJSON-143683903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:54:22 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ba426f76-6643-446c-8f30-e7bb4f2be25f tempest-VolumeQuotasAdminTestJSON-143683903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a6075c9-dc07-4e6c-b0a5-3402fbcb65f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0285b014-8b2c-42c3-86a6-a1cfb2ee9db4', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:54:22 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ba426f76-6643-446c-8f30-e7bb4f2be25f tempest-VolumeQuotasAdminTestJSON-143683903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f00f782d-bc98-4a60-b345-3037be55090b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:54:22 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-ba426f76-6643-446c-8f30-e7bb4f2be25f tempest-VolumeQuotasAdminTestJSON-143683903 None] Volume volume-0285b014-8b2c-42c3-86a6-a1cfb2ee9db4 (0285b014-8b2c-42c3-86a6-a1cfb2ee9db4): created successfully Sep 08 06:54:22 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ba426f76-6643-446c-8f30-e7bb4f2be25f tempest-VolumeQuotasAdminTestJSON-143683903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f00f782d-bc98-4a60-b345-3037be55090b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:54:22 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ba426f76-6643-446c-8f30-e7bb4f2be25f tempest-VolumeQuotasAdminTestJSON-143683903 None] Flow 'volume_create_manager' (45463553-e67f-4a59-8a5b-46b68a93d264) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:54:22 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-ba426f76-6643-446c-8f30-e7bb4f2be25f tempest-VolumeQuotasAdminTestJSON-143683903 None] Created volume successfully. Sep 08 06:54:24 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-2c9b5e93-bcee-4254-96f5-1f0e7366416e tempest-VolumeQuotasAdminTestJSON-346713385 None] Transfer volume completed successfully. Sep 08 06:54:25 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-613dc322-8188-41f4-b85b-e5bb60428d96 tempest-VolumeQuotasAdminTestJSON-839562275 None] Acquiring lock "cinder-0285b014-8b2c-42c3-86a6-a1cfb2ee9db4-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:54:25 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-613dc322-8188-41f4-b85b-e5bb60428d96 tempest-VolumeQuotasAdminTestJSON-839562275 None] Lock "cinder-0285b014-8b2c-42c3-86a6-a1cfb2ee9db4-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:54:25 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-613dc322-8188-41f4-b85b-e5bb60428d96 tempest-VolumeQuotasAdminTestJSON-839562275 None] Acquiring lock "cinder-quobyte-0285b014-8b2c-42c3-86a6-a1cfb2ee9db4" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:54:25 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-613dc322-8188-41f4-b85b-e5bb60428d96 tempest-VolumeQuotasAdminTestJSON-839562275 None] Lock "cinder-quobyte-0285b014-8b2c-42c3-86a6-a1cfb2ee9db4" acquired by "delete_volume" :: waited 0.025s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:54:25 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf3b486-1cc0-48fa-bec3-f796dadfea27]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:54:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-613dc322-8188-41f4-b85b-e5bb60428d96 tempest-VolumeQuotasAdminTestJSON-839562275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0285b014-8b2c-42c3-86a6-a1cfb2ee9db4 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:54:25 devstack sudo[106828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0285b014-8b2c-42c3-86a6-a1cfb2ee9db4 Sep 08 06:54:25 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:54:25 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root Sep 08 06:54:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-613dc322-8188-41f4-b85b-e5bb60428d96 tempest-VolumeQuotasAdminTestJSON-839562275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0285b014-8b2c-42c3-86a6-a1cfb2ee9db4" returned: 0 in 0.423s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:54:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-613dc322-8188-41f4-b85b-e5bb60428d96 tempest-VolumeQuotasAdminTestJSON-839562275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0285b014-8b2c-42c3-86a6-a1cfb2ee9db4 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:54:25 devstack sudo[106847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0285b014-8b2c-42c3-86a6-a1cfb2ee9db4 Sep 08 06:54:25 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:54:25 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root Sep 08 06:54:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-613dc322-8188-41f4-b85b-e5bb60428d96 tempest-VolumeQuotasAdminTestJSON-839562275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0285b014-8b2c-42c3-86a6-a1cfb2ee9db4" returned: 0 in 0.305s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:54:25 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-613dc322-8188-41f4-b85b-e5bb60428d96 tempest-VolumeQuotasAdminTestJSON-839562275 None] Lock "cinder-quobyte-0285b014-8b2c-42c3-86a6-a1cfb2ee9db4" released by "delete_volume" :: held 0.778s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:54:25 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-613dc322-8188-41f4-b85b-e5bb60428d96 tempest-VolumeQuotasAdminTestJSON-839562275 None] Created reservations ['2964bfe5-ee00-4f64-87df-c888b1a900e5', '5f0dda07-24fc-483a-b703-b63855a2ef90', 'f0d5399b-cd72-4f41-8b51-f6744abdc912', 'c69ef883-e633-49f7-aa0f-132ac8403572'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:54:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-613dc322-8188-41f4-b85b-e5bb60428d96 tempest-VolumeQuotasAdminTestJSON-839562275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:54:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-613dc322-8188-41f4-b85b-e5bb60428d96 tempest-VolumeQuotasAdminTestJSON-839562275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:54:26 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-613dc322-8188-41f4-b85b-e5bb60428d96 tempest-VolumeQuotasAdminTestJSON-839562275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:54:26 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-613dc322-8188-41f4-b85b-e5bb60428d96 tempest-VolumeQuotasAdminTestJSON-839562275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:54:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-613dc322-8188-41f4-b85b-e5bb60428d96 tempest-VolumeQuotasAdminTestJSON-839562275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:54:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-613dc322-8188-41f4-b85b-e5bb60428d96 tempest-VolumeQuotasAdminTestJSON-839562275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:54:26 devstack sudo[106863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:54:26 devstack sudo[106863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:54:26 devstack sudo[106863]: pam_unix(sudo:session): session closed for user root Sep 08 06:54:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-613dc322-8188-41f4-b85b-e5bb60428d96 tempest-VolumeQuotasAdminTestJSON-839562275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.377s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:54:26 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-613dc322-8188-41f4-b85b-e5bb60428d96 tempest-VolumeQuotasAdminTestJSON-839562275 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:54:26 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-613dc322-8188-41f4-b85b-e5bb60428d96 tempest-VolumeQuotasAdminTestJSON-839562275 None] Deleted volume successfully. Sep 08 06:54:26 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-613dc322-8188-41f4-b85b-e5bb60428d96 tempest-VolumeQuotasAdminTestJSON-839562275 None] Lock "cinder-0285b014-8b2c-42c3-86a6-a1cfb2ee9db4-delete_volume" released by "delete_volume" :: held 1.444s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:54:30 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd3f2a98-1617-4037-b0cb-a9133091bee7 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:54:30 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-cd3f2a98-1617-4037-b0cb-a9133091bee7 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Flow 'volume_create_manager' (a555d57f-7aef-42c6-8c16-1e9509f670cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:54:30 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-cd3f2a98-1617-4037-b0cb-a9133091bee7 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9fae124-7d9f-4773-9ecb-000e3c1ae80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:54:30 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-cd3f2a98-1617-4037-b0cb-a9133091bee7 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9fae124-7d9f-4773-9ecb-000e3c1ae80a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:54:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-279733323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=599ec05a-ee64-427f-966a-3984ac95d6f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72c8024e6dfc4ffdaec7f6be85a0eaeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:54:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:54:30Z,use_quota=True,user_id='4a0564ff4b7f492da4f659e49fc2bedc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:54:30 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-cd3f2a98-1617-4037-b0cb-a9133091bee7 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac126b65-7b88-48f2-a328-1548af616f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:54:30 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-cd3f2a98-1617-4037-b0cb-a9133091bee7 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac126b65-7b88-48f2-a328-1548af616f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:54:30 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-cd3f2a98-1617-4037-b0cb-a9133091bee7 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cc27364-d8bb-4b0f-a752-359c24b5fc53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:54:30 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-cd3f2a98-1617-4037-b0cb-a9133091bee7 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cc27364-d8bb-4b0f-a752-359c24b5fc53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '599ec05a-ee64-427f-966a-3984ac95d6f5', 'volume_name': 'volume-599ec05a-ee64-427f-966a-3984ac95d6f5', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:54:30 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-cd3f2a98-1617-4037-b0cb-a9133091bee7 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60a8b5cf-b3e7-4a19-98a7-180545e5d591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:54:30 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-cd3f2a98-1617-4037-b0cb-a9133091bee7 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60a8b5cf-b3e7-4a19-98a7-180545e5d591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:54:30 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-cd3f2a98-1617-4037-b0cb-a9133091bee7 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db919d26-77a1-4213-878d-0bdd7fb4fe1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:54:30 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-cd3f2a98-1617-4037-b0cb-a9133091bee7 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Volume 599ec05a-ee64-427f-966a-3984ac95d6f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-599ec05a-ee64-427f-966a-3984ac95d6f5', 'volume_size': 1} Sep 08 06:54:30 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-cd3f2a98-1617-4037-b0cb-a9133091bee7 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:54:30 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-cd3f2a98-1617-4037-b0cb-a9133091bee7 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:54:30 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-cd3f2a98-1617-4037-b0cb-a9133091bee7 tempest-TestServerVolumeAttachmentScenario-1142016208 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:54:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-279733323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=599ec05a-ee64-427f-966a-3984ac95d6f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72c8024e6dfc4ffdaec7f6be85a0eaeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:54:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:54:30Z,use_quota=True,user_id='4a0564ff4b7f492da4f659e49fc2bedc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:54:30 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-cd3f2a98-1617-4037-b0cb-a9133091bee7 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Creating volume 599ec05a-ee64-427f-966a-3984ac95d6f5 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:54:30 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-cd3f2a98-1617-4037-b0cb-a9133091bee7 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:54:30 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-cd3f2a98-1617-4037-b0cb-a9133091bee7 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:54:30 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-cd3f2a98-1617-4037-b0cb-a9133091bee7 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:54:30 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-cd3f2a98-1617-4037-b0cb-a9133091bee7 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:54:30 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-cd3f2a98-1617-4037-b0cb-a9133091bee7 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:54:30 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-cd3f2a98-1617-4037-b0cb-a9133091bee7 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:54:30 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-cd3f2a98-1617-4037-b0cb-a9133091bee7 tempest-TestServerVolumeAttachmentScenario-1142016208 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:54:30 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-cd3f2a98-1617-4037-b0cb-a9133091bee7 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-599ec05a-ee64-427f-966a-3984ac95d6f5 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:54:30 devstack sudo[107007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-599ec05a-ee64-427f-966a-3984ac95d6f5 1073741824 Sep 08 06:54:30 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:54:31 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-04d07157-92d2-4990-8122-4df7a90c6f08 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:54:31 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-04d07157-92d2-4990-8122-4df7a90c6f08 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Flow 'volume_create_manager' (a6cecc23-2201-4910-8f3b-69bb1e586d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:54:31 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-04d07157-92d2-4990-8122-4df7a90c6f08 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13c9a0ba-8e74-494b-a1fa-953bc2253e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:54:31 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-04d07157-92d2-4990-8122-4df7a90c6f08 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13c9a0ba-8e74-494b-a1fa-953bc2253e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:54:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1144238521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b583bbb-b149-44b8-a4c3-c015ae9c2b35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72c8024e6dfc4ffdaec7f6be85a0eaeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:54:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:54:31Z,use_quota=True,user_id='4a0564ff4b7f492da4f659e49fc2bedc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:54:31 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-04d07157-92d2-4990-8122-4df7a90c6f08 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33e1b8bc-0892-42a7-b2a9-720ba757086e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:54:31 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-04d07157-92d2-4990-8122-4df7a90c6f08 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33e1b8bc-0892-42a7-b2a9-720ba757086e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:54:31 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-04d07157-92d2-4990-8122-4df7a90c6f08 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2af9b947-b0b0-49e4-8ccb-fbe6c1db922a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:54:31 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-04d07157-92d2-4990-8122-4df7a90c6f08 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2af9b947-b0b0-49e4-8ccb-fbe6c1db922a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b583bbb-b149-44b8-a4c3-c015ae9c2b35', 'volume_name': 'volume-7b583bbb-b149-44b8-a4c3-c015ae9c2b35', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:54:31 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-04d07157-92d2-4990-8122-4df7a90c6f08 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38229161-5c5e-4f9a-85cf-90e6f1321d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:54:31 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-04d07157-92d2-4990-8122-4df7a90c6f08 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38229161-5c5e-4f9a-85cf-90e6f1321d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:54:31 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-04d07157-92d2-4990-8122-4df7a90c6f08 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eebb1684-1a4f-4b30-8600-fad6c72a3375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:54:31 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-04d07157-92d2-4990-8122-4df7a90c6f08 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Volume 7b583bbb-b149-44b8-a4c3-c015ae9c2b35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b583bbb-b149-44b8-a4c3-c015ae9c2b35', 'volume_size': 1} Sep 08 06:54:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-04d07157-92d2-4990-8122-4df7a90c6f08 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:54:31 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root Sep 08 06:54:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-cd3f2a98-1617-4037-b0cb-a9133091bee7 tempest-TestServerVolumeAttachmentScenario-1142016208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-599ec05a-ee64-427f-966a-3984ac95d6f5 1073741824" returned: 0 in 0.691s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:54:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-cd3f2a98-1617-4037-b0cb-a9133091bee7 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-599ec05a-ee64-427f-966a-3984ac95d6f5 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:54:31 devstack sudo[107035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-599ec05a-ee64-427f-966a-3984ac95d6f5 Sep 08 06:54:31 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:54:31 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root Sep 08 06:54:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-cd3f2a98-1617-4037-b0cb-a9133091bee7 tempest-TestServerVolumeAttachmentScenario-1142016208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-599ec05a-ee64-427f-966a-3984ac95d6f5" returned: 0 in 0.359s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:54:31 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-cd3f2a98-1617-4037-b0cb-a9133091bee7 tempest-TestServerVolumeAttachmentScenario-1142016208 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:54:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-cd3f2a98-1617-4037-b0cb-a9133091bee7 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:54:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-04d07157-92d2-4990-8122-4df7a90c6f08 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.478s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:54:31 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-04d07157-92d2-4990-8122-4df7a90c6f08 tempest-TestServerVolumeAttachmentScenario-1142016208 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:54:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1144238521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b583bbb-b149-44b8-a4c3-c015ae9c2b35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72c8024e6dfc4ffdaec7f6be85a0eaeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:54:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:54:31Z,use_quota=True,user_id='4a0564ff4b7f492da4f659e49fc2bedc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:54:31 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-04d07157-92d2-4990-8122-4df7a90c6f08 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Creating volume 7b583bbb-b149-44b8-a4c3-c015ae9c2b35 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:54:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-04d07157-92d2-4990-8122-4df7a90c6f08 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:54:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-04d07157-92d2-4990-8122-4df7a90c6f08 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:54:31 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-04d07157-92d2-4990-8122-4df7a90c6f08 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:54:31 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-04d07157-92d2-4990-8122-4df7a90c6f08 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:54:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-04d07157-92d2-4990-8122-4df7a90c6f08 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:54:31 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-04d07157-92d2-4990-8122-4df7a90c6f08 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:54:31 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-04d07157-92d2-4990-8122-4df7a90c6f08 tempest-TestServerVolumeAttachmentScenario-1142016208 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:54:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-04d07157-92d2-4990-8122-4df7a90c6f08 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7b583bbb-b149-44b8-a4c3-c015ae9c2b35 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:54:31 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-cd3f2a98-1617-4037-b0cb-a9133091bee7 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db919d26-77a1-4213-878d-0bdd7fb4fe1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-599ec05a-ee64-427f-966a-3984ac95d6f5', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:54:31 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-cd3f2a98-1617-4037-b0cb-a9133091bee7 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8bcf74a-9bc8-4bbd-95bb-7fb6ef8a3632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:54:31 devstack sudo[107050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7b583bbb-b149-44b8-a4c3-c015ae9c2b35 1073741824 Sep 08 06:54:31 devstack sudo[107050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:54:31 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-cd3f2a98-1617-4037-b0cb-a9133091bee7 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Volume volume-599ec05a-ee64-427f-966a-3984ac95d6f5 (599ec05a-ee64-427f-966a-3984ac95d6f5): created successfully Sep 08 06:54:31 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-cd3f2a98-1617-4037-b0cb-a9133091bee7 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8bcf74a-9bc8-4bbd-95bb-7fb6ef8a3632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:54:31 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-cd3f2a98-1617-4037-b0cb-a9133091bee7 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Flow 'volume_create_manager' (a555d57f-7aef-42c6-8c16-1e9509f670cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:54:31 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-cd3f2a98-1617-4037-b0cb-a9133091bee7 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Created volume successfully. Sep 08 06:54:32 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-e7fc9b43-d5d8-4306-90cf-a4f02092191c tempest-VolumesNegativeTest-899931976 None] Acquiring lock "cinder-524bde1e-abb3-46fa-ad5c-469cf78469cc-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:54:32 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-e7fc9b43-d5d8-4306-90cf-a4f02092191c tempest-VolumesNegativeTest-899931976 None] Lock "cinder-524bde1e-abb3-46fa-ad5c-469cf78469cc-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:54:32 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-e7fc9b43-d5d8-4306-90cf-a4f02092191c tempest-VolumesNegativeTest-899931976 None] Acquiring lock "cinder-quobyte-524bde1e-abb3-46fa-ad5c-469cf78469cc" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:54:32 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-e7fc9b43-d5d8-4306-90cf-a4f02092191c tempest-VolumesNegativeTest-899931976 None] Lock "cinder-quobyte-524bde1e-abb3-46fa-ad5c-469cf78469cc" acquired by "delete_volume" :: waited 0.021s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:54:32 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9f830b-d9fe-4555-a109-098f52c70799]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:54:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e7fc9b43-d5d8-4306-90cf-a4f02092191c tempest-VolumesNegativeTest-899931976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-524bde1e-abb3-46fa-ad5c-469cf78469cc {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:54:32 devstack sudo[107073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-524bde1e-abb3-46fa-ad5c-469cf78469cc Sep 08 06:54:32 devstack sudo[107073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:54:32 devstack sudo[107050]: pam_unix(sudo:session): session closed for user root Sep 08 06:54:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-04d07157-92d2-4990-8122-4df7a90c6f08 tempest-TestServerVolumeAttachmentScenario-1142016208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7b583bbb-b149-44b8-a4c3-c015ae9c2b35 1073741824" returned: 0 in 0.774s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:54:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-04d07157-92d2-4990-8122-4df7a90c6f08 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7b583bbb-b149-44b8-a4c3-c015ae9c2b35 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:54:32 devstack sudo[107082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7b583bbb-b149-44b8-a4c3-c015ae9c2b35 Sep 08 06:54:32 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:54:32 devstack sudo[107073]: pam_unix(sudo:session): session closed for user root Sep 08 06:54:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e7fc9b43-d5d8-4306-90cf-a4f02092191c tempest-VolumesNegativeTest-899931976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-524bde1e-abb3-46fa-ad5c-469cf78469cc" returned: 0 in 0.485s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:54:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e7fc9b43-d5d8-4306-90cf-a4f02092191c tempest-VolumesNegativeTest-899931976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-524bde1e-abb3-46fa-ad5c-469cf78469cc {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:54:32 devstack sudo[107096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-524bde1e-abb3-46fa-ad5c-469cf78469cc Sep 08 06:54:32 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:54:32 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root Sep 08 06:54:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-04d07157-92d2-4990-8122-4df7a90c6f08 tempest-TestServerVolumeAttachmentScenario-1142016208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7b583bbb-b149-44b8-a4c3-c015ae9c2b35" returned: 0 in 0.331s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:54:32 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-04d07157-92d2-4990-8122-4df7a90c6f08 tempest-TestServerVolumeAttachmentScenario-1142016208 None] <== create_volume: return (1164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:54:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-04d07157-92d2-4990-8122-4df7a90c6f08 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.168s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:54:33 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-04d07157-92d2-4990-8122-4df7a90c6f08 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eebb1684-1a4f-4b30-8600-fad6c72a3375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b583bbb-b149-44b8-a4c3-c015ae9c2b35', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:54:33 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-04d07157-92d2-4990-8122-4df7a90c6f08 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (193cf0af-0cf4-43c9-8b1b-6fddb62dcaf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:54:33 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-04d07157-92d2-4990-8122-4df7a90c6f08 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Volume volume-7b583bbb-b149-44b8-a4c3-c015ae9c2b35 (7b583bbb-b149-44b8-a4c3-c015ae9c2b35): created successfully Sep 08 06:54:33 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-04d07157-92d2-4990-8122-4df7a90c6f08 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (193cf0af-0cf4-43c9-8b1b-6fddb62dcaf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:54:33 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-04d07157-92d2-4990-8122-4df7a90c6f08 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Flow 'volume_create_manager' (a6cecc23-2201-4910-8f3b-69bb1e586d3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:54:33 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-04d07157-92d2-4990-8122-4df7a90c6f08 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Created volume successfully. Sep 08 06:54:33 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root Sep 08 06:54:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e7fc9b43-d5d8-4306-90cf-a4f02092191c tempest-VolumesNegativeTest-899931976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-524bde1e-abb3-46fa-ad5c-469cf78469cc" returned: 0 in 0.307s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:54:33 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-e7fc9b43-d5d8-4306-90cf-a4f02092191c tempest-VolumesNegativeTest-899931976 None] Lock "cinder-quobyte-524bde1e-abb3-46fa-ad5c-469cf78469cc" released by "delete_volume" :: held 0.837s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:54:33 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-e7fc9b43-d5d8-4306-90cf-a4f02092191c tempest-VolumesNegativeTest-899931976 None] Created reservations ['440d4df3-b4ed-40b2-94f5-d1ef9281d5a1', 'f069cbd9-29bd-48f7-8b8b-e4f9b3cdcfa0', 'a952c051-f647-4463-8e85-f8cf4f1dcd71', '2469a365-9aaf-4141-ac06-4930f6f9971e'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:54:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-e7fc9b43-d5d8-4306-90cf-a4f02092191c tempest-VolumesNegativeTest-899931976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:54:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-e7fc9b43-d5d8-4306-90cf-a4f02092191c tempest-VolumesNegativeTest-899931976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:54:33 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-e7fc9b43-d5d8-4306-90cf-a4f02092191c tempest-VolumesNegativeTest-899931976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:54:33 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-e7fc9b43-d5d8-4306-90cf-a4f02092191c tempest-VolumesNegativeTest-899931976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:54:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-e7fc9b43-d5d8-4306-90cf-a4f02092191c tempest-VolumesNegativeTest-899931976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:54:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e7fc9b43-d5d8-4306-90cf-a4f02092191c tempest-VolumesNegativeTest-899931976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:54:33 devstack sudo[107114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:54:33 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:54:33 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root Sep 08 06:54:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e7fc9b43-d5d8-4306-90cf-a4f02092191c tempest-VolumesNegativeTest-899931976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.344s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:54:33 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-e7fc9b43-d5d8-4306-90cf-a4f02092191c tempest-VolumesNegativeTest-899931976 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:54:33 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-e7fc9b43-d5d8-4306-90cf-a4f02092191c tempest-VolumesNegativeTest-899931976 None] Deleted volume successfully. Sep 08 06:54:33 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-e7fc9b43-d5d8-4306-90cf-a4f02092191c tempest-VolumesNegativeTest-899931976 None] Lock "cinder-524bde1e-abb3-46fa-ad5c-469cf78469cc-delete_volume" released by "delete_volume" :: held 1.458s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:54:35 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-01ea3bc0-0c33-4985-bc80-a0fccb489980 tempest-VolumesListAdminTestJSON-27452076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:54:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-01ea3bc0-0c33-4985-bc80-a0fccb489980 tempest-VolumesListAdminTestJSON-27452076 None] Flow 'volume_create_manager' (71f44073-b5a8-4674-b038-2188715addb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:54:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-01ea3bc0-0c33-4985-bc80-a0fccb489980 tempest-VolumesListAdminTestJSON-27452076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d271bd3a-8fde-4f3e-83cf-d60534a33211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:54:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-01ea3bc0-0c33-4985-bc80-a0fccb489980 tempest-VolumesListAdminTestJSON-27452076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d271bd3a-8fde-4f3e-83cf-d60534a33211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1149200863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31ba6dea-8527-4f38-afb4-47ad0b4817d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fa08b61ba9b4ea887647bcf7ab9499d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:54:36Z,use_quota=True,user_id='c25529ef0b97419db72570c7be73bedc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:54:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-01ea3bc0-0c33-4985-bc80-a0fccb489980 tempest-VolumesListAdminTestJSON-27452076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (543fe847-afdb-490a-aefe-f11cd91d0dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:54:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-01ea3bc0-0c33-4985-bc80-a0fccb489980 tempest-VolumesListAdminTestJSON-27452076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (543fe847-afdb-490a-aefe-f11cd91d0dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:54:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-01ea3bc0-0c33-4985-bc80-a0fccb489980 tempest-VolumesListAdminTestJSON-27452076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fa69cbb-1994-4856-809b-1cc7ec337142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:54:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-01ea3bc0-0c33-4985-bc80-a0fccb489980 tempest-VolumesListAdminTestJSON-27452076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fa69cbb-1994-4856-809b-1cc7ec337142) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31ba6dea-8527-4f38-afb4-47ad0b4817d2', 'volume_name': 'volume-31ba6dea-8527-4f38-afb4-47ad0b4817d2', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:54:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-01ea3bc0-0c33-4985-bc80-a0fccb489980 tempest-VolumesListAdminTestJSON-27452076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b711ab2-03db-4783-b0b0-70f02d36df83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:54:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-01ea3bc0-0c33-4985-bc80-a0fccb489980 tempest-VolumesListAdminTestJSON-27452076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b711ab2-03db-4783-b0b0-70f02d36df83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:54:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-01ea3bc0-0c33-4985-bc80-a0fccb489980 tempest-VolumesListAdminTestJSON-27452076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e2a1429-7f0d-423a-bfea-21bdaefadcef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:54:35 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-01ea3bc0-0c33-4985-bc80-a0fccb489980 tempest-VolumesListAdminTestJSON-27452076 None] Volume 31ba6dea-8527-4f38-afb4-47ad0b4817d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31ba6dea-8527-4f38-afb4-47ad0b4817d2', 'volume_size': 1} Sep 08 06:54:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-01ea3bc0-0c33-4985-bc80-a0fccb489980 tempest-VolumesListAdminTestJSON-27452076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:54:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-01ea3bc0-0c33-4985-bc80-a0fccb489980 tempest-VolumesListAdminTestJSON-27452076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:54:35 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-01ea3bc0-0c33-4985-bc80-a0fccb489980 tempest-VolumesListAdminTestJSON-27452076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1149200863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31ba6dea-8527-4f38-afb4-47ad0b4817d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fa08b61ba9b4ea887647bcf7ab9499d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:54:36Z,use_quota=True,user_id='c25529ef0b97419db72570c7be73bedc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:54:35 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-01ea3bc0-0c33-4985-bc80-a0fccb489980 tempest-VolumesListAdminTestJSON-27452076 None] Creating volume 31ba6dea-8527-4f38-afb4-47ad0b4817d2 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:54:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-01ea3bc0-0c33-4985-bc80-a0fccb489980 tempest-VolumesListAdminTestJSON-27452076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:54:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-01ea3bc0-0c33-4985-bc80-a0fccb489980 tempest-VolumesListAdminTestJSON-27452076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:54:35 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-01ea3bc0-0c33-4985-bc80-a0fccb489980 tempest-VolumesListAdminTestJSON-27452076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:54:35 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-01ea3bc0-0c33-4985-bc80-a0fccb489980 tempest-VolumesListAdminTestJSON-27452076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:54:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-01ea3bc0-0c33-4985-bc80-a0fccb489980 tempest-VolumesListAdminTestJSON-27452076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:54:35 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-01ea3bc0-0c33-4985-bc80-a0fccb489980 tempest-VolumesListAdminTestJSON-27452076 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:54:35 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-01ea3bc0-0c33-4985-bc80-a0fccb489980 tempest-VolumesListAdminTestJSON-27452076 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:54:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-01ea3bc0-0c33-4985-bc80-a0fccb489980 tempest-VolumesListAdminTestJSON-27452076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-31ba6dea-8527-4f38-afb4-47ad0b4817d2 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:54:35 devstack sudo[107196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-31ba6dea-8527-4f38-afb4-47ad0b4817d2 1073741824 Sep 08 06:54:35 devstack sudo[107196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:54:36 devstack sudo[107196]: pam_unix(sudo:session): session closed for user root Sep 08 06:54:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-01ea3bc0-0c33-4985-bc80-a0fccb489980 tempest-VolumesListAdminTestJSON-27452076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-31ba6dea-8527-4f38-afb4-47ad0b4817d2 1073741824" returned: 0 in 0.543s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:54:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-01ea3bc0-0c33-4985-bc80-a0fccb489980 tempest-VolumesListAdminTestJSON-27452076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-31ba6dea-8527-4f38-afb4-47ad0b4817d2 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:54:36 devstack sudo[107217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-31ba6dea-8527-4f38-afb4-47ad0b4817d2 Sep 08 06:54:36 devstack sudo[107217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:54:36 devstack sudo[107217]: pam_unix(sudo:session): session closed for user root Sep 08 06:54:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-01ea3bc0-0c33-4985-bc80-a0fccb489980 tempest-VolumesListAdminTestJSON-27452076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-31ba6dea-8527-4f38-afb4-47ad0b4817d2" returned: 0 in 0.384s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:54:36 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-01ea3bc0-0c33-4985-bc80-a0fccb489980 tempest-VolumesListAdminTestJSON-27452076 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:54:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-01ea3bc0-0c33-4985-bc80-a0fccb489980 tempest-VolumesListAdminTestJSON-27452076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:54:36 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-01ea3bc0-0c33-4985-bc80-a0fccb489980 tempest-VolumesListAdminTestJSON-27452076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e2a1429-7f0d-423a-bfea-21bdaefadcef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31ba6dea-8527-4f38-afb4-47ad0b4817d2', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:54:36 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-01ea3bc0-0c33-4985-bc80-a0fccb489980 tempest-VolumesListAdminTestJSON-27452076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d81a29fc-fee4-4f4b-868b-f8b4031f0bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:54:36 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-01ea3bc0-0c33-4985-bc80-a0fccb489980 tempest-VolumesListAdminTestJSON-27452076 None] Volume volume-31ba6dea-8527-4f38-afb4-47ad0b4817d2 (31ba6dea-8527-4f38-afb4-47ad0b4817d2): created successfully Sep 08 06:54:36 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-01ea3bc0-0c33-4985-bc80-a0fccb489980 tempest-VolumesListAdminTestJSON-27452076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d81a29fc-fee4-4f4b-868b-f8b4031f0bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:54:36 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-01ea3bc0-0c33-4985-bc80-a0fccb489980 tempest-VolumesListAdminTestJSON-27452076 None] Flow 'volume_create_manager' (71f44073-b5a8-4674-b038-2188715addb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:54:36 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-01ea3bc0-0c33-4985-bc80-a0fccb489980 tempest-VolumesListAdminTestJSON-27452076 None] Created volume successfully. Sep 08 06:54:38 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-de760548-db23-4fc1-adb1-c24b0724dfc6 tempest-VolumesListAdminTestJSON-27452076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:54:38 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-de760548-db23-4fc1-adb1-c24b0724dfc6 tempest-VolumesListAdminTestJSON-27452076 None] Flow 'volume_create_manager' (1844f8b3-eaf0-40b0-8c36-494aa1a633e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:54:38 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-de760548-db23-4fc1-adb1-c24b0724dfc6 tempest-VolumesListAdminTestJSON-27452076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16255d72-ff5b-48a8-b67e-90a5827e350f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:54:38 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-de760548-db23-4fc1-adb1-c24b0724dfc6 tempest-VolumesListAdminTestJSON-27452076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16255d72-ff5b-48a8-b67e-90a5827e350f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:54:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1424302915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a17626b-66e5-4acb-a71d-1384f23ae09d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fa08b61ba9b4ea887647bcf7ab9499d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:54:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:54:38Z,use_quota=True,user_id='c25529ef0b97419db72570c7be73bedc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:54:38 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-de760548-db23-4fc1-adb1-c24b0724dfc6 tempest-VolumesListAdminTestJSON-27452076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e449df1-c100-4be9-bead-2efa499eb7f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:54:38 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-de760548-db23-4fc1-adb1-c24b0724dfc6 tempest-VolumesListAdminTestJSON-27452076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e449df1-c100-4be9-bead-2efa499eb7f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:54:38 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-de760548-db23-4fc1-adb1-c24b0724dfc6 tempest-VolumesListAdminTestJSON-27452076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cb57b7d-f08f-42b1-9847-26ae4bb1a0ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:54:38 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-de760548-db23-4fc1-adb1-c24b0724dfc6 tempest-VolumesListAdminTestJSON-27452076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cb57b7d-f08f-42b1-9847-26ae4bb1a0ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a17626b-66e5-4acb-a71d-1384f23ae09d', 'volume_name': 'volume-1a17626b-66e5-4acb-a71d-1384f23ae09d', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:54:38 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-de760548-db23-4fc1-adb1-c24b0724dfc6 tempest-VolumesListAdminTestJSON-27452076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c3e7308-6bb8-493e-88d0-094299835783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:54:38 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-de760548-db23-4fc1-adb1-c24b0724dfc6 tempest-VolumesListAdminTestJSON-27452076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c3e7308-6bb8-493e-88d0-094299835783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:54:38 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-de760548-db23-4fc1-adb1-c24b0724dfc6 tempest-VolumesListAdminTestJSON-27452076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6effaecd-1647-43c5-99be-58212fcddb44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:54:38 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-de760548-db23-4fc1-adb1-c24b0724dfc6 tempest-VolumesListAdminTestJSON-27452076 None] Volume 1a17626b-66e5-4acb-a71d-1384f23ae09d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a17626b-66e5-4acb-a71d-1384f23ae09d', 'volume_size': 1} Sep 08 06:54:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-de760548-db23-4fc1-adb1-c24b0724dfc6 tempest-VolumesListAdminTestJSON-27452076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:54:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-de760548-db23-4fc1-adb1-c24b0724dfc6 tempest-VolumesListAdminTestJSON-27452076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:54:38 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-de760548-db23-4fc1-adb1-c24b0724dfc6 tempest-VolumesListAdminTestJSON-27452076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:54:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1424302915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a17626b-66e5-4acb-a71d-1384f23ae09d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fa08b61ba9b4ea887647bcf7ab9499d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:54:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:54:38Z,use_quota=True,user_id='c25529ef0b97419db72570c7be73bedc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:54:38 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-de760548-db23-4fc1-adb1-c24b0724dfc6 tempest-VolumesListAdminTestJSON-27452076 None] Creating volume 1a17626b-66e5-4acb-a71d-1384f23ae09d {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:54:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-de760548-db23-4fc1-adb1-c24b0724dfc6 tempest-VolumesListAdminTestJSON-27452076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:54:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-de760548-db23-4fc1-adb1-c24b0724dfc6 tempest-VolumesListAdminTestJSON-27452076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:54:38 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-de760548-db23-4fc1-adb1-c24b0724dfc6 tempest-VolumesListAdminTestJSON-27452076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:54:38 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-de760548-db23-4fc1-adb1-c24b0724dfc6 tempest-VolumesListAdminTestJSON-27452076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:54:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-de760548-db23-4fc1-adb1-c24b0724dfc6 tempest-VolumesListAdminTestJSON-27452076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:54:38 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-de760548-db23-4fc1-adb1-c24b0724dfc6 tempest-VolumesListAdminTestJSON-27452076 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:54:38 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-de760548-db23-4fc1-adb1-c24b0724dfc6 tempest-VolumesListAdminTestJSON-27452076 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:54:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-de760548-db23-4fc1-adb1-c24b0724dfc6 tempest-VolumesListAdminTestJSON-27452076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1a17626b-66e5-4acb-a71d-1384f23ae09d 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:54:38 devstack sudo[107303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1a17626b-66e5-4acb-a71d-1384f23ae09d 1073741824 Sep 08 06:54:38 devstack sudo[107303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:54:38 devstack sudo[107303]: pam_unix(sudo:session): session closed for user root Sep 08 06:54:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-de760548-db23-4fc1-adb1-c24b0724dfc6 tempest-VolumesListAdminTestJSON-27452076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1a17626b-66e5-4acb-a71d-1384f23ae09d 1073741824" returned: 0 in 0.512s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:54:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-de760548-db23-4fc1-adb1-c24b0724dfc6 tempest-VolumesListAdminTestJSON-27452076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1a17626b-66e5-4acb-a71d-1384f23ae09d {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:54:39 devstack sudo[107328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1a17626b-66e5-4acb-a71d-1384f23ae09d Sep 08 06:54:39 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:54:39 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root Sep 08 06:54:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-de760548-db23-4fc1-adb1-c24b0724dfc6 tempest-VolumesListAdminTestJSON-27452076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1a17626b-66e5-4acb-a71d-1384f23ae09d" returned: 0 in 0.325s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:54:39 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-de760548-db23-4fc1-adb1-c24b0724dfc6 tempest-VolumesListAdminTestJSON-27452076 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:54:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-de760548-db23-4fc1-adb1-c24b0724dfc6 tempest-VolumesListAdminTestJSON-27452076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:54:39 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-de760548-db23-4fc1-adb1-c24b0724dfc6 tempest-VolumesListAdminTestJSON-27452076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6effaecd-1647-43c5-99be-58212fcddb44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a17626b-66e5-4acb-a71d-1384f23ae09d', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:54:39 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-de760548-db23-4fc1-adb1-c24b0724dfc6 tempest-VolumesListAdminTestJSON-27452076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0acf567-7e19-458f-852c-b03c6c5a2d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:54:39 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-de760548-db23-4fc1-adb1-c24b0724dfc6 tempest-VolumesListAdminTestJSON-27452076 None] Volume volume-1a17626b-66e5-4acb-a71d-1384f23ae09d (1a17626b-66e5-4acb-a71d-1384f23ae09d): created successfully Sep 08 06:54:39 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-de760548-db23-4fc1-adb1-c24b0724dfc6 tempest-VolumesListAdminTestJSON-27452076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0acf567-7e19-458f-852c-b03c6c5a2d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:54:39 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-de760548-db23-4fc1-adb1-c24b0724dfc6 tempest-VolumesListAdminTestJSON-27452076 None] Flow 'volume_create_manager' (1844f8b3-eaf0-40b0-8c36-494aa1a633e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:54:39 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-de760548-db23-4fc1-adb1-c24b0724dfc6 tempest-VolumesListAdminTestJSON-27452076 None] Created volume successfully. Sep 08 06:54:41 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-e788c8b1-fb52-4212-8d88-720dde95f59a tempest-VolumesListAdminTestJSON-27452076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:54:41 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-e788c8b1-fb52-4212-8d88-720dde95f59a tempest-VolumesListAdminTestJSON-27452076 None] Flow 'volume_create_manager' (c2cff32a-4c0a-432a-a7c9-08e848807c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:54:41 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-e788c8b1-fb52-4212-8d88-720dde95f59a tempest-VolumesListAdminTestJSON-27452076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4d472c9-b1ac-4760-9646-a2d050d5ee3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:54:41 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-e788c8b1-fb52-4212-8d88-720dde95f59a tempest-VolumesListAdminTestJSON-27452076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4d472c9-b1ac-4760-9646-a2d050d5ee3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:54:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1095171450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=145c0f25-19f1-42c5-adf0-25d2ab8e509b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fa08b61ba9b4ea887647bcf7ab9499d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:54:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:54:41Z,use_quota=True,user_id='c25529ef0b97419db72570c7be73bedc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:54:41 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-e788c8b1-fb52-4212-8d88-720dde95f59a tempest-VolumesListAdminTestJSON-27452076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c0c3f91-7864-453b-9b3a-140d8be8f405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:54:41 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-e788c8b1-fb52-4212-8d88-720dde95f59a tempest-VolumesListAdminTestJSON-27452076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c0c3f91-7864-453b-9b3a-140d8be8f405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:54:41 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-e788c8b1-fb52-4212-8d88-720dde95f59a tempest-VolumesListAdminTestJSON-27452076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33ea0f12-7895-4381-ae67-f486bda1662a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:54:41 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-e788c8b1-fb52-4212-8d88-720dde95f59a tempest-VolumesListAdminTestJSON-27452076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33ea0f12-7895-4381-ae67-f486bda1662a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '145c0f25-19f1-42c5-adf0-25d2ab8e509b', 'volume_name': 'volume-145c0f25-19f1-42c5-adf0-25d2ab8e509b', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:54:41 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-e788c8b1-fb52-4212-8d88-720dde95f59a tempest-VolumesListAdminTestJSON-27452076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00596b13-ad0a-4607-9ddb-1ddb8529e168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:54:41 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-e788c8b1-fb52-4212-8d88-720dde95f59a tempest-VolumesListAdminTestJSON-27452076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00596b13-ad0a-4607-9ddb-1ddb8529e168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:54:41 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-e788c8b1-fb52-4212-8d88-720dde95f59a tempest-VolumesListAdminTestJSON-27452076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (764c44e7-5d1c-4131-94de-51075fa0c784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:54:41 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-e788c8b1-fb52-4212-8d88-720dde95f59a tempest-VolumesListAdminTestJSON-27452076 None] Volume 145c0f25-19f1-42c5-adf0-25d2ab8e509b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-145c0f25-19f1-42c5-adf0-25d2ab8e509b', 'volume_size': 1} Sep 08 06:54:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-e788c8b1-fb52-4212-8d88-720dde95f59a tempest-VolumesListAdminTestJSON-27452076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:54:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-e788c8b1-fb52-4212-8d88-720dde95f59a tempest-VolumesListAdminTestJSON-27452076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:54:41 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-e788c8b1-fb52-4212-8d88-720dde95f59a tempest-VolumesListAdminTestJSON-27452076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:54:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1095171450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=145c0f25-19f1-42c5-adf0-25d2ab8e509b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fa08b61ba9b4ea887647bcf7ab9499d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:54:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:54:41Z,use_quota=True,user_id='c25529ef0b97419db72570c7be73bedc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:54:41 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-e788c8b1-fb52-4212-8d88-720dde95f59a tempest-VolumesListAdminTestJSON-27452076 None] Creating volume 145c0f25-19f1-42c5-adf0-25d2ab8e509b {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:54:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-e788c8b1-fb52-4212-8d88-720dde95f59a tempest-VolumesListAdminTestJSON-27452076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:54:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-e788c8b1-fb52-4212-8d88-720dde95f59a tempest-VolumesListAdminTestJSON-27452076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:54:41 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-e788c8b1-fb52-4212-8d88-720dde95f59a tempest-VolumesListAdminTestJSON-27452076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:54:41 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-e788c8b1-fb52-4212-8d88-720dde95f59a tempest-VolumesListAdminTestJSON-27452076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:54:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-e788c8b1-fb52-4212-8d88-720dde95f59a tempest-VolumesListAdminTestJSON-27452076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:54:41 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-e788c8b1-fb52-4212-8d88-720dde95f59a tempest-VolumesListAdminTestJSON-27452076 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:54:41 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-e788c8b1-fb52-4212-8d88-720dde95f59a tempest-VolumesListAdminTestJSON-27452076 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:54:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e788c8b1-fb52-4212-8d88-720dde95f59a tempest-VolumesListAdminTestJSON-27452076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-145c0f25-19f1-42c5-adf0-25d2ab8e509b 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:54:41 devstack sudo[107466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-145c0f25-19f1-42c5-adf0-25d2ab8e509b 1073741824 Sep 08 06:54:41 devstack sudo[107466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:54:42 devstack sudo[107466]: pam_unix(sudo:session): session closed for user root Sep 08 06:54:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e788c8b1-fb52-4212-8d88-720dde95f59a tempest-VolumesListAdminTestJSON-27452076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-145c0f25-19f1-42c5-adf0-25d2ab8e509b 1073741824" returned: 0 in 0.641s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:54:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e788c8b1-fb52-4212-8d88-720dde95f59a tempest-VolumesListAdminTestJSON-27452076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-145c0f25-19f1-42c5-adf0-25d2ab8e509b {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:54:42 devstack sudo[107495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-145c0f25-19f1-42c5-adf0-25d2ab8e509b Sep 08 06:54:42 devstack sudo[107495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:54:42 devstack sudo[107495]: pam_unix(sudo:session): session closed for user root Sep 08 06:54:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e788c8b1-fb52-4212-8d88-720dde95f59a tempest-VolumesListAdminTestJSON-27452076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-145c0f25-19f1-42c5-adf0-25d2ab8e509b" returned: 0 in 0.360s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:54:42 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-e788c8b1-fb52-4212-8d88-720dde95f59a tempest-VolumesListAdminTestJSON-27452076 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:54:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-e788c8b1-fb52-4212-8d88-720dde95f59a tempest-VolumesListAdminTestJSON-27452076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:54:42 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-e788c8b1-fb52-4212-8d88-720dde95f59a tempest-VolumesListAdminTestJSON-27452076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (764c44e7-5d1c-4131-94de-51075fa0c784) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-145c0f25-19f1-42c5-adf0-25d2ab8e509b', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:54:42 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-e788c8b1-fb52-4212-8d88-720dde95f59a tempest-VolumesListAdminTestJSON-27452076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c25c0f4-50ec-4034-a686-a55f004b45b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:54:42 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-e788c8b1-fb52-4212-8d88-720dde95f59a tempest-VolumesListAdminTestJSON-27452076 None] Volume volume-145c0f25-19f1-42c5-adf0-25d2ab8e509b (145c0f25-19f1-42c5-adf0-25d2ab8e509b): created successfully Sep 08 06:54:42 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-e788c8b1-fb52-4212-8d88-720dde95f59a tempest-VolumesListAdminTestJSON-27452076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c25c0f4-50ec-4034-a686-a55f004b45b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:54:42 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-e788c8b1-fb52-4212-8d88-720dde95f59a tempest-VolumesListAdminTestJSON-27452076 None] Flow 'volume_create_manager' (c2cff32a-4c0a-432a-a7c9-08e848807c76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:54:42 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-e788c8b1-fb52-4212-8d88-720dde95f59a tempest-VolumesListAdminTestJSON-27452076 None] Created volume successfully. Sep 08 06:54:44 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaa9e12b-36eb-407e-a5f2-3362e8ccb8c8 tempest-VolumesListAdminTestJSON-1538147854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:54:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-aaa9e12b-36eb-407e-a5f2-3362e8ccb8c8 tempest-VolumesListAdminTestJSON-1538147854 None] Flow 'volume_create_manager' (e3137a30-d822-4273-b7b5-9263facf793b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:54:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-aaa9e12b-36eb-407e-a5f2-3362e8ccb8c8 tempest-VolumesListAdminTestJSON-1538147854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ae3b9bb-259f-4063-9e4b-11c14947d402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:54:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-aaa9e12b-36eb-407e-a5f2-3362e8ccb8c8 tempest-VolumesListAdminTestJSON-1538147854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ae3b9bb-259f-4063-9e4b-11c14947d402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:54:44Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed3f35d9-033b-4988-8b89-7fb3558661dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67f3e96028b24baa821208af15c46635',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:54:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:54:45Z,use_quota=True,user_id='e46a6029c0c8486db2146b968ca9b092',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:54:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-aaa9e12b-36eb-407e-a5f2-3362e8ccb8c8 tempest-VolumesListAdminTestJSON-1538147854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af02e85a-ab5b-4de4-aa6b-230156b5deb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:54:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-aaa9e12b-36eb-407e-a5f2-3362e8ccb8c8 tempest-VolumesListAdminTestJSON-1538147854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af02e85a-ab5b-4de4-aa6b-230156b5deb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:54:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-aaa9e12b-36eb-407e-a5f2-3362e8ccb8c8 tempest-VolumesListAdminTestJSON-1538147854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71744486-1033-478e-9bfc-00593167486c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:54:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-aaa9e12b-36eb-407e-a5f2-3362e8ccb8c8 tempest-VolumesListAdminTestJSON-1538147854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71744486-1033-478e-9bfc-00593167486c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed3f35d9-033b-4988-8b89-7fb3558661dc', 'volume_name': 'volume-ed3f35d9-033b-4988-8b89-7fb3558661dc', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:54:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-aaa9e12b-36eb-407e-a5f2-3362e8ccb8c8 tempest-VolumesListAdminTestJSON-1538147854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e4e3315-4006-440b-b9aa-b9427672655d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:54:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-aaa9e12b-36eb-407e-a5f2-3362e8ccb8c8 tempest-VolumesListAdminTestJSON-1538147854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e4e3315-4006-440b-b9aa-b9427672655d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:54:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-aaa9e12b-36eb-407e-a5f2-3362e8ccb8c8 tempest-VolumesListAdminTestJSON-1538147854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e12a61f-e0a9-4607-a6c0-0653b78d2805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:54:44 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-aaa9e12b-36eb-407e-a5f2-3362e8ccb8c8 tempest-VolumesListAdminTestJSON-1538147854 None] Volume ed3f35d9-033b-4988-8b89-7fb3558661dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed3f35d9-033b-4988-8b89-7fb3558661dc', 'volume_size': 1} Sep 08 06:54:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-aaa9e12b-36eb-407e-a5f2-3362e8ccb8c8 tempest-VolumesListAdminTestJSON-1538147854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:54:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-aaa9e12b-36eb-407e-a5f2-3362e8ccb8c8 tempest-VolumesListAdminTestJSON-1538147854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:54:44 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-aaa9e12b-36eb-407e-a5f2-3362e8ccb8c8 tempest-VolumesListAdminTestJSON-1538147854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:54:44Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed3f35d9-033b-4988-8b89-7fb3558661dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67f3e96028b24baa821208af15c46635',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:54:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:54:45Z,use_quota=True,user_id='e46a6029c0c8486db2146b968ca9b092',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:54:44 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-aaa9e12b-36eb-407e-a5f2-3362e8ccb8c8 tempest-VolumesListAdminTestJSON-1538147854 None] Creating volume ed3f35d9-033b-4988-8b89-7fb3558661dc {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:54:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-aaa9e12b-36eb-407e-a5f2-3362e8ccb8c8 tempest-VolumesListAdminTestJSON-1538147854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:54:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-aaa9e12b-36eb-407e-a5f2-3362e8ccb8c8 tempest-VolumesListAdminTestJSON-1538147854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:54:44 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-aaa9e12b-36eb-407e-a5f2-3362e8ccb8c8 tempest-VolumesListAdminTestJSON-1538147854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:54:44 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-aaa9e12b-36eb-407e-a5f2-3362e8ccb8c8 tempest-VolumesListAdminTestJSON-1538147854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:54:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-aaa9e12b-36eb-407e-a5f2-3362e8ccb8c8 tempest-VolumesListAdminTestJSON-1538147854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:54:44 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-aaa9e12b-36eb-407e-a5f2-3362e8ccb8c8 tempest-VolumesListAdminTestJSON-1538147854 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:54:44 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-aaa9e12b-36eb-407e-a5f2-3362e8ccb8c8 tempest-VolumesListAdminTestJSON-1538147854 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:54:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-aaa9e12b-36eb-407e-a5f2-3362e8ccb8c8 tempest-VolumesListAdminTestJSON-1538147854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ed3f35d9-033b-4988-8b89-7fb3558661dc 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:54:45 devstack sudo[107588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ed3f35d9-033b-4988-8b89-7fb3558661dc 1073741824 Sep 08 06:54:45 devstack sudo[107588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:54:45 devstack sudo[107588]: pam_unix(sudo:session): session closed for user root Sep 08 06:54:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-aaa9e12b-36eb-407e-a5f2-3362e8ccb8c8 tempest-VolumesListAdminTestJSON-1538147854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ed3f35d9-033b-4988-8b89-7fb3558661dc 1073741824" returned: 0 in 0.625s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:54:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-aaa9e12b-36eb-407e-a5f2-3362e8ccb8c8 tempest-VolumesListAdminTestJSON-1538147854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ed3f35d9-033b-4988-8b89-7fb3558661dc {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:54:45 devstack sudo[107614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ed3f35d9-033b-4988-8b89-7fb3558661dc Sep 08 06:54:45 devstack sudo[107614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:54:46 devstack sudo[107614]: pam_unix(sudo:session): session closed for user root Sep 08 06:54:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-aaa9e12b-36eb-407e-a5f2-3362e8ccb8c8 tempest-VolumesListAdminTestJSON-1538147854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ed3f35d9-033b-4988-8b89-7fb3558661dc" returned: 0 in 0.334s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:54:46 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-aaa9e12b-36eb-407e-a5f2-3362e8ccb8c8 tempest-VolumesListAdminTestJSON-1538147854 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:54:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-aaa9e12b-36eb-407e-a5f2-3362e8ccb8c8 tempest-VolumesListAdminTestJSON-1538147854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:54:46 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-aaa9e12b-36eb-407e-a5f2-3362e8ccb8c8 tempest-VolumesListAdminTestJSON-1538147854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e12a61f-e0a9-4607-a6c0-0653b78d2805) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed3f35d9-033b-4988-8b89-7fb3558661dc', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:54:46 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-aaa9e12b-36eb-407e-a5f2-3362e8ccb8c8 tempest-VolumesListAdminTestJSON-1538147854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e9e86b3-4979-47a1-8014-3dd49f57f65c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:54:46 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-aaa9e12b-36eb-407e-a5f2-3362e8ccb8c8 tempest-VolumesListAdminTestJSON-1538147854 None] Volume volume-ed3f35d9-033b-4988-8b89-7fb3558661dc (ed3f35d9-033b-4988-8b89-7fb3558661dc): created successfully Sep 08 06:54:46 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-aaa9e12b-36eb-407e-a5f2-3362e8ccb8c8 tempest-VolumesListAdminTestJSON-1538147854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e9e86b3-4979-47a1-8014-3dd49f57f65c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:54:46 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-aaa9e12b-36eb-407e-a5f2-3362e8ccb8c8 tempest-VolumesListAdminTestJSON-1538147854 None] Flow 'volume_create_manager' (e3137a30-d822-4273-b7b5-9263facf793b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:54:46 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-aaa9e12b-36eb-407e-a5f2-3362e8ccb8c8 tempest-VolumesListAdminTestJSON-1538147854 None] Created volume successfully. Sep 08 06:54:47 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-4ef2496a-cbd7-4ad4-b360-70ae1e3d0569 tempest-VolumesListAdminTestJSON-1538147854 None] Acquiring lock "cinder-ed3f35d9-033b-4988-8b89-7fb3558661dc-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:54:47 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-4ef2496a-cbd7-4ad4-b360-70ae1e3d0569 tempest-VolumesListAdminTestJSON-1538147854 None] Lock "cinder-ed3f35d9-033b-4988-8b89-7fb3558661dc-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:54:47 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-4ef2496a-cbd7-4ad4-b360-70ae1e3d0569 tempest-VolumesListAdminTestJSON-1538147854 None] Acquiring lock "cinder-quobyte-ed3f35d9-033b-4988-8b89-7fb3558661dc" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:54:47 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-4ef2496a-cbd7-4ad4-b360-70ae1e3d0569 tempest-VolumesListAdminTestJSON-1538147854 None] Lock "cinder-quobyte-ed3f35d9-033b-4988-8b89-7fb3558661dc" acquired by "delete_volume" :: waited 0.029s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:54:47 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15511b5-d5d8-496f-afc1-83aa08adaf22]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:54:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4ef2496a-cbd7-4ad4-b360-70ae1e3d0569 tempest-VolumesListAdminTestJSON-1538147854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ed3f35d9-033b-4988-8b89-7fb3558661dc {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:54:47 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-2ff7c380-0981-481e-8e9f-34731fe431e0 tempest-VolumesListAdminTestJSON-27452076 None] Acquiring lock "cinder-145c0f25-19f1-42c5-adf0-25d2ab8e509b-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:54:47 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-2ff7c380-0981-481e-8e9f-34731fe431e0 tempest-VolumesListAdminTestJSON-27452076 None] Lock "cinder-145c0f25-19f1-42c5-adf0-25d2ab8e509b-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:54:47 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-2ff7c380-0981-481e-8e9f-34731fe431e0 tempest-VolumesListAdminTestJSON-27452076 None] Acquiring lock "cinder-quobyte-145c0f25-19f1-42c5-adf0-25d2ab8e509b" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:54:47 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-2ff7c380-0981-481e-8e9f-34731fe431e0 tempest-VolumesListAdminTestJSON-27452076 None] Lock "cinder-quobyte-145c0f25-19f1-42c5-adf0-25d2ab8e509b" acquired by "delete_volume" :: waited 0.025s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:54:47 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38cfcfd-e36c-4dea-be80-ca4d5f880edb]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:54:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2ff7c380-0981-481e-8e9f-34731fe431e0 tempest-VolumesListAdminTestJSON-27452076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-145c0f25-19f1-42c5-adf0-25d2ab8e509b {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:54:47 devstack sudo[107662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ed3f35d9-033b-4988-8b89-7fb3558661dc Sep 08 06:54:47 devstack sudo[107662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:54:47 devstack sudo[107671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-145c0f25-19f1-42c5-adf0-25d2ab8e509b Sep 08 06:54:47 devstack sudo[107671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:54:47 devstack sudo[107662]: pam_unix(sudo:session): session closed for user root Sep 08 06:54:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4ef2496a-cbd7-4ad4-b360-70ae1e3d0569 tempest-VolumesListAdminTestJSON-1538147854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ed3f35d9-033b-4988-8b89-7fb3558661dc" returned: 0 in 0.661s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:54:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4ef2496a-cbd7-4ad4-b360-70ae1e3d0569 tempest-VolumesListAdminTestJSON-1538147854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ed3f35d9-033b-4988-8b89-7fb3558661dc {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:54:47 devstack sudo[107693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ed3f35d9-033b-4988-8b89-7fb3558661dc Sep 08 06:54:47 devstack sudo[107693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:54:48 devstack sudo[107671]: pam_unix(sudo:session): session closed for user root Sep 08 06:54:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2ff7c380-0981-481e-8e9f-34731fe431e0 tempest-VolumesListAdminTestJSON-27452076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-145c0f25-19f1-42c5-adf0-25d2ab8e509b" returned: 0 in 0.523s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:54:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2ff7c380-0981-481e-8e9f-34731fe431e0 tempest-VolumesListAdminTestJSON-27452076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-145c0f25-19f1-42c5-adf0-25d2ab8e509b {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:54:48 devstack sudo[107698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-145c0f25-19f1-42c5-adf0-25d2ab8e509b Sep 08 06:54:48 devstack sudo[107698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:54:48 devstack sudo[107693]: pam_unix(sudo:session): session closed for user root Sep 08 06:54:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4ef2496a-cbd7-4ad4-b360-70ae1e3d0569 tempest-VolumesListAdminTestJSON-1538147854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ed3f35d9-033b-4988-8b89-7fb3558661dc" returned: 0 in 0.334s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:54:48 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-4ef2496a-cbd7-4ad4-b360-70ae1e3d0569 tempest-VolumesListAdminTestJSON-1538147854 None] Lock "cinder-quobyte-ed3f35d9-033b-4988-8b89-7fb3558661dc" released by "delete_volume" :: held 1.072s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:54:48 devstack sudo[107698]: pam_unix(sudo:session): session closed for user root Sep 08 06:54:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2ff7c380-0981-481e-8e9f-34731fe431e0 tempest-VolumesListAdminTestJSON-27452076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-145c0f25-19f1-42c5-adf0-25d2ab8e509b" returned: 0 in 0.385s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:54:48 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-2ff7c380-0981-481e-8e9f-34731fe431e0 tempest-VolumesListAdminTestJSON-27452076 None] Lock "cinder-quobyte-145c0f25-19f1-42c5-adf0-25d2ab8e509b" released by "delete_volume" :: held 0.978s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:54:48 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-4ef2496a-cbd7-4ad4-b360-70ae1e3d0569 tempest-VolumesListAdminTestJSON-1538147854 None] Created reservations ['856013d1-bf83-4d0d-8546-d9f94a5eeb3f', 'b70c275c-754e-4ede-856f-5b42770dafe8', '2c74c05f-d307-456c-bdd0-36c8fa330ab9', 'bf7a43b6-d656-466d-82fc-304bdd824f39'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:54:48 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-2ff7c380-0981-481e-8e9f-34731fe431e0 tempest-VolumesListAdminTestJSON-27452076 None] Created reservations ['9c8f51ba-2ceb-4ba9-8a3a-1d78485a3069', '5d78b786-e9dd-487f-872d-6f25a289706a', 'cec3be18-c340-4226-be04-207a3c1eb7fe', 'c84f2ad1-9c25-408d-8f30-42f0d14e4620'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:54:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4ef2496a-cbd7-4ad4-b360-70ae1e3d0569 tempest-VolumesListAdminTestJSON-1538147854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:54:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4ef2496a-cbd7-4ad4-b360-70ae1e3d0569 tempest-VolumesListAdminTestJSON-1538147854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:54:48 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-4ef2496a-cbd7-4ad4-b360-70ae1e3d0569 tempest-VolumesListAdminTestJSON-1538147854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:54:48 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-4ef2496a-cbd7-4ad4-b360-70ae1e3d0569 tempest-VolumesListAdminTestJSON-1538147854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:54:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4ef2496a-cbd7-4ad4-b360-70ae1e3d0569 tempest-VolumesListAdminTestJSON-1538147854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:54:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4ef2496a-cbd7-4ad4-b360-70ae1e3d0569 tempest-VolumesListAdminTestJSON-1538147854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:54:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-2ff7c380-0981-481e-8e9f-34731fe431e0 tempest-VolumesListAdminTestJSON-27452076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:54:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-2ff7c380-0981-481e-8e9f-34731fe431e0 tempest-VolumesListAdminTestJSON-27452076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:54:48 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-2ff7c380-0981-481e-8e9f-34731fe431e0 tempest-VolumesListAdminTestJSON-27452076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:54:48 devstack sudo[107717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:54:48 devstack sudo[107717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:54:48 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-2ff7c380-0981-481e-8e9f-34731fe431e0 tempest-VolumesListAdminTestJSON-27452076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:54:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-2ff7c380-0981-481e-8e9f-34731fe431e0 tempest-VolumesListAdminTestJSON-27452076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:54:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2ff7c380-0981-481e-8e9f-34731fe431e0 tempest-VolumesListAdminTestJSON-27452076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:54:48 devstack sudo[107722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:54:48 devstack sudo[107722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:54:48 devstack sudo[107722]: pam_unix(sudo:session): session closed for user root Sep 08 06:54:48 devstack sudo[107717]: pam_unix(sudo:session): session closed for user root Sep 08 06:54:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2ff7c380-0981-481e-8e9f-34731fe431e0 tempest-VolumesListAdminTestJSON-27452076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.331s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:54:48 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-2ff7c380-0981-481e-8e9f-34731fe431e0 tempest-VolumesListAdminTestJSON-27452076 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:54:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4ef2496a-cbd7-4ad4-b360-70ae1e3d0569 tempest-VolumesListAdminTestJSON-1538147854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.406s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:54:48 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-4ef2496a-cbd7-4ad4-b360-70ae1e3d0569 tempest-VolumesListAdminTestJSON-1538147854 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:54:48 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-2ff7c380-0981-481e-8e9f-34731fe431e0 tempest-VolumesListAdminTestJSON-27452076 None] Deleted volume successfully. Sep 08 06:54:49 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-4ef2496a-cbd7-4ad4-b360-70ae1e3d0569 tempest-VolumesListAdminTestJSON-1538147854 None] Deleted volume successfully. Sep 08 06:54:49 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-2ff7c380-0981-481e-8e9f-34731fe431e0 tempest-VolumesListAdminTestJSON-27452076 None] Lock "cinder-145c0f25-19f1-42c5-adf0-25d2ab8e509b-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:54:49 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-4ef2496a-cbd7-4ad4-b360-70ae1e3d0569 tempest-VolumesListAdminTestJSON-1538147854 None] Lock "cinder-ed3f35d9-033b-4988-8b89-7fb3558661dc-delete_volume" released by "delete_volume" :: held 1.925s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:54:49 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-22e5a4be-afdc-462f-b26b-fa00bd1c9fce tempest-VolumesListAdminTestJSON-27452076 None] Acquiring lock "cinder-1a17626b-66e5-4acb-a71d-1384f23ae09d-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:54:49 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-22e5a4be-afdc-462f-b26b-fa00bd1c9fce tempest-VolumesListAdminTestJSON-27452076 None] Lock "cinder-1a17626b-66e5-4acb-a71d-1384f23ae09d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:54:49 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-22e5a4be-afdc-462f-b26b-fa00bd1c9fce tempest-VolumesListAdminTestJSON-27452076 None] Acquiring lock "cinder-quobyte-1a17626b-66e5-4acb-a71d-1384f23ae09d" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:54:49 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-22e5a4be-afdc-462f-b26b-fa00bd1c9fce tempest-VolumesListAdminTestJSON-27452076 None] Lock "cinder-quobyte-1a17626b-66e5-4acb-a71d-1384f23ae09d" acquired by "delete_volume" :: waited 0.023s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:54:49 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[769219f2-d67a-40a7-874a-64dfe75ab4bb]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:54:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-22e5a4be-afdc-462f-b26b-fa00bd1c9fce tempest-VolumesListAdminTestJSON-27452076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1a17626b-66e5-4acb-a71d-1384f23ae09d {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:54:50 devstack sudo[107763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1a17626b-66e5-4acb-a71d-1384f23ae09d Sep 08 06:54:50 devstack sudo[107763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:54:50 devstack sudo[107763]: pam_unix(sudo:session): session closed for user root Sep 08 06:54:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-22e5a4be-afdc-462f-b26b-fa00bd1c9fce tempest-VolumesListAdminTestJSON-27452076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1a17626b-66e5-4acb-a71d-1384f23ae09d" returned: 0 in 0.508s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:54:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-22e5a4be-afdc-462f-b26b-fa00bd1c9fce tempest-VolumesListAdminTestJSON-27452076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1a17626b-66e5-4acb-a71d-1384f23ae09d {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:54:50 devstack sudo[107783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1a17626b-66e5-4acb-a71d-1384f23ae09d Sep 08 06:54:50 devstack sudo[107783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:54:50 devstack sudo[107783]: pam_unix(sudo:session): session closed for user root Sep 08 06:54:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-22e5a4be-afdc-462f-b26b-fa00bd1c9fce tempest-VolumesListAdminTestJSON-27452076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1a17626b-66e5-4acb-a71d-1384f23ae09d" returned: 0 in 0.439s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:54:50 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-22e5a4be-afdc-462f-b26b-fa00bd1c9fce tempest-VolumesListAdminTestJSON-27452076 None] Lock "cinder-quobyte-1a17626b-66e5-4acb-a71d-1384f23ae09d" released by "delete_volume" :: held 1.092s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:54:50 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-22e5a4be-afdc-462f-b26b-fa00bd1c9fce tempest-VolumesListAdminTestJSON-27452076 None] Created reservations ['3e2aa051-c9d1-46f0-bc32-99f07463b6e2', 'e4f178e6-4dd8-439d-b400-fda08386320e', '9cf262d0-378c-492d-a3db-226b0ddf2e41', 'f3bf21c9-d4db-402d-8c83-f0c521893072'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:54:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-22e5a4be-afdc-462f-b26b-fa00bd1c9fce tempest-VolumesListAdminTestJSON-27452076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:54:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-22e5a4be-afdc-462f-b26b-fa00bd1c9fce tempest-VolumesListAdminTestJSON-27452076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:54:51 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-22e5a4be-afdc-462f-b26b-fa00bd1c9fce tempest-VolumesListAdminTestJSON-27452076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:54:51 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-22e5a4be-afdc-462f-b26b-fa00bd1c9fce tempest-VolumesListAdminTestJSON-27452076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:54:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-22e5a4be-afdc-462f-b26b-fa00bd1c9fce tempest-VolumesListAdminTestJSON-27452076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:54:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-22e5a4be-afdc-462f-b26b-fa00bd1c9fce tempest-VolumesListAdminTestJSON-27452076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:54:51 devstack sudo[107807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:54:51 devstack sudo[107807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:54:51 devstack sudo[107807]: pam_unix(sudo:session): session closed for user root Sep 08 06:54:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-22e5a4be-afdc-462f-b26b-fa00bd1c9fce tempest-VolumesListAdminTestJSON-27452076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.332s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:54:51 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-22e5a4be-afdc-462f-b26b-fa00bd1c9fce tempest-VolumesListAdminTestJSON-27452076 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:54:51 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-22e5a4be-afdc-462f-b26b-fa00bd1c9fce tempest-VolumesListAdminTestJSON-27452076 None] Deleted volume successfully. Sep 08 06:54:51 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-22e5a4be-afdc-462f-b26b-fa00bd1c9fce tempest-VolumesListAdminTestJSON-27452076 None] Lock "cinder-1a17626b-66e5-4acb-a71d-1384f23ae09d-delete_volume" released by "delete_volume" :: held 1.765s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:54:52 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-ffffc92d-1f5a-4fc7-b4d6-da6f6b2532ac tempest-VolumesListAdminTestJSON-27452076 None] Acquiring lock "cinder-31ba6dea-8527-4f38-afb4-47ad0b4817d2-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:54:52 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-ffffc92d-1f5a-4fc7-b4d6-da6f6b2532ac tempest-VolumesListAdminTestJSON-27452076 None] Lock "cinder-31ba6dea-8527-4f38-afb4-47ad0b4817d2-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:54:52 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-ffffc92d-1f5a-4fc7-b4d6-da6f6b2532ac tempest-VolumesListAdminTestJSON-27452076 None] Acquiring lock "cinder-quobyte-31ba6dea-8527-4f38-afb4-47ad0b4817d2" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:54:52 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-ffffc92d-1f5a-4fc7-b4d6-da6f6b2532ac tempest-VolumesListAdminTestJSON-27452076 None] Lock "cinder-quobyte-31ba6dea-8527-4f38-afb4-47ad0b4817d2" acquired by "delete_volume" :: waited 0.029s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:54:52 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb4844b-9e49-4597-9756-cf49d0aba152]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:54:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ffffc92d-1f5a-4fc7-b4d6-da6f6b2532ac tempest-VolumesListAdminTestJSON-27452076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-31ba6dea-8527-4f38-afb4-47ad0b4817d2 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:54:52 devstack sudo[107843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-31ba6dea-8527-4f38-afb4-47ad0b4817d2 Sep 08 06:54:52 devstack sudo[107843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:54:52 devstack sudo[107843]: pam_unix(sudo:session): session closed for user root Sep 08 06:54:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ffffc92d-1f5a-4fc7-b4d6-da6f6b2532ac tempest-VolumesListAdminTestJSON-27452076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-31ba6dea-8527-4f38-afb4-47ad0b4817d2" returned: 0 in 0.436s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:54:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ffffc92d-1f5a-4fc7-b4d6-da6f6b2532ac tempest-VolumesListAdminTestJSON-27452076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-31ba6dea-8527-4f38-afb4-47ad0b4817d2 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:54:52 devstack sudo[107863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-31ba6dea-8527-4f38-afb4-47ad0b4817d2 Sep 08 06:54:52 devstack sudo[107863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:54:52 devstack sudo[107863]: pam_unix(sudo:session): session closed for user root Sep 08 06:54:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ffffc92d-1f5a-4fc7-b4d6-da6f6b2532ac tempest-VolumesListAdminTestJSON-27452076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-31ba6dea-8527-4f38-afb4-47ad0b4817d2" returned: 0 in 0.316s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:54:52 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-ffffc92d-1f5a-4fc7-b4d6-da6f6b2532ac tempest-VolumesListAdminTestJSON-27452076 None] Lock "cinder-quobyte-31ba6dea-8527-4f38-afb4-47ad0b4817d2" released by "delete_volume" :: held 0.805s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:54:53 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-ffffc92d-1f5a-4fc7-b4d6-da6f6b2532ac tempest-VolumesListAdminTestJSON-27452076 None] Created reservations ['242751eb-6795-4095-81b9-e7ef678550a0', '7f1dd4b7-e6f6-4ed4-b448-c1aef7538b42', '2c69d760-1325-4181-8ee9-dabe9122a4d5', '04615047-6e92-4ae0-826b-5659ef8480ec'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:54:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-ffffc92d-1f5a-4fc7-b4d6-da6f6b2532ac tempest-VolumesListAdminTestJSON-27452076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:54:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-ffffc92d-1f5a-4fc7-b4d6-da6f6b2532ac tempest-VolumesListAdminTestJSON-27452076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:54:53 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-ffffc92d-1f5a-4fc7-b4d6-da6f6b2532ac tempest-VolumesListAdminTestJSON-27452076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:54:53 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-ffffc92d-1f5a-4fc7-b4d6-da6f6b2532ac tempest-VolumesListAdminTestJSON-27452076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:54:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-ffffc92d-1f5a-4fc7-b4d6-da6f6b2532ac tempest-VolumesListAdminTestJSON-27452076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:54:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ffffc92d-1f5a-4fc7-b4d6-da6f6b2532ac tempest-VolumesListAdminTestJSON-27452076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:54:53 devstack sudo[107880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:54:53 devstack sudo[107880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:54:53 devstack sudo[107880]: pam_unix(sudo:session): session closed for user root Sep 08 06:54:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ffffc92d-1f5a-4fc7-b4d6-da6f6b2532ac tempest-VolumesListAdminTestJSON-27452076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.370s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:54:53 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-ffffc92d-1f5a-4fc7-b4d6-da6f6b2532ac tempest-VolumesListAdminTestJSON-27452076 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:54:53 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-ffffc92d-1f5a-4fc7-b4d6-da6f6b2532ac tempest-VolumesListAdminTestJSON-27452076 None] Deleted volume successfully. Sep 08 06:54:53 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-ffffc92d-1f5a-4fc7-b4d6-da6f6b2532ac tempest-VolumesListAdminTestJSON-27452076 None] Lock "cinder-31ba6dea-8527-4f38-afb4-47ad0b4817d2-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:55:02 devstack cinder-volume[87507]: DEBUG dbcounter [-] [87507] Writing DB stats cinder:SELECT=90,cinder:INSERT=37,cinder:DELETE=13,cinder:UPDATE=122 {{(pid=87507) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 06:55:02 devstack cinder-volume[87507]: DEBUG dbcounter [-] [87507] Writing DB stats cinder:INSERT=33,cinder:SELECT=84,cinder:UPDATE=134,cinder:DELETE=10 {{(pid=87507) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 06:55:03 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bd22db6-74c6-40a7-af42-9305d5c8d3af tempest-VolumesDeleteCascade-1957490773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:55:03 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9bd22db6-74c6-40a7-af42-9305d5c8d3af tempest-VolumesDeleteCascade-1957490773 None] Flow 'volume_create_manager' (8bc1b374-3bc5-4f60-8cc0-4367c97b0e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:55:03 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9bd22db6-74c6-40a7-af42-9305d5c8d3af tempest-VolumesDeleteCascade-1957490773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fc0f8c4-40ea-4f48-8af1-124f1293c8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:55:03 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9bd22db6-74c6-40a7-af42-9305d5c8d3af tempest-VolumesDeleteCascade-1957490773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fc0f8c4-40ea-4f48-8af1-124f1293c8ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-18832762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51cb8551-abac-4d2e-8371-8e8331ffa2ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='612432fdaf784e5689104d8668565a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:55:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:55:04Z,use_quota=True,user_id='6fc7149505cb472cbc9017d4e7ff403e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:55:03 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9bd22db6-74c6-40a7-af42-9305d5c8d3af tempest-VolumesDeleteCascade-1957490773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d65f7ffa-3f2f-4014-b71c-c5ca6e92da6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:55:03 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9bd22db6-74c6-40a7-af42-9305d5c8d3af tempest-VolumesDeleteCascade-1957490773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d65f7ffa-3f2f-4014-b71c-c5ca6e92da6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:55:03 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9bd22db6-74c6-40a7-af42-9305d5c8d3af tempest-VolumesDeleteCascade-1957490773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bfa07c8-b4ed-4529-8cde-9e2cc40ed30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:55:03 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9bd22db6-74c6-40a7-af42-9305d5c8d3af tempest-VolumesDeleteCascade-1957490773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bfa07c8-b4ed-4529-8cde-9e2cc40ed30a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51cb8551-abac-4d2e-8371-8e8331ffa2ba', 'volume_name': 'volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:55:03 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9bd22db6-74c6-40a7-af42-9305d5c8d3af tempest-VolumesDeleteCascade-1957490773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9d2c328-8fe2-4236-bed6-9c6e0e1580c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:55:04 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9bd22db6-74c6-40a7-af42-9305d5c8d3af tempest-VolumesDeleteCascade-1957490773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9d2c328-8fe2-4236-bed6-9c6e0e1580c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:55:04 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9bd22db6-74c6-40a7-af42-9305d5c8d3af tempest-VolumesDeleteCascade-1957490773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (706b1da0-95ab-4755-a34f-6263ec67ca55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:55:04 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-9bd22db6-74c6-40a7-af42-9305d5c8d3af tempest-VolumesDeleteCascade-1957490773 None] Volume 51cb8551-abac-4d2e-8371-8e8331ffa2ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba', 'volume_size': 1} Sep 08 06:55:04 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-9bd22db6-74c6-40a7-af42-9305d5c8d3af tempest-VolumesDeleteCascade-1957490773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:55:04 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-9bd22db6-74c6-40a7-af42-9305d5c8d3af tempest-VolumesDeleteCascade-1957490773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:55:04 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-9bd22db6-74c6-40a7-af42-9305d5c8d3af tempest-VolumesDeleteCascade-1957490773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-18832762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51cb8551-abac-4d2e-8371-8e8331ffa2ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='612432fdaf784e5689104d8668565a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:55:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:55:04Z,use_quota=True,user_id='6fc7149505cb472cbc9017d4e7ff403e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:55:04 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-9bd22db6-74c6-40a7-af42-9305d5c8d3af tempest-VolumesDeleteCascade-1957490773 None] Creating volume 51cb8551-abac-4d2e-8371-8e8331ffa2ba {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:55:04 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-9bd22db6-74c6-40a7-af42-9305d5c8d3af tempest-VolumesDeleteCascade-1957490773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:55:04 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-9bd22db6-74c6-40a7-af42-9305d5c8d3af tempest-VolumesDeleteCascade-1957490773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:55:04 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-9bd22db6-74c6-40a7-af42-9305d5c8d3af tempest-VolumesDeleteCascade-1957490773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:55:04 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-9bd22db6-74c6-40a7-af42-9305d5c8d3af tempest-VolumesDeleteCascade-1957490773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:55:04 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-9bd22db6-74c6-40a7-af42-9305d5c8d3af tempest-VolumesDeleteCascade-1957490773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:55:04 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-9bd22db6-74c6-40a7-af42-9305d5c8d3af tempest-VolumesDeleteCascade-1957490773 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:55:04 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-9bd22db6-74c6-40a7-af42-9305d5c8d3af tempest-VolumesDeleteCascade-1957490773 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:55:04 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9bd22db6-74c6-40a7-af42-9305d5c8d3af tempest-VolumesDeleteCascade-1957490773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:04 devstack sudo[108230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba 1073741824 Sep 08 06:55:04 devstack sudo[108230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:04 devstack sudo[108230]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:04 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9bd22db6-74c6-40a7-af42-9305d5c8d3af tempest-VolumesDeleteCascade-1957490773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba 1073741824" returned: 0 in 0.484s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:04 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9bd22db6-74c6-40a7-af42-9305d5c8d3af tempest-VolumesDeleteCascade-1957490773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:04 devstack sudo[108255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba Sep 08 06:55:04 devstack sudo[108255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:04 devstack sudo[108255]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:04 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9bd22db6-74c6-40a7-af42-9305d5c8d3af tempest-VolumesDeleteCascade-1957490773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba" returned: 0 in 0.272s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:04 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-9bd22db6-74c6-40a7-af42-9305d5c8d3af tempest-VolumesDeleteCascade-1957490773 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:55:04 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-9bd22db6-74c6-40a7-af42-9305d5c8d3af tempest-VolumesDeleteCascade-1957490773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:55:04 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9bd22db6-74c6-40a7-af42-9305d5c8d3af tempest-VolumesDeleteCascade-1957490773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (706b1da0-95ab-4755-a34f-6263ec67ca55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:55:04 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9bd22db6-74c6-40a7-af42-9305d5c8d3af tempest-VolumesDeleteCascade-1957490773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d48db84-e814-45a7-96ad-2e5c14dd4afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:55:04 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-9bd22db6-74c6-40a7-af42-9305d5c8d3af tempest-VolumesDeleteCascade-1957490773 None] Volume volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba (51cb8551-abac-4d2e-8371-8e8331ffa2ba): created successfully Sep 08 06:55:04 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9bd22db6-74c6-40a7-af42-9305d5c8d3af tempest-VolumesDeleteCascade-1957490773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d48db84-e814-45a7-96ad-2e5c14dd4afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:55:04 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9bd22db6-74c6-40a7-af42-9305d5c8d3af tempest-VolumesDeleteCascade-1957490773 None] Flow 'volume_create_manager' (8bc1b374-3bc5-4f60-8cc0-4367c97b0e42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:55:04 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-9bd22db6-74c6-40a7-af42-9305d5c8d3af tempest-VolumesDeleteCascade-1957490773 None] Created volume successfully. Sep 08 06:55:06 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-075bf77e-8417-450f-b0ec-ce334b79742d req-183e8a12-d33a-4c10-a463-cb763ddab295 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:55:06 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-075bf77e-8417-450f-b0ec-ce334b79742d req-183e8a12-d33a-4c10-a463-cb763ddab295 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:55:06 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-075bf77e-8417-450f-b0ec-ce334b79742d req-183e8a12-d33a-4c10-a463-cb763ddab295 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:55:06 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-075bf77e-8417-450f-b0ec-ce334b79742d req-183e8a12-d33a-4c10-a463-cb763ddab295 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d', 'name': 'volume-599ec05a-ee64-427f-966a-3984ac95d6f5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b91dc20b-2539-4add-baac-2d642422ea5a', 'enforce_multipath': True} {{(pid=87507) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 06:55:06 devstack cinder-volume[87507]: INFO cinder.volume.manager [req-075bf77e-8417-450f-b0ec-ce334b79742d req-183e8a12-d33a-4c10-a463-cb763ddab295 tempest-TestServerVolumeAttachmentScenario-1142016208 None] attachment_update completed successfully. Sep 08 06:55:06 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-834efbd1-a7d1-44a1-8865-7d48ba8dbc23 tempest-VolumesDeleteCascade-1957490773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:55:06 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-834efbd1-a7d1-44a1-8865-7d48ba8dbc23 tempest-VolumesDeleteCascade-1957490773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:55:06 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-834efbd1-a7d1-44a1-8865-7d48ba8dbc23 tempest-VolumesDeleteCascade-1957490773 None] Creating offline snapshot 42a4e59c-f646-4ae6-9596-bbb551e1ddcd of volume 51cb8551-abac-4d2e-8371-8e8331ffa2ba {{(pid=87507) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 06:55:06 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f25188-c339-44b8-ba71-007a15340221]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:55:06 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-834efbd1-a7d1-44a1-8865-7d48ba8dbc23 tempest-VolumesDeleteCascade-1957490773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:06 devstack sudo[108324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba Sep 08 06:55:06 devstack sudo[108324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:06 devstack sudo[108324]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:06 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-834efbd1-a7d1-44a1-8865-7d48ba8dbc23 tempest-VolumesDeleteCascade-1957490773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba" returned: 0 in 0.616s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:06 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-834efbd1-a7d1-44a1-8865-7d48ba8dbc23 tempest-VolumesDeleteCascade-1957490773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba.42a4e59c-f646-4ae6-9596-bbb551e1ddcd 1G {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:06 devstack sudo[108909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba.42a4e59c-f646-4ae6-9596-bbb551e1ddcd 1G Sep 08 06:55:06 devstack sudo[108909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:07 devstack sudo[108909]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-834efbd1-a7d1-44a1-8865-7d48ba8dbc23 tempest-VolumesDeleteCascade-1957490773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba.42a4e59c-f646-4ae6-9596-bbb551e1ddcd 1G" returned: 0 in 0.709s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-834efbd1-a7d1-44a1-8865-7d48ba8dbc23 tempest-VolumesDeleteCascade-1957490773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba.42a4e59c-f646-4ae6-9596-bbb551e1ddcd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:07 devstack sudo[109100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba.42a4e59c-f646-4ae6-9596-bbb551e1ddcd Sep 08 06:55:07 devstack sudo[109100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:08 devstack sudo[109100]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:08 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-834efbd1-a7d1-44a1-8865-7d48ba8dbc23 tempest-VolumesDeleteCascade-1957490773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba.42a4e59c-f646-4ae6-9596-bbb551e1ddcd" returned: 0 in 0.416s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:08 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-834efbd1-a7d1-44a1-8865-7d48ba8dbc23 tempest-VolumesDeleteCascade-1957490773 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba.42a4e59c-f646-4ae6-9596-bbb551e1ddcd is being set with open permissions: ugo+rw Sep 08 06:55:08 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-834efbd1-a7d1-44a1-8865-7d48ba8dbc23 tempest-VolumesDeleteCascade-1957490773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba.42a4e59c-f646-4ae6-9596-bbb551e1ddcd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:08 devstack sudo[109119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba.42a4e59c-f646-4ae6-9596-bbb551e1ddcd Sep 08 06:55:08 devstack sudo[109119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:08 devstack sudo[109119]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:08 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-834efbd1-a7d1-44a1-8865-7d48ba8dbc23 tempest-VolumesDeleteCascade-1957490773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba.42a4e59c-f646-4ae6-9596-bbb551e1ddcd" returned: 0 in 0.290s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:08 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-834efbd1-a7d1-44a1-8865-7d48ba8dbc23 tempest-VolumesDeleteCascade-1957490773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:08 devstack sudo[109134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba.info Sep 08 06:55:08 devstack sudo[109134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:08 devstack sudo[109134]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:08 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-834efbd1-a7d1-44a1-8865-7d48ba8dbc23 tempest-VolumesDeleteCascade-1957490773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba.info" returned: 0 in 0.267s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:08 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-834efbd1-a7d1-44a1-8865-7d48ba8dbc23 tempest-VolumesDeleteCascade-1957490773 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba.info is being set with open permissions: ugo+rw Sep 08 06:55:08 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-834efbd1-a7d1-44a1-8865-7d48ba8dbc23 tempest-VolumesDeleteCascade-1957490773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:08 devstack sudo[109143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba.info Sep 08 06:55:08 devstack sudo[109143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:08 devstack sudo[109143]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:08 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-834efbd1-a7d1-44a1-8865-7d48ba8dbc23 tempest-VolumesDeleteCascade-1957490773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba.info" returned: 0 in 0.287s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:08 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-834efbd1-a7d1-44a1-8865-7d48ba8dbc23 tempest-VolumesDeleteCascade-1957490773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.711s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:55:09 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-834efbd1-a7d1-44a1-8865-7d48ba8dbc23 tempest-VolumesDeleteCascade-1957490773 None] Create snapshot completed successfully Sep 08 06:55:09 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4f95a7a7-5a7d-4ebc-b9f9-2580d2ff7477 tempest-VolumesDeleteCascade-1957490773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:55:09 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4f95a7a7-5a7d-4ebc-b9f9-2580d2ff7477 tempest-VolumesDeleteCascade-1957490773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:55:09 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-4f95a7a7-5a7d-4ebc-b9f9-2580d2ff7477 tempest-VolumesDeleteCascade-1957490773 None] Creating offline snapshot 31e924c9-0297-4183-a903-e8ed00895614 of volume 51cb8551-abac-4d2e-8371-8e8331ffa2ba {{(pid=87507) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 06:55:09 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc4ef7e-3b26-4eae-a7b0-f0c5a6863333]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:55:09 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4f95a7a7-5a7d-4ebc-b9f9-2580d2ff7477 tempest-VolumesDeleteCascade-1957490773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba.42a4e59c-f646-4ae6-9596-bbb551e1ddcd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:10 devstack sudo[109200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba.42a4e59c-f646-4ae6-9596-bbb551e1ddcd Sep 08 06:55:10 devstack sudo[109200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:10 devstack sudo[109200]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:10 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4f95a7a7-5a7d-4ebc-b9f9-2580d2ff7477 tempest-VolumesDeleteCascade-1957490773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba.42a4e59c-f646-4ae6-9596-bbb551e1ddcd" returned: 0 in 0.821s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:10 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-4f95a7a7-5a7d-4ebc-b9f9-2580d2ff7477 tempest-VolumesDeleteCascade-1957490773 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 06:55:10 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4f95a7a7-5a7d-4ebc-b9f9-2580d2ff7477 tempest-VolumesDeleteCascade-1957490773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba.42a4e59c-f646-4ae6-9596-bbb551e1ddcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba.31e924c9-0297-4183-a903-e8ed00895614 1G {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:10 devstack sudo[109359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba.42a4e59c-f646-4ae6-9596-bbb551e1ddcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba.31e924c9-0297-4183-a903-e8ed00895614 1G Sep 08 06:55:10 devstack sudo[109359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:11 devstack sudo[109359]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4f95a7a7-5a7d-4ebc-b9f9-2580d2ff7477 tempest-VolumesDeleteCascade-1957490773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba.42a4e59c-f646-4ae6-9596-bbb551e1ddcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba.31e924c9-0297-4183-a903-e8ed00895614 1G" returned: 0 in 0.707s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4f95a7a7-5a7d-4ebc-b9f9-2580d2ff7477 tempest-VolumesDeleteCascade-1957490773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba.42a4e59c-f646-4ae6-9596-bbb551e1ddcd -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba.31e924c9-0297-4183-a903-e8ed00895614 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:11 devstack sudo[109396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba.42a4e59c-f646-4ae6-9596-bbb551e1ddcd -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba.31e924c9-0297-4183-a903-e8ed00895614 Sep 08 06:55:11 devstack sudo[109396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:11 devstack sudo[109396]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4f95a7a7-5a7d-4ebc-b9f9-2580d2ff7477 tempest-VolumesDeleteCascade-1957490773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba.42a4e59c-f646-4ae6-9596-bbb551e1ddcd -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba.31e924c9-0297-4183-a903-e8ed00895614" returned: 0 in 0.428s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:11 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-4f95a7a7-5a7d-4ebc-b9f9-2580d2ff7477 tempest-VolumesDeleteCascade-1957490773 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba.31e924c9-0297-4183-a903-e8ed00895614 is being set with open permissions: ugo+rw Sep 08 06:55:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4f95a7a7-5a7d-4ebc-b9f9-2580d2ff7477 tempest-VolumesDeleteCascade-1957490773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba.31e924c9-0297-4183-a903-e8ed00895614 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:11 devstack sudo[109418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba.31e924c9-0297-4183-a903-e8ed00895614 Sep 08 06:55:11 devstack sudo[109418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:12 devstack sudo[109418]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:12 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4f95a7a7-5a7d-4ebc-b9f9-2580d2ff7477 tempest-VolumesDeleteCascade-1957490773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba.31e924c9-0297-4183-a903-e8ed00895614" returned: 0 in 0.462s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:12 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4f95a7a7-5a7d-4ebc-b9f9-2580d2ff7477 tempest-VolumesDeleteCascade-1957490773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.647s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:55:12 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-4f95a7a7-5a7d-4ebc-b9f9-2580d2ff7477 tempest-VolumesDeleteCascade-1957490773 None] Create snapshot completed successfully Sep 08 06:55:12 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-181d331e-2ca2-4c97-8b4c-3ec86c0473b3 req-ad185400-016e-4294-8a04-083cd7a55d64 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:55:12 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-181d331e-2ca2-4c97-8b4c-3ec86c0473b3 req-ad185400-016e-4294-8a04-083cd7a55d64 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:55:12 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-181d331e-2ca2-4c97-8b4c-3ec86c0473b3 req-ad185400-016e-4294-8a04-083cd7a55d64 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:55:12 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-181d331e-2ca2-4c97-8b4c-3ec86c0473b3 req-ad185400-016e-4294-8a04-083cd7a55d64 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d', 'name': 'volume-7b583bbb-b149-44b8-a4c3-c015ae9c2b35', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7c20c1bb-be60-469e-85c8-1826474c0481', 'enforce_multipath': True} {{(pid=87507) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 06:55:12 devstack cinder-volume[87507]: INFO cinder.volume.manager [req-181d331e-2ca2-4c97-8b4c-3ec86c0473b3 req-ad185400-016e-4294-8a04-083cd7a55d64 tempest-TestServerVolumeAttachmentScenario-1142016208 None] attachment_update completed successfully. Sep 08 06:55:13 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-61f5d171-4fa7-4928-b693-716b969dede3 tempest-VolumesDeleteCascade-1957490773 None] Acquiring lock "cinder-51cb8551-abac-4d2e-8371-8e8331ffa2ba-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:55:13 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-61f5d171-4fa7-4928-b693-716b969dede3 tempest-VolumesDeleteCascade-1957490773 None] Lock "cinder-51cb8551-abac-4d2e-8371-8e8331ffa2ba-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:55:13 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-61f5d171-4fa7-4928-b693-716b969dede3 tempest-VolumesDeleteCascade-1957490773 None] Performing cascade delete. {{(pid=87507) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 08 06:55:13 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-61f5d171-4fa7-4928-b693-716b969dede3 tempest-VolumesDeleteCascade-1957490773 None] Acquiring lock "cinder-31e924c9-0297-4183-a903-e8ed00895614-delete_snapshot" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:55:13 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-61f5d171-4fa7-4928-b693-716b969dede3 tempest-VolumesDeleteCascade-1957490773 None] Lock "cinder-31e924c9-0297-4183-a903-e8ed00895614-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:55:13 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-61f5d171-4fa7-4928-b693-716b969dede3 tempest-VolumesDeleteCascade-1957490773 None] Acquiring lock "cinder-quobyte-51cb8551-abac-4d2e-8371-8e8331ffa2ba" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:55:13 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-61f5d171-4fa7-4928-b693-716b969dede3 tempest-VolumesDeleteCascade-1957490773 None] Lock "cinder-quobyte-51cb8551-abac-4d2e-8371-8e8331ffa2ba" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:55:13 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-61f5d171-4fa7-4928-b693-716b969dede3 tempest-VolumesDeleteCascade-1957490773 None] Acquiring lock "cinder-quobyte-31e924c9-0297-4183-a903-e8ed00895614" by "_delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:55:13 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-61f5d171-4fa7-4928-b693-716b969dede3 tempest-VolumesDeleteCascade-1957490773 None] Lock "cinder-quobyte-31e924c9-0297-4183-a903-e8ed00895614" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:55:13 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-61f5d171-4fa7-4928-b693-716b969dede3 tempest-VolumesDeleteCascade-1957490773 None] Deleting offline snapshot 31e924c9-0297-4183-a903-e8ed00895614 of volume 51cb8551-abac-4d2e-8371-8e8331ffa2ba {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 06:55:13 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-61f5d171-4fa7-4928-b693-716b969dede3 tempest-VolumesDeleteCascade-1957490773 None] snapshot_file for this snap is: volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba.31e924c9-0297-4183-a903-e8ed00895614 {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 06:55:13 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[848908c4-5fd5-4add-98aa-1a4a3351aec1]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:55:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-61f5d171-4fa7-4928-b693-716b969dede3 tempest-VolumesDeleteCascade-1957490773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba.31e924c9-0297-4183-a903-e8ed00895614 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:13 devstack sudo[109474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba.31e924c9-0297-4183-a903-e8ed00895614 Sep 08 06:55:13 devstack sudo[109474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:14 devstack sudo[109474]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-61f5d171-4fa7-4928-b693-716b969dede3 tempest-VolumesDeleteCascade-1957490773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba.31e924c9-0297-4183-a903-e8ed00895614" returned: 0 in 0.735s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:14 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-61f5d171-4fa7-4928-b693-716b969dede3 tempest-VolumesDeleteCascade-1957490773 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 06:55:14 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d10db0d2-b65e-45a5-88ae-cb4799744ee4]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:55:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-61f5d171-4fa7-4928-b693-716b969dede3 tempest-VolumesDeleteCascade-1957490773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba.42a4e59c-f646-4ae6-9596-bbb551e1ddcd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:14 devstack sudo[109511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba.42a4e59c-f646-4ae6-9596-bbb551e1ddcd Sep 08 06:55:14 devstack sudo[109511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:14 devstack sudo[109511]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-61f5d171-4fa7-4928-b693-716b969dede3 tempest-VolumesDeleteCascade-1957490773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba.42a4e59c-f646-4ae6-9596-bbb551e1ddcd" returned: 0 in 0.615s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:14 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-61f5d171-4fa7-4928-b693-716b969dede3 tempest-VolumesDeleteCascade-1957490773 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 06:55:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-61f5d171-4fa7-4928-b693-716b969dede3 tempest-VolumesDeleteCascade-1957490773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba.31e924c9-0297-4183-a903-e8ed00895614 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:14 devstack sudo[109541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba.31e924c9-0297-4183-a903-e8ed00895614 Sep 08 06:55:14 devstack sudo[109541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:15 devstack sudo[109541]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-61f5d171-4fa7-4928-b693-716b969dede3 tempest-VolumesDeleteCascade-1957490773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba.31e924c9-0297-4183-a903-e8ed00895614" returned: 0 in 0.755s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-61f5d171-4fa7-4928-b693-716b969dede3 tempest-VolumesDeleteCascade-1957490773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba.31e924c9-0297-4183-a903-e8ed00895614 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:15 devstack sudo[109571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba.31e924c9-0297-4183-a903-e8ed00895614 Sep 08 06:55:15 devstack sudo[109571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:15 devstack sudo[109571]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-61f5d171-4fa7-4928-b693-716b969dede3 tempest-VolumesDeleteCascade-1957490773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba.31e924c9-0297-4183-a903-e8ed00895614" returned: 0 in 0.356s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:15 devstack cinder-volume[87507]: INFO cinder.volume.manager [req-a081f6cc-9ccf-4166-8d31-94905b5dfc26 req-b4e8b42c-e95f-465b-a4f4-fb3a6d3d86bd tempest-TestServerVolumeAttachmentScenario-1142016208 None] Terminate volume connection completed successfully. Sep 08 06:55:15 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-a081f6cc-9ccf-4166-8d31-94905b5dfc26 req-b4e8b42c-e95f-465b-a4f4-fb3a6d3d86bd tempest-TestServerVolumeAttachmentScenario-1142016208 None] Deleting attachment 7c20c1bb-be60-469e-85c8-1826474c0481. {{(pid=87507) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 06:55:15 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-61f5d171-4fa7-4928-b693-716b969dede3 tempest-VolumesDeleteCascade-1957490773 None] Lock "cinder-quobyte-31e924c9-0297-4183-a903-e8ed00895614" released by "_delete_snapshot" :: held 2.620s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:55:15 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-61f5d171-4fa7-4928-b693-716b969dede3 tempest-VolumesDeleteCascade-1957490773 None] Lock "cinder-quobyte-51cb8551-abac-4d2e-8371-8e8331ffa2ba" released by "delete_snapshot" :: held 2.654s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:55:15 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-61f5d171-4fa7-4928-b693-716b969dede3 tempest-VolumesDeleteCascade-1957490773 None] Created reservations ['2c6751fa-8363-4e1c-9a80-a80177cf7946', '8c494b15-d6f7-4d89-8bac-52d80e8324aa', 'a7920a29-09ec-4fc9-b359-da43703d8e31', 'd5d49069-0ce3-4f8e-91e7-2553d1cce7d6'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:55:16 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-61f5d171-4fa7-4928-b693-716b969dede3 tempest-VolumesDeleteCascade-1957490773 None] Delete snapshot completed successfully. Sep 08 06:55:16 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-61f5d171-4fa7-4928-b693-716b969dede3 tempest-VolumesDeleteCascade-1957490773 None] Lock "cinder-31e924c9-0297-4183-a903-e8ed00895614-delete_snapshot" released by "delete_snapshot" :: held 2.886s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:55:16 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-61f5d171-4fa7-4928-b693-716b969dede3 tempest-VolumesDeleteCascade-1957490773 None] Acquiring lock "cinder-42a4e59c-f646-4ae6-9596-bbb551e1ddcd-delete_snapshot" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:55:16 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-61f5d171-4fa7-4928-b693-716b969dede3 tempest-VolumesDeleteCascade-1957490773 None] Lock "cinder-42a4e59c-f646-4ae6-9596-bbb551e1ddcd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:55:16 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-61f5d171-4fa7-4928-b693-716b969dede3 tempest-VolumesDeleteCascade-1957490773 None] Acquiring lock "cinder-quobyte-51cb8551-abac-4d2e-8371-8e8331ffa2ba" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:55:16 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-61f5d171-4fa7-4928-b693-716b969dede3 tempest-VolumesDeleteCascade-1957490773 None] Lock "cinder-quobyte-51cb8551-abac-4d2e-8371-8e8331ffa2ba" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:55:16 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-61f5d171-4fa7-4928-b693-716b969dede3 tempest-VolumesDeleteCascade-1957490773 None] Acquiring lock "cinder-quobyte-42a4e59c-f646-4ae6-9596-bbb551e1ddcd" by "_delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:55:16 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-61f5d171-4fa7-4928-b693-716b969dede3 tempest-VolumesDeleteCascade-1957490773 None] Lock "cinder-quobyte-42a4e59c-f646-4ae6-9596-bbb551e1ddcd" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:55:16 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-61f5d171-4fa7-4928-b693-716b969dede3 tempest-VolumesDeleteCascade-1957490773 None] Deleting offline snapshot 42a4e59c-f646-4ae6-9596-bbb551e1ddcd of volume 51cb8551-abac-4d2e-8371-8e8331ffa2ba {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 06:55:16 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-61f5d171-4fa7-4928-b693-716b969dede3 tempest-VolumesDeleteCascade-1957490773 None] snapshot_file for this snap is: volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba.42a4e59c-f646-4ae6-9596-bbb551e1ddcd {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 06:55:16 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc42eca2-2763-4338-b58d-6bbd0d1d3a23]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:55:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-61f5d171-4fa7-4928-b693-716b969dede3 tempest-VolumesDeleteCascade-1957490773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba.42a4e59c-f646-4ae6-9596-bbb551e1ddcd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:16 devstack sudo[109599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba.42a4e59c-f646-4ae6-9596-bbb551e1ddcd Sep 08 06:55:16 devstack sudo[109599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:16 devstack sudo[109599]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-61f5d171-4fa7-4928-b693-716b969dede3 tempest-VolumesDeleteCascade-1957490773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba.42a4e59c-f646-4ae6-9596-bbb551e1ddcd" returned: 0 in 0.410s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:16 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-61f5d171-4fa7-4928-b693-716b969dede3 tempest-VolumesDeleteCascade-1957490773 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 06:55:16 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0539e26-88f2-4b94-8560-d72735f83675]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:55:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-61f5d171-4fa7-4928-b693-716b969dede3 tempest-VolumesDeleteCascade-1957490773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:16 devstack sudo[109617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba Sep 08 06:55:16 devstack sudo[109617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:17 devstack sudo[109617]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-61f5d171-4fa7-4928-b693-716b969dede3 tempest-VolumesDeleteCascade-1957490773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba" returned: 0 in 0.447s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-61f5d171-4fa7-4928-b693-716b969dede3 tempest-VolumesDeleteCascade-1957490773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba.42a4e59c-f646-4ae6-9596-bbb551e1ddcd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:17 devstack sudo[109638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba.42a4e59c-f646-4ae6-9596-bbb551e1ddcd Sep 08 06:55:17 devstack sudo[109638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:17 devstack cinder-volume[87507]: INFO cinder.volume.manager [req-d2109404-548f-4cd0-bb1a-521ba1ceb9b3 req-1d5324cb-38c3-48b0-91e5-1c677eff7bac tempest-TestServerVolumeAttachmentScenario-1142016208 None] Terminate volume connection completed successfully. Sep 08 06:55:17 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-d2109404-548f-4cd0-bb1a-521ba1ceb9b3 req-1d5324cb-38c3-48b0-91e5-1c677eff7bac tempest-TestServerVolumeAttachmentScenario-1142016208 None] Deleting attachment b91dc20b-2539-4add-baac-2d642422ea5a. {{(pid=87507) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 06:55:17 devstack sudo[109638]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-61f5d171-4fa7-4928-b693-716b969dede3 tempest-VolumesDeleteCascade-1957490773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba.42a4e59c-f646-4ae6-9596-bbb551e1ddcd" returned: 0 in 0.415s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-61f5d171-4fa7-4928-b693-716b969dede3 tempest-VolumesDeleteCascade-1957490773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba.42a4e59c-f646-4ae6-9596-bbb551e1ddcd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:17 devstack sudo[109682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba.42a4e59c-f646-4ae6-9596-bbb551e1ddcd Sep 08 06:55:17 devstack sudo[109682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:17 devstack sudo[109682]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-61f5d171-4fa7-4928-b693-716b969dede3 tempest-VolumesDeleteCascade-1957490773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba.42a4e59c-f646-4ae6-9596-bbb551e1ddcd" returned: 0 in 0.291s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:17 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-61f5d171-4fa7-4928-b693-716b969dede3 tempest-VolumesDeleteCascade-1957490773 None] Lock "cinder-quobyte-42a4e59c-f646-4ae6-9596-bbb551e1ddcd" released by "_delete_snapshot" :: held 1.682s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:55:17 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-61f5d171-4fa7-4928-b693-716b969dede3 tempest-VolumesDeleteCascade-1957490773 None] Lock "cinder-quobyte-51cb8551-abac-4d2e-8371-8e8331ffa2ba" released by "delete_snapshot" :: held 1.712s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:55:17 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-61f5d171-4fa7-4928-b693-716b969dede3 tempest-VolumesDeleteCascade-1957490773 None] Created reservations ['37e17337-f1fb-4902-837d-4421131d7b6d', '4549cb43-4729-435b-9827-06b251d6e5f4', '3b0bd243-3210-411a-ac32-a1c2feffa056', 'c942a6a3-f73d-474b-8cc1-a739814c8c41'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:55:17 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-61f5d171-4fa7-4928-b693-716b969dede3 tempest-VolumesDeleteCascade-1957490773 None] Delete snapshot completed successfully. Sep 08 06:55:17 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-61f5d171-4fa7-4928-b693-716b969dede3 tempest-VolumesDeleteCascade-1957490773 None] Lock "cinder-42a4e59c-f646-4ae6-9596-bbb551e1ddcd-delete_snapshot" released by "delete_snapshot" :: held 1.875s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:55:17 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-61f5d171-4fa7-4928-b693-716b969dede3 tempest-VolumesDeleteCascade-1957490773 None] Snapshots deleted, issuing volume delete {{(pid=87507) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 08 06:55:17 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-61f5d171-4fa7-4928-b693-716b969dede3 tempest-VolumesDeleteCascade-1957490773 None] Acquiring lock "cinder-quobyte-51cb8551-abac-4d2e-8371-8e8331ffa2ba" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:55:17 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-61f5d171-4fa7-4928-b693-716b969dede3 tempest-VolumesDeleteCascade-1957490773 None] Lock "cinder-quobyte-51cb8551-abac-4d2e-8371-8e8331ffa2ba" acquired by "delete_volume" :: waited 0.020s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:55:18 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8453b26-3553-45c7-96c2-0cfaeca79868]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:55:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-61f5d171-4fa7-4928-b693-716b969dede3 tempest-VolumesDeleteCascade-1957490773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:18 devstack sudo[109700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba Sep 08 06:55:18 devstack sudo[109700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:18 devstack sudo[109700]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-61f5d171-4fa7-4928-b693-716b969dede3 tempest-VolumesDeleteCascade-1957490773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba" returned: 0 in 0.494s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-61f5d171-4fa7-4928-b693-716b969dede3 tempest-VolumesDeleteCascade-1957490773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:18 devstack sudo[109721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba Sep 08 06:55:18 devstack sudo[109721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:18 devstack sudo[109721]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-61f5d171-4fa7-4928-b693-716b969dede3 tempest-VolumesDeleteCascade-1957490773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-51cb8551-abac-4d2e-8371-8e8331ffa2ba" returned: 0 in 0.421s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:19 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-61f5d171-4fa7-4928-b693-716b969dede3 tempest-VolumesDeleteCascade-1957490773 None] Lock "cinder-quobyte-51cb8551-abac-4d2e-8371-8e8331ffa2ba" released by "delete_volume" :: held 1.008s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:55:19 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-61f5d171-4fa7-4928-b693-716b969dede3 tempest-VolumesDeleteCascade-1957490773 None] Created reservations ['f3103e1b-38a4-48bd-bf9a-38935db94e1c', '8e46e1ae-45cc-4a45-a9f7-0d329b5c3d5b', '9c2596f7-939a-4fb4-b135-929a76ebcf45', 'f0e509aa-0697-46ca-b873-b0be1da5fd69'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:55:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-61f5d171-4fa7-4928-b693-716b969dede3 tempest-VolumesDeleteCascade-1957490773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:55:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-61f5d171-4fa7-4928-b693-716b969dede3 tempest-VolumesDeleteCascade-1957490773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:55:19 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-61f5d171-4fa7-4928-b693-716b969dede3 tempest-VolumesDeleteCascade-1957490773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:55:19 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-61f5d171-4fa7-4928-b693-716b969dede3 tempest-VolumesDeleteCascade-1957490773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:55:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-61f5d171-4fa7-4928-b693-716b969dede3 tempest-VolumesDeleteCascade-1957490773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:55:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-61f5d171-4fa7-4928-b693-716b969dede3 tempest-VolumesDeleteCascade-1957490773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:19 devstack sudo[109759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:55:19 devstack sudo[109759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:19 devstack sudo[109759]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-61f5d171-4fa7-4928-b693-716b969dede3 tempest-VolumesDeleteCascade-1957490773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.271s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:19 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-61f5d171-4fa7-4928-b693-716b969dede3 tempest-VolumesDeleteCascade-1957490773 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:55:19 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-61f5d171-4fa7-4928-b693-716b969dede3 tempest-VolumesDeleteCascade-1957490773 None] Deleted volume successfully. Sep 08 06:55:19 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-61f5d171-4fa7-4928-b693-716b969dede3 tempest-VolumesDeleteCascade-1957490773 None] Lock "cinder-51cb8551-abac-4d2e-8371-8e8331ffa2ba-delete_volume" released by "delete_volume" :: held 6.493s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:55:20 devstack cinder-volume[87507]: DEBUG oslo_service.periodic_task [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87507) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 06:55:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:55:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:55:20 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:55:20 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:55:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:55:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:20 devstack sudo[109788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:55:20 devstack sudo[109788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:20 devstack sudo[109788]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.466s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:20 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:55:20 devstack cinder-volume[87507]: DEBUG oslo_service.periodic_task [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Running periodic task VolumeManager._thread_info {{(pid=87507) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 06:55:20 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] thread count: 29 {{(pid=87507) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 06:55:20 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] thread info: [<_MainThread(MainThread, started 127913129345152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87507) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 06:55:20 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-5432f483-2e62-49c6-8e65-401a5a42d971 tempest-VolumesDeleteCascade-1957490773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:55:20 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5432f483-2e62-49c6-8e65-401a5a42d971 tempest-VolumesDeleteCascade-1957490773 None] Flow 'volume_create_manager' (1eee85c6-fea8-4891-83df-73cef841b597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:55:20 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5432f483-2e62-49c6-8e65-401a5a42d971 tempest-VolumesDeleteCascade-1957490773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59e119fe-5f4c-4b3e-89f9-1ac240497c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:55:20 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5432f483-2e62-49c6-8e65-401a5a42d971 tempest-VolumesDeleteCascade-1957490773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59e119fe-5f4c-4b3e-89f9-1ac240497c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:55:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1682705358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b75474b0-4a4b-49c4-a761-1d452202e036,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='612432fdaf784e5689104d8668565a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:55:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:55:21Z,use_quota=True,user_id='6fc7149505cb472cbc9017d4e7ff403e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:55:20 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5432f483-2e62-49c6-8e65-401a5a42d971 tempest-VolumesDeleteCascade-1957490773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2354a421-809a-4e1c-8971-b3f7a38686b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:55:20 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5432f483-2e62-49c6-8e65-401a5a42d971 tempest-VolumesDeleteCascade-1957490773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2354a421-809a-4e1c-8971-b3f7a38686b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:55:20 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5432f483-2e62-49c6-8e65-401a5a42d971 tempest-VolumesDeleteCascade-1957490773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a31c9453-b7ba-43f0-8a87-b1c6018d6cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:55:20 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5432f483-2e62-49c6-8e65-401a5a42d971 tempest-VolumesDeleteCascade-1957490773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a31c9453-b7ba-43f0-8a87-b1c6018d6cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b75474b0-4a4b-49c4-a761-1d452202e036', 'volume_name': 'volume-b75474b0-4a4b-49c4-a761-1d452202e036', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:55:20 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5432f483-2e62-49c6-8e65-401a5a42d971 tempest-VolumesDeleteCascade-1957490773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (103b6fc6-4a0f-47fe-b224-88181bf810cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:55:20 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5432f483-2e62-49c6-8e65-401a5a42d971 tempest-VolumesDeleteCascade-1957490773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (103b6fc6-4a0f-47fe-b224-88181bf810cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:55:20 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5432f483-2e62-49c6-8e65-401a5a42d971 tempest-VolumesDeleteCascade-1957490773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cae6ccd-1c30-417f-a67a-ecd1bf39e91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:55:20 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-5432f483-2e62-49c6-8e65-401a5a42d971 tempest-VolumesDeleteCascade-1957490773 None] Volume b75474b0-4a4b-49c4-a761-1d452202e036: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b75474b0-4a4b-49c4-a761-1d452202e036', 'volume_size': 1} Sep 08 06:55:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-5432f483-2e62-49c6-8e65-401a5a42d971 tempest-VolumesDeleteCascade-1957490773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:55:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-5432f483-2e62-49c6-8e65-401a5a42d971 tempest-VolumesDeleteCascade-1957490773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:55:20 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-5432f483-2e62-49c6-8e65-401a5a42d971 tempest-VolumesDeleteCascade-1957490773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:55:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1682705358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b75474b0-4a4b-49c4-a761-1d452202e036,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='612432fdaf784e5689104d8668565a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:55:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:55:21Z,use_quota=True,user_id='6fc7149505cb472cbc9017d4e7ff403e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:55:20 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-5432f483-2e62-49c6-8e65-401a5a42d971 tempest-VolumesDeleteCascade-1957490773 None] Creating volume b75474b0-4a4b-49c4-a761-1d452202e036 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:55:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-5432f483-2e62-49c6-8e65-401a5a42d971 tempest-VolumesDeleteCascade-1957490773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:55:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-5432f483-2e62-49c6-8e65-401a5a42d971 tempest-VolumesDeleteCascade-1957490773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:55:20 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-5432f483-2e62-49c6-8e65-401a5a42d971 tempest-VolumesDeleteCascade-1957490773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:55:20 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-5432f483-2e62-49c6-8e65-401a5a42d971 tempest-VolumesDeleteCascade-1957490773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:55:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-5432f483-2e62-49c6-8e65-401a5a42d971 tempest-VolumesDeleteCascade-1957490773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:55:20 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-5432f483-2e62-49c6-8e65-401a5a42d971 tempest-VolumesDeleteCascade-1957490773 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:55:20 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-5432f483-2e62-49c6-8e65-401a5a42d971 tempest-VolumesDeleteCascade-1957490773 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:55:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5432f483-2e62-49c6-8e65-401a5a42d971 tempest-VolumesDeleteCascade-1957490773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b75474b0-4a4b-49c4-a761-1d452202e036 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:20 devstack sudo[109817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b75474b0-4a4b-49c4-a761-1d452202e036 1073741824 Sep 08 06:55:20 devstack sudo[109817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:21 devstack sudo[109817]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:21 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5432f483-2e62-49c6-8e65-401a5a42d971 tempest-VolumesDeleteCascade-1957490773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b75474b0-4a4b-49c4-a761-1d452202e036 1073741824" returned: 0 in 0.566s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:21 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5432f483-2e62-49c6-8e65-401a5a42d971 tempest-VolumesDeleteCascade-1957490773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b75474b0-4a4b-49c4-a761-1d452202e036 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:21 devstack sudo[109842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b75474b0-4a4b-49c4-a761-1d452202e036 Sep 08 06:55:21 devstack sudo[109842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:21 devstack sudo[109842]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:21 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5432f483-2e62-49c6-8e65-401a5a42d971 tempest-VolumesDeleteCascade-1957490773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b75474b0-4a4b-49c4-a761-1d452202e036" returned: 0 in 0.263s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:21 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-5432f483-2e62-49c6-8e65-401a5a42d971 tempest-VolumesDeleteCascade-1957490773 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:55:21 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-5432f483-2e62-49c6-8e65-401a5a42d971 tempest-VolumesDeleteCascade-1957490773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:55:21 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5432f483-2e62-49c6-8e65-401a5a42d971 tempest-VolumesDeleteCascade-1957490773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cae6ccd-1c30-417f-a67a-ecd1bf39e91f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b75474b0-4a4b-49c4-a761-1d452202e036', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:55:21 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5432f483-2e62-49c6-8e65-401a5a42d971 tempest-VolumesDeleteCascade-1957490773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dc009e4-e115-4539-ab0b-3d8a4ef897af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:55:21 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-5432f483-2e62-49c6-8e65-401a5a42d971 tempest-VolumesDeleteCascade-1957490773 None] Volume volume-b75474b0-4a4b-49c4-a761-1d452202e036 (b75474b0-4a4b-49c4-a761-1d452202e036): created successfully Sep 08 06:55:21 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5432f483-2e62-49c6-8e65-401a5a42d971 tempest-VolumesDeleteCascade-1957490773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dc009e4-e115-4539-ab0b-3d8a4ef897af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:55:21 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5432f483-2e62-49c6-8e65-401a5a42d971 tempest-VolumesDeleteCascade-1957490773 None] Flow 'volume_create_manager' (1eee85c6-fea8-4891-83df-73cef841b597) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:55:21 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-5432f483-2e62-49c6-8e65-401a5a42d971 tempest-VolumesDeleteCascade-1957490773 None] Created volume successfully. Sep 08 06:55:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-d85f2e8c-b527-43b0-89ee-e2ba593d6335 tempest-VolumesDeleteCascade-1957490773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:55:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-d85f2e8c-b527-43b0-89ee-e2ba593d6335 tempest-VolumesDeleteCascade-1957490773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:55:23 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-d85f2e8c-b527-43b0-89ee-e2ba593d6335 tempest-VolumesDeleteCascade-1957490773 None] Creating offline snapshot 38b1d68a-7ac5-455b-8366-7f3d3543b77e of volume b75474b0-4a4b-49c4-a761-1d452202e036 {{(pid=87507) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 06:55:23 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d26fe7-62d7-40ef-86d3-81874aadaf1b]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:55:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-d85f2e8c-b527-43b0-89ee-e2ba593d6335 tempest-VolumesDeleteCascade-1957490773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b75474b0-4a4b-49c4-a761-1d452202e036 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:23 devstack sudo[109904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b75474b0-4a4b-49c4-a761-1d452202e036 Sep 08 06:55:23 devstack sudo[109904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:23 devstack sudo[109904]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-d85f2e8c-b527-43b0-89ee-e2ba593d6335 tempest-VolumesDeleteCascade-1957490773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b75474b0-4a4b-49c4-a761-1d452202e036" returned: 0 in 0.539s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-d85f2e8c-b527-43b0-89ee-e2ba593d6335 tempest-VolumesDeleteCascade-1957490773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b75474b0-4a4b-49c4-a761-1d452202e036,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b75474b0-4a4b-49c4-a761-1d452202e036.38b1d68a-7ac5-455b-8366-7f3d3543b77e 1G {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:23 devstack sudo[109952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b75474b0-4a4b-49c4-a761-1d452202e036,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b75474b0-4a4b-49c4-a761-1d452202e036.38b1d68a-7ac5-455b-8366-7f3d3543b77e 1G Sep 08 06:55:23 devstack sudo[109952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:23 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-429142bd-92bd-4828-b0df-ebd2de66e9c8 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Acquiring lock "cinder-7b583bbb-b149-44b8-a4c3-c015ae9c2b35-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:55:23 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-429142bd-92bd-4828-b0df-ebd2de66e9c8 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Lock "cinder-7b583bbb-b149-44b8-a4c3-c015ae9c2b35-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:55:23 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-429142bd-92bd-4828-b0df-ebd2de66e9c8 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Acquiring lock "cinder-quobyte-7b583bbb-b149-44b8-a4c3-c015ae9c2b35" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:55:23 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-429142bd-92bd-4828-b0df-ebd2de66e9c8 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Lock "cinder-quobyte-7b583bbb-b149-44b8-a4c3-c015ae9c2b35" acquired by "delete_volume" :: waited 0.020s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:55:23 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdfba719-a887-4914-9d4f-690f968b4abe]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:55:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-429142bd-92bd-4828-b0df-ebd2de66e9c8 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7b583bbb-b149-44b8-a4c3-c015ae9c2b35 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:24 devstack sudo[109960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7b583bbb-b149-44b8-a4c3-c015ae9c2b35 Sep 08 06:55:24 devstack sudo[109960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:24 devstack sudo[109952]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-d85f2e8c-b527-43b0-89ee-e2ba593d6335 tempest-VolumesDeleteCascade-1957490773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b75474b0-4a4b-49c4-a761-1d452202e036,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b75474b0-4a4b-49c4-a761-1d452202e036.38b1d68a-7ac5-455b-8366-7f3d3543b77e 1G" returned: 0 in 0.520s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-d85f2e8c-b527-43b0-89ee-e2ba593d6335 tempest-VolumesDeleteCascade-1957490773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b75474b0-4a4b-49c4-a761-1d452202e036 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b75474b0-4a4b-49c4-a761-1d452202e036.38b1d68a-7ac5-455b-8366-7f3d3543b77e {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:24 devstack sudo[109976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b75474b0-4a4b-49c4-a761-1d452202e036 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b75474b0-4a4b-49c4-a761-1d452202e036.38b1d68a-7ac5-455b-8366-7f3d3543b77e Sep 08 06:55:24 devstack sudo[109976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:24 devstack sudo[109960]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-429142bd-92bd-4828-b0df-ebd2de66e9c8 tempest-TestServerVolumeAttachmentScenario-1142016208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7b583bbb-b149-44b8-a4c3-c015ae9c2b35" returned: 0 in 0.499s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-429142bd-92bd-4828-b0df-ebd2de66e9c8 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7b583bbb-b149-44b8-a4c3-c015ae9c2b35 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:24 devstack sudo[110006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7b583bbb-b149-44b8-a4c3-c015ae9c2b35 Sep 08 06:55:24 devstack sudo[110006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:24 devstack sudo[109976]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-d85f2e8c-b527-43b0-89ee-e2ba593d6335 tempest-VolumesDeleteCascade-1957490773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b75474b0-4a4b-49c4-a761-1d452202e036 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b75474b0-4a4b-49c4-a761-1d452202e036.38b1d68a-7ac5-455b-8366-7f3d3543b77e" returned: 0 in 0.330s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:24 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-d85f2e8c-b527-43b0-89ee-e2ba593d6335 tempest-VolumesDeleteCascade-1957490773 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b75474b0-4a4b-49c4-a761-1d452202e036.38b1d68a-7ac5-455b-8366-7f3d3543b77e is being set with open permissions: ugo+rw Sep 08 06:55:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-d85f2e8c-b527-43b0-89ee-e2ba593d6335 tempest-VolumesDeleteCascade-1957490773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b75474b0-4a4b-49c4-a761-1d452202e036.38b1d68a-7ac5-455b-8366-7f3d3543b77e {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:24 devstack sudo[110015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b75474b0-4a4b-49c4-a761-1d452202e036.38b1d68a-7ac5-455b-8366-7f3d3543b77e Sep 08 06:55:24 devstack sudo[110015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:24 devstack sudo[110006]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-429142bd-92bd-4828-b0df-ebd2de66e9c8 tempest-TestServerVolumeAttachmentScenario-1142016208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7b583bbb-b149-44b8-a4c3-c015ae9c2b35" returned: 0 in 0.275s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:24 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-429142bd-92bd-4828-b0df-ebd2de66e9c8 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Lock "cinder-quobyte-7b583bbb-b149-44b8-a4c3-c015ae9c2b35" released by "delete_volume" :: held 0.830s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:55:24 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-429142bd-92bd-4828-b0df-ebd2de66e9c8 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Created reservations ['558529e7-f25e-4cdd-b10b-c4327d38e801', '3f986f18-4f01-4b14-9c22-b79e42af97b4', '974bc1bb-fa62-48d4-b2f6-e991342c8f81', '6a7a03e4-6a49-4066-9011-bd45eb585c64'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:55:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-429142bd-92bd-4828-b0df-ebd2de66e9c8 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:55:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-429142bd-92bd-4828-b0df-ebd2de66e9c8 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:55:24 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-429142bd-92bd-4828-b0df-ebd2de66e9c8 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:55:24 devstack sudo[110015]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:24 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-429142bd-92bd-4828-b0df-ebd2de66e9c8 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:55:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-429142bd-92bd-4828-b0df-ebd2de66e9c8 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:55:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-429142bd-92bd-4828-b0df-ebd2de66e9c8 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-d85f2e8c-b527-43b0-89ee-e2ba593d6335 tempest-VolumesDeleteCascade-1957490773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b75474b0-4a4b-49c4-a761-1d452202e036.38b1d68a-7ac5-455b-8366-7f3d3543b77e" returned: 0 in 0.297s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:24 devstack sudo[110028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:55:24 devstack sudo[110028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-d85f2e8c-b527-43b0-89ee-e2ba593d6335 tempest-VolumesDeleteCascade-1957490773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b75474b0-4a4b-49c4-a761-1d452202e036.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:24 devstack sudo[110030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b75474b0-4a4b-49c4-a761-1d452202e036.info Sep 08 06:55:24 devstack sudo[110030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:24 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-0f95f997-9f9b-405c-ab8c-358c178460a3 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Acquiring lock "cinder-599ec05a-ee64-427f-966a-3984ac95d6f5-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:55:24 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-0f95f997-9f9b-405c-ab8c-358c178460a3 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Lock "cinder-599ec05a-ee64-427f-966a-3984ac95d6f5-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:55:24 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-0f95f997-9f9b-405c-ab8c-358c178460a3 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Acquiring lock "cinder-quobyte-599ec05a-ee64-427f-966a-3984ac95d6f5" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:55:25 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-0f95f997-9f9b-405c-ab8c-358c178460a3 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Lock "cinder-quobyte-599ec05a-ee64-427f-966a-3984ac95d6f5" acquired by "delete_volume" :: waited 0.031s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:55:25 devstack sudo[110028]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:25 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c354586-e773-4633-8bdb-ffc857923f5a]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:55:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0f95f997-9f9b-405c-ab8c-358c178460a3 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-599ec05a-ee64-427f-966a-3984ac95d6f5 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-429142bd-92bd-4828-b0df-ebd2de66e9c8 tempest-TestServerVolumeAttachmentScenario-1142016208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.281s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:25 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-429142bd-92bd-4828-b0df-ebd2de66e9c8 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:55:25 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-429142bd-92bd-4828-b0df-ebd2de66e9c8 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Deleted volume successfully. Sep 08 06:55:25 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-429142bd-92bd-4828-b0df-ebd2de66e9c8 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Lock "cinder-7b583bbb-b149-44b8-a4c3-c015ae9c2b35-delete_volume" released by "delete_volume" :: held 1.351s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:55:25 devstack sudo[110042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-599ec05a-ee64-427f-966a-3984ac95d6f5 Sep 08 06:55:25 devstack sudo[110042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:25 devstack sudo[110030]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-d85f2e8c-b527-43b0-89ee-e2ba593d6335 tempest-VolumesDeleteCascade-1957490773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b75474b0-4a4b-49c4-a761-1d452202e036.info" returned: 0 in 0.342s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:25 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-d85f2e8c-b527-43b0-89ee-e2ba593d6335 tempest-VolumesDeleteCascade-1957490773 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b75474b0-4a4b-49c4-a761-1d452202e036.info is being set with open permissions: ugo+rw Sep 08 06:55:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-d85f2e8c-b527-43b0-89ee-e2ba593d6335 tempest-VolumesDeleteCascade-1957490773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b75474b0-4a4b-49c4-a761-1d452202e036.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:25 devstack sudo[110048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b75474b0-4a4b-49c4-a761-1d452202e036.info Sep 08 06:55:25 devstack sudo[110048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:25 devstack sudo[110042]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0f95f997-9f9b-405c-ab8c-358c178460a3 tempest-TestServerVolumeAttachmentScenario-1142016208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-599ec05a-ee64-427f-966a-3984ac95d6f5" returned: 0 in 0.361s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0f95f997-9f9b-405c-ab8c-358c178460a3 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-599ec05a-ee64-427f-966a-3984ac95d6f5 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:25 devstack sudo[110048]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-d85f2e8c-b527-43b0-89ee-e2ba593d6335 tempest-VolumesDeleteCascade-1957490773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b75474b0-4a4b-49c4-a761-1d452202e036.info" returned: 0 in 0.251s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:25 devstack sudo[110060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-599ec05a-ee64-427f-966a-3984ac95d6f5 Sep 08 06:55:25 devstack sudo[110060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-d85f2e8c-b527-43b0-89ee-e2ba593d6335 tempest-VolumesDeleteCascade-1957490773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.393s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:55:25 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-d85f2e8c-b527-43b0-89ee-e2ba593d6335 tempest-VolumesDeleteCascade-1957490773 None] Create snapshot completed successfully Sep 08 06:55:25 devstack sudo[110060]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0f95f997-9f9b-405c-ab8c-358c178460a3 tempest-TestServerVolumeAttachmentScenario-1142016208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-599ec05a-ee64-427f-966a-3984ac95d6f5" returned: 0 in 0.256s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:25 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-0f95f997-9f9b-405c-ab8c-358c178460a3 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Lock "cinder-quobyte-599ec05a-ee64-427f-966a-3984ac95d6f5" released by "delete_volume" :: held 0.660s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:55:25 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-0f95f997-9f9b-405c-ab8c-358c178460a3 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Created reservations ['5541d824-d288-4fd6-8003-09a6ec6198af', '9cbc66d5-a419-4c4e-890b-fafc067f9355', '4f26798d-19ad-4585-8000-57e08dd73dc1', '388cc64f-d002-401a-bb8c-bb9c14fadca2'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:55:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-0f95f997-9f9b-405c-ab8c-358c178460a3 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:55:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-0f95f997-9f9b-405c-ab8c-358c178460a3 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:55:25 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-0f95f997-9f9b-405c-ab8c-358c178460a3 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:55:25 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-0f95f997-9f9b-405c-ab8c-358c178460a3 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:55:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-0f95f997-9f9b-405c-ab8c-358c178460a3 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:55:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0f95f997-9f9b-405c-ab8c-358c178460a3 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:25 devstack sudo[110075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:55:25 devstack sudo[110075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:26 devstack sudo[110075]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0f95f997-9f9b-405c-ab8c-358c178460a3 tempest-TestServerVolumeAttachmentScenario-1142016208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.233s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:26 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-0f95f997-9f9b-405c-ab8c-358c178460a3 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:55:26 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-0f95f997-9f9b-405c-ab8c-358c178460a3 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Deleted volume successfully. Sep 08 06:55:26 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-0f95f997-9f9b-405c-ab8c-358c178460a3 tempest-TestServerVolumeAttachmentScenario-1142016208 None] Lock "cinder-599ec05a-ee64-427f-966a-3984ac95d6f5-delete_volume" released by "delete_volume" :: held 1.138s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:55:26 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-61a8a7d7-b61d-475c-bdb8-e3244d274aae tempest-VolumesDeleteCascade-1957490773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:55:26 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-61a8a7d7-b61d-475c-bdb8-e3244d274aae tempest-VolumesDeleteCascade-1957490773 None] Flow 'volume_create_manager' (3ae8d194-e61c-4f0b-b2ff-d785072ea67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:55:26 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-61a8a7d7-b61d-475c-bdb8-e3244d274aae tempest-VolumesDeleteCascade-1957490773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3239a2b0-dfa8-4080-8955-9f77f976dee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:55:26 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-61a8a7d7-b61d-475c-bdb8-e3244d274aae tempest-VolumesDeleteCascade-1957490773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3239a2b0-dfa8-4080-8955-9f77f976dee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:55:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-595377414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73b88bdb-7b01-4bcc-914b-a268b222e8c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='612432fdaf784e5689104d8668565a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:55:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=38b1d68a-7ac5-455b-8366-7f3d3543b77e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:55:27Z,use_quota=True,user_id='6fc7149505cb472cbc9017d4e7ff403e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:55:26 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-61a8a7d7-b61d-475c-bdb8-e3244d274aae tempest-VolumesDeleteCascade-1957490773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ee9ca36-99d1-4edf-8bfc-3ef6643fd885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:55:26 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-61a8a7d7-b61d-475c-bdb8-e3244d274aae tempest-VolumesDeleteCascade-1957490773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ee9ca36-99d1-4edf-8bfc-3ef6643fd885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:55:26 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-61a8a7d7-b61d-475c-bdb8-e3244d274aae tempest-VolumesDeleteCascade-1957490773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a46ca9a-c348-46f6-b911-c3a70f4471f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:55:26 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-61a8a7d7-b61d-475c-bdb8-e3244d274aae tempest-VolumesDeleteCascade-1957490773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a46ca9a-c348-46f6-b911-c3a70f4471f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '73b88bdb-7b01-4bcc-914b-a268b222e8c3', 'volume_name': 'volume-73b88bdb-7b01-4bcc-914b-a268b222e8c3', 'volume_size': 1, 'snapshot_id': '38b1d68a-7ac5-455b-8366-7f3d3543b77e'}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:55:26 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-61a8a7d7-b61d-475c-bdb8-e3244d274aae tempest-VolumesDeleteCascade-1957490773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (633f9af0-5763-4274-9d7a-44b1cc6eb071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:55:26 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-61a8a7d7-b61d-475c-bdb8-e3244d274aae tempest-VolumesDeleteCascade-1957490773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (633f9af0-5763-4274-9d7a-44b1cc6eb071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:55:26 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-61a8a7d7-b61d-475c-bdb8-e3244d274aae tempest-VolumesDeleteCascade-1957490773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8377a6e-b942-4042-a4c8-d47d37dff8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:55:26 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-61a8a7d7-b61d-475c-bdb8-e3244d274aae tempest-VolumesDeleteCascade-1957490773 None] Volume 73b88bdb-7b01-4bcc-914b-a268b222e8c3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-73b88bdb-7b01-4bcc-914b-a268b222e8c3', 'volume_size': 1, 'snapshot_id': '38b1d68a-7ac5-455b-8366-7f3d3543b77e'} Sep 08 06:55:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-61a8a7d7-b61d-475c-bdb8-e3244d274aae tempest-VolumesDeleteCascade-1957490773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:55:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-61a8a7d7-b61d-475c-bdb8-e3244d274aae tempest-VolumesDeleteCascade-1957490773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:55:26 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-61a8a7d7-b61d-475c-bdb8-e3244d274aae tempest-VolumesDeleteCascade-1957490773 None] Acquiring lock "cinder-quobyte-38b1d68a-7ac5-455b-8366-7f3d3543b77e-73b88bdb-7b01-4bcc-914b-a268b222e8c3" by "_create_volume_from_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:55:26 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-61a8a7d7-b61d-475c-bdb8-e3244d274aae tempest-VolumesDeleteCascade-1957490773 None] Lock "cinder-quobyte-38b1d68a-7ac5-455b-8366-7f3d3543b77e-73b88bdb-7b01-4bcc-914b-a268b222e8c3" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:55:26 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-61a8a7d7-b61d-475c-bdb8-e3244d274aae tempest-VolumesDeleteCascade-1957490773 None] Creating volume 73b88bdb-7b01-4bcc-914b-a268b222e8c3 from snapshot 38b1d68a-7ac5-455b-8366-7f3d3543b77e {{(pid=87507) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 08 06:55:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-61a8a7d7-b61d-475c-bdb8-e3244d274aae tempest-VolumesDeleteCascade-1957490773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:55:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-61a8a7d7-b61d-475c-bdb8-e3244d274aae tempest-VolumesDeleteCascade-1957490773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:55:26 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-61a8a7d7-b61d-475c-bdb8-e3244d274aae tempest-VolumesDeleteCascade-1957490773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:55:26 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-61a8a7d7-b61d-475c-bdb8-e3244d274aae tempest-VolumesDeleteCascade-1957490773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:55:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-61a8a7d7-b61d-475c-bdb8-e3244d274aae tempest-VolumesDeleteCascade-1957490773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:55:26 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-61a8a7d7-b61d-475c-bdb8-e3244d274aae tempest-VolumesDeleteCascade-1957490773 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:55:26 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-61a8a7d7-b61d-475c-bdb8-e3244d274aae tempest-VolumesDeleteCascade-1957490773 None] Acquiring lock "cinder-quobyte-73b88bdb-7b01-4bcc-914b-a268b222e8c3" by "_copy_volume_from_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:55:26 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-61a8a7d7-b61d-475c-bdb8-e3244d274aae tempest-VolumesDeleteCascade-1957490773 None] Lock "cinder-quobyte-73b88bdb-7b01-4bcc-914b-a268b222e8c3" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:55:26 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-61a8a7d7-b61d-475c-bdb8-e3244d274aae tempest-VolumesDeleteCascade-1957490773 None] snapshot: 38b1d68a-7ac5-455b-8366-7f3d3543b77e, volume: 73b88bdb-7b01-4bcc-914b-a268b222e8c3, {{(pid=87507) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 08 06:55:27 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-61a8a7d7-b61d-475c-bdb8-e3244d274aae tempest-VolumesDeleteCascade-1957490773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:55:27 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-61a8a7d7-b61d-475c-bdb8-e3244d274aae tempest-VolumesDeleteCascade-1957490773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:55:27 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-61a8a7d7-b61d-475c-bdb8-e3244d274aae tempest-VolumesDeleteCascade-1957490773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:55:27 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-61a8a7d7-b61d-475c-bdb8-e3244d274aae tempest-VolumesDeleteCascade-1957490773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:55:27 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-61a8a7d7-b61d-475c-bdb8-e3244d274aae tempest-VolumesDeleteCascade-1957490773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:55:27 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[931161ab-87a3-4d93-aea5-6de645d9f4d6]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:55:27 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-61a8a7d7-b61d-475c-bdb8-e3244d274aae tempest-VolumesDeleteCascade-1957490773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b75474b0-4a4b-49c4-a761-1d452202e036.38b1d68a-7ac5-455b-8366-7f3d3543b77e {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:27 devstack sudo[110114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b75474b0-4a4b-49c4-a761-1d452202e036.38b1d68a-7ac5-455b-8366-7f3d3543b77e Sep 08 06:55:27 devstack sudo[110114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:27 devstack sudo[110114]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:27 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-61a8a7d7-b61d-475c-bdb8-e3244d274aae tempest-VolumesDeleteCascade-1957490773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b75474b0-4a4b-49c4-a761-1d452202e036.38b1d68a-7ac5-455b-8366-7f3d3543b77e" returned: 0 in 0.373s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:27 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-61a8a7d7-b61d-475c-bdb8-e3244d274aae tempest-VolumesDeleteCascade-1957490773 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b75474b0-4a4b-49c4-a761-1d452202e036(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 06:55:27 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2498dec1-32f1-43e7-86a7-6dd1713c6973]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:55:27 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-61a8a7d7-b61d-475c-bdb8-e3244d274aae tempest-VolumesDeleteCascade-1957490773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b75474b0-4a4b-49c4-a761-1d452202e036 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:27 devstack sudo[110131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b75474b0-4a4b-49c4-a761-1d452202e036 Sep 08 06:55:27 devstack sudo[110131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:27 devstack sudo[110131]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:27 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-61a8a7d7-b61d-475c-bdb8-e3244d274aae tempest-VolumesDeleteCascade-1957490773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b75474b0-4a4b-49c4-a761-1d452202e036" returned: 0 in 0.390s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:27 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-61a8a7d7-b61d-475c-bdb8-e3244d274aae tempest-VolumesDeleteCascade-1957490773 None] will copy from snapshot at /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b75474b0-4a4b-49c4-a761-1d452202e036 {{(pid=87507) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 08 06:55:27 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-61a8a7d7-b61d-475c-bdb8-e3244d274aae tempest-VolumesDeleteCascade-1957490773 None] Creating direct copy from snapshot {{(pid=87507) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 08 06:55:27 devstack cinder-volume[87507]: DEBUG cinder.utils [None req-61a8a7d7-b61d-475c-bdb8-e3244d274aae tempest-VolumesDeleteCascade-1957490773 None] Path /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-73b88bdb-7b01-4bcc-914b-a268b222e8c3 not found in is_blk_device check {{(pid=87507) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 08 06:55:27 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-61a8a7d7-b61d-475c-bdb8-e3244d274aae tempest-VolumesDeleteCascade-1957490773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b75474b0-4a4b-49c4-a761-1d452202e036 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-73b88bdb-7b01-4bcc-914b-a268b222e8c3 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:27 devstack sudo[110150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b75474b0-4a4b-49c4-a761-1d452202e036 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-73b88bdb-7b01-4bcc-914b-a268b222e8c3 Sep 08 06:55:27 devstack sudo[110150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:33 devstack sudo[110150]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-61a8a7d7-b61d-475c-bdb8-e3244d274aae tempest-VolumesDeleteCascade-1957490773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b75474b0-4a4b-49c4-a761-1d452202e036 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-73b88bdb-7b01-4bcc-914b-a268b222e8c3" returned: 0 in 5.361s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:33 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-61a8a7d7-b61d-475c-bdb8-e3244d274aae tempest-VolumesDeleteCascade-1957490773 None] Image conversion details: src /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b75474b0-4a4b-49c4-a761-1d452202e036, size 1024.00 MB, duration 5.36 sec, destination /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-73b88bdb-7b01-4bcc-914b-a268b222e8c3 {{(pid=87507) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 06:55:33 devstack cinder-volume[87507]: INFO cinder.image.image_utils [None req-61a8a7d7-b61d-475c-bdb8-e3244d274aae tempest-VolumesDeleteCascade-1957490773 None] Converted 1024.00 MB image at 190.95 MB/s Sep 08 06:55:33 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-61a8a7d7-b61d-475c-bdb8-e3244d274aae tempest-VolumesDeleteCascade-1957490773 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-73b88bdb-7b01-4bcc-914b-a268b222e8c3 is being set with open permissions: ugo+rw Sep 08 06:55:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-61a8a7d7-b61d-475c-bdb8-e3244d274aae tempest-VolumesDeleteCascade-1957490773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-73b88bdb-7b01-4bcc-914b-a268b222e8c3 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:33 devstack sudo[110325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-73b88bdb-7b01-4bcc-914b-a268b222e8c3 Sep 08 06:55:33 devstack sudo[110325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:33 devstack sudo[110325]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-61a8a7d7-b61d-475c-bdb8-e3244d274aae tempest-VolumesDeleteCascade-1957490773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-73b88bdb-7b01-4bcc-914b-a268b222e8c3" returned: 0 in 0.281s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:33 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-61a8a7d7-b61d-475c-bdb8-e3244d274aae tempest-VolumesDeleteCascade-1957490773 None] Lock "cinder-quobyte-73b88bdb-7b01-4bcc-914b-a268b222e8c3" released by "_copy_volume_from_snapshot" :: held 6.488s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:55:33 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-61a8a7d7-b61d-475c-bdb8-e3244d274aae tempest-VolumesDeleteCascade-1957490773 None] Lock "cinder-quobyte-38b1d68a-7ac5-455b-8366-7f3d3543b77e-73b88bdb-7b01-4bcc-914b-a268b222e8c3" released by "_create_volume_from_snapshot" :: held 6.568s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:55:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-61a8a7d7-b61d-475c-bdb8-e3244d274aae tempest-VolumesDeleteCascade-1957490773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.585s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:55:33 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-61a8a7d7-b61d-475c-bdb8-e3244d274aae tempest-VolumesDeleteCascade-1957490773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8377a6e-b942-4042-a4c8-d47d37dff8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73b88bdb-7b01-4bcc-914b-a268b222e8c3', 'volume_size': 1, 'snapshot_id': '38b1d68a-7ac5-455b-8366-7f3d3543b77e'}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:55:33 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-61a8a7d7-b61d-475c-bdb8-e3244d274aae tempest-VolumesDeleteCascade-1957490773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02701af5-035c-4e1c-b1c3-b6c2c61632ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:55:33 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-61a8a7d7-b61d-475c-bdb8-e3244d274aae tempest-VolumesDeleteCascade-1957490773 None] Volume volume-73b88bdb-7b01-4bcc-914b-a268b222e8c3 (73b88bdb-7b01-4bcc-914b-a268b222e8c3): created successfully Sep 08 06:55:33 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-61a8a7d7-b61d-475c-bdb8-e3244d274aae tempest-VolumesDeleteCascade-1957490773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02701af5-035c-4e1c-b1c3-b6c2c61632ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:55:33 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-61a8a7d7-b61d-475c-bdb8-e3244d274aae tempest-VolumesDeleteCascade-1957490773 None] Flow 'volume_create_manager' (3ae8d194-e61c-4f0b-b2ff-d785072ea67f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:55:33 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-61a8a7d7-b61d-475c-bdb8-e3244d274aae tempest-VolumesDeleteCascade-1957490773 None] Created volume successfully. Sep 08 06:55:34 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-fcee8fea-3546-4939-8625-a0d8f1b3a828 tempest-VolumesDeleteCascade-1957490773 None] Acquiring lock "cinder-b75474b0-4a4b-49c4-a761-1d452202e036-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:55:34 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-fcee8fea-3546-4939-8625-a0d8f1b3a828 tempest-VolumesDeleteCascade-1957490773 None] Lock "cinder-b75474b0-4a4b-49c4-a761-1d452202e036-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:55:34 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-fcee8fea-3546-4939-8625-a0d8f1b3a828 tempest-VolumesDeleteCascade-1957490773 None] Performing cascade delete. {{(pid=87507) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 08 06:55:34 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-fcee8fea-3546-4939-8625-a0d8f1b3a828 tempest-VolumesDeleteCascade-1957490773 None] Acquiring lock "cinder-38b1d68a-7ac5-455b-8366-7f3d3543b77e-delete_snapshot" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:55:34 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-fcee8fea-3546-4939-8625-a0d8f1b3a828 tempest-VolumesDeleteCascade-1957490773 None] Lock "cinder-38b1d68a-7ac5-455b-8366-7f3d3543b77e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:55:34 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-fcee8fea-3546-4939-8625-a0d8f1b3a828 tempest-VolumesDeleteCascade-1957490773 None] Acquiring lock "cinder-quobyte-b75474b0-4a4b-49c4-a761-1d452202e036" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:55:34 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-fcee8fea-3546-4939-8625-a0d8f1b3a828 tempest-VolumesDeleteCascade-1957490773 None] Lock "cinder-quobyte-b75474b0-4a4b-49c4-a761-1d452202e036" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:55:34 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-fcee8fea-3546-4939-8625-a0d8f1b3a828 tempest-VolumesDeleteCascade-1957490773 None] Acquiring lock "cinder-quobyte-38b1d68a-7ac5-455b-8366-7f3d3543b77e" by "_delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:55:34 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-fcee8fea-3546-4939-8625-a0d8f1b3a828 tempest-VolumesDeleteCascade-1957490773 None] Lock "cinder-quobyte-38b1d68a-7ac5-455b-8366-7f3d3543b77e" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:55:34 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-fcee8fea-3546-4939-8625-a0d8f1b3a828 tempest-VolumesDeleteCascade-1957490773 None] Deleting offline snapshot 38b1d68a-7ac5-455b-8366-7f3d3543b77e of volume b75474b0-4a4b-49c4-a761-1d452202e036 {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 06:55:34 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-fcee8fea-3546-4939-8625-a0d8f1b3a828 tempest-VolumesDeleteCascade-1957490773 None] snapshot_file for this snap is: volume-b75474b0-4a4b-49c4-a761-1d452202e036.38b1d68a-7ac5-455b-8366-7f3d3543b77e {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 06:55:34 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[909619cc-be8f-4924-91e7-c164ed11e5b4]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:55:34 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-fcee8fea-3546-4939-8625-a0d8f1b3a828 tempest-VolumesDeleteCascade-1957490773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b75474b0-4a4b-49c4-a761-1d452202e036.38b1d68a-7ac5-455b-8366-7f3d3543b77e {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:34 devstack sudo[110374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b75474b0-4a4b-49c4-a761-1d452202e036.38b1d68a-7ac5-455b-8366-7f3d3543b77e Sep 08 06:55:34 devstack sudo[110374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:35 devstack sudo[110374]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-fcee8fea-3546-4939-8625-a0d8f1b3a828 tempest-VolumesDeleteCascade-1957490773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b75474b0-4a4b-49c4-a761-1d452202e036.38b1d68a-7ac5-455b-8366-7f3d3543b77e" returned: 0 in 0.402s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:35 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-fcee8fea-3546-4939-8625-a0d8f1b3a828 tempest-VolumesDeleteCascade-1957490773 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b75474b0-4a4b-49c4-a761-1d452202e036(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 06:55:35 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e06bf7-292f-43c7-bbaf-c5d4be78c383]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:55:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-fcee8fea-3546-4939-8625-a0d8f1b3a828 tempest-VolumesDeleteCascade-1957490773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b75474b0-4a4b-49c4-a761-1d452202e036 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:35 devstack sudo[110403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b75474b0-4a4b-49c4-a761-1d452202e036 Sep 08 06:55:35 devstack sudo[110403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:35 devstack sudo[110403]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-fcee8fea-3546-4939-8625-a0d8f1b3a828 tempest-VolumesDeleteCascade-1957490773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b75474b0-4a4b-49c4-a761-1d452202e036" returned: 0 in 0.553s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-fcee8fea-3546-4939-8625-a0d8f1b3a828 tempest-VolumesDeleteCascade-1957490773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b75474b0-4a4b-49c4-a761-1d452202e036.38b1d68a-7ac5-455b-8366-7f3d3543b77e {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:35 devstack sudo[110424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b75474b0-4a4b-49c4-a761-1d452202e036.38b1d68a-7ac5-455b-8366-7f3d3543b77e Sep 08 06:55:35 devstack sudo[110424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:36 devstack sudo[110424]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-fcee8fea-3546-4939-8625-a0d8f1b3a828 tempest-VolumesDeleteCascade-1957490773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b75474b0-4a4b-49c4-a761-1d452202e036.38b1d68a-7ac5-455b-8366-7f3d3543b77e" returned: 0 in 0.532s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-fcee8fea-3546-4939-8625-a0d8f1b3a828 tempest-VolumesDeleteCascade-1957490773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b75474b0-4a4b-49c4-a761-1d452202e036.38b1d68a-7ac5-455b-8366-7f3d3543b77e {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:36 devstack sudo[110447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b75474b0-4a4b-49c4-a761-1d452202e036.38b1d68a-7ac5-455b-8366-7f3d3543b77e Sep 08 06:55:36 devstack sudo[110447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:36 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-11e66676-3263-4e5b-aa80-2357774160a0 tempest-TestServerVolumeAttachScenarioOldVersion-70037735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:55:36 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-11e66676-3263-4e5b-aa80-2357774160a0 tempest-TestServerVolumeAttachScenarioOldVersion-70037735 None] Flow 'volume_create_manager' (9522f186-f756-4f33-83e2-a893551f0376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:55:36 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-11e66676-3263-4e5b-aa80-2357774160a0 tempest-TestServerVolumeAttachScenarioOldVersion-70037735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4d6d7a8-be91-449d-830d-13fbc52e1c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:55:36 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-11e66676-3263-4e5b-aa80-2357774160a0 tempest-TestServerVolumeAttachScenarioOldVersion-70037735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4d6d7a8-be91-449d-830d-13fbc52e1c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:55:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-490937366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b07bd05-5d49-49ca-abfe-f73cbbc818a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b9484964c6042409d17a48b25999d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:55:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:55:36Z,use_quota=True,user_id='2e13f0f1d0844efba9933c697f9ed8dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:55:36 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-11e66676-3263-4e5b-aa80-2357774160a0 tempest-TestServerVolumeAttachScenarioOldVersion-70037735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (835138c0-d26e-4460-8a01-41b77c4a60b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:55:36 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-11e66676-3263-4e5b-aa80-2357774160a0 tempest-TestServerVolumeAttachScenarioOldVersion-70037735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (835138c0-d26e-4460-8a01-41b77c4a60b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:55:36 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-11e66676-3263-4e5b-aa80-2357774160a0 tempest-TestServerVolumeAttachScenarioOldVersion-70037735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b356fae9-747d-4508-8c75-5f6867e92a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:55:36 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-11e66676-3263-4e5b-aa80-2357774160a0 tempest-TestServerVolumeAttachScenarioOldVersion-70037735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b356fae9-747d-4508-8c75-5f6867e92a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b07bd05-5d49-49ca-abfe-f73cbbc818a6', 'volume_name': 'volume-5b07bd05-5d49-49ca-abfe-f73cbbc818a6', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:55:36 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-11e66676-3263-4e5b-aa80-2357774160a0 tempest-TestServerVolumeAttachScenarioOldVersion-70037735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62e441cf-f9e3-4f67-88a1-60cf2930cf80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:55:36 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-11e66676-3263-4e5b-aa80-2357774160a0 tempest-TestServerVolumeAttachScenarioOldVersion-70037735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62e441cf-f9e3-4f67-88a1-60cf2930cf80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:55:36 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-11e66676-3263-4e5b-aa80-2357774160a0 tempest-TestServerVolumeAttachScenarioOldVersion-70037735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4710546b-c22c-4ad2-a300-6845b673b702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:55:36 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-11e66676-3263-4e5b-aa80-2357774160a0 tempest-TestServerVolumeAttachScenarioOldVersion-70037735 None] Volume 5b07bd05-5d49-49ca-abfe-f73cbbc818a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b07bd05-5d49-49ca-abfe-f73cbbc818a6', 'volume_size': 1} Sep 08 06:55:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-11e66676-3263-4e5b-aa80-2357774160a0 tempest-TestServerVolumeAttachScenarioOldVersion-70037735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:55:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-11e66676-3263-4e5b-aa80-2357774160a0 tempest-TestServerVolumeAttachScenarioOldVersion-70037735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:55:36 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-11e66676-3263-4e5b-aa80-2357774160a0 tempest-TestServerVolumeAttachScenarioOldVersion-70037735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:55:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-490937366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b07bd05-5d49-49ca-abfe-f73cbbc818a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b9484964c6042409d17a48b25999d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:55:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:55:36Z,use_quota=True,user_id='2e13f0f1d0844efba9933c697f9ed8dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:55:36 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-11e66676-3263-4e5b-aa80-2357774160a0 tempest-TestServerVolumeAttachScenarioOldVersion-70037735 None] Creating volume 5b07bd05-5d49-49ca-abfe-f73cbbc818a6 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:55:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-11e66676-3263-4e5b-aa80-2357774160a0 tempest-TestServerVolumeAttachScenarioOldVersion-70037735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:55:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-11e66676-3263-4e5b-aa80-2357774160a0 tempest-TestServerVolumeAttachScenarioOldVersion-70037735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:55:36 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-11e66676-3263-4e5b-aa80-2357774160a0 tempest-TestServerVolumeAttachScenarioOldVersion-70037735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:55:36 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-11e66676-3263-4e5b-aa80-2357774160a0 tempest-TestServerVolumeAttachScenarioOldVersion-70037735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:55:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-11e66676-3263-4e5b-aa80-2357774160a0 tempest-TestServerVolumeAttachScenarioOldVersion-70037735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:55:36 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-11e66676-3263-4e5b-aa80-2357774160a0 tempest-TestServerVolumeAttachScenarioOldVersion-70037735 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:55:36 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-11e66676-3263-4e5b-aa80-2357774160a0 tempest-TestServerVolumeAttachScenarioOldVersion-70037735 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:55:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-11e66676-3263-4e5b-aa80-2357774160a0 tempest-TestServerVolumeAttachScenarioOldVersion-70037735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5b07bd05-5d49-49ca-abfe-f73cbbc818a6 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:36 devstack sudo[110453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5b07bd05-5d49-49ca-abfe-f73cbbc818a6 1073741824 Sep 08 06:55:36 devstack sudo[110453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:36 devstack sudo[110447]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-fcee8fea-3546-4939-8625-a0d8f1b3a828 tempest-VolumesDeleteCascade-1957490773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b75474b0-4a4b-49c4-a761-1d452202e036.38b1d68a-7ac5-455b-8366-7f3d3543b77e" returned: 0 in 0.263s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:36 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-fcee8fea-3546-4939-8625-a0d8f1b3a828 tempest-VolumesDeleteCascade-1957490773 None] Lock "cinder-quobyte-38b1d68a-7ac5-455b-8366-7f3d3543b77e" released by "_delete_snapshot" :: held 1.869s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:55:36 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-fcee8fea-3546-4939-8625-a0d8f1b3a828 tempest-VolumesDeleteCascade-1957490773 None] Lock "cinder-quobyte-b75474b0-4a4b-49c4-a761-1d452202e036" released by "delete_snapshot" :: held 1.897s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:55:36 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-fcee8fea-3546-4939-8625-a0d8f1b3a828 tempest-VolumesDeleteCascade-1957490773 None] Created reservations ['9b2f301f-d51d-4436-a3a3-1f92de83286d', '78a3ba17-4a65-4321-a988-35b350b5f730', '825b9b3c-3712-4274-8f30-4a5f681eb7bc', 'af0baa6a-48e4-458b-b28d-6823e16259ef'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:55:36 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-fcee8fea-3546-4939-8625-a0d8f1b3a828 tempest-VolumesDeleteCascade-1957490773 None] Delete snapshot completed successfully. Sep 08 06:55:36 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-fcee8fea-3546-4939-8625-a0d8f1b3a828 tempest-VolumesDeleteCascade-1957490773 None] Lock "cinder-38b1d68a-7ac5-455b-8366-7f3d3543b77e-delete_snapshot" released by "delete_snapshot" :: held 2.069s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:55:36 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-fcee8fea-3546-4939-8625-a0d8f1b3a828 tempest-VolumesDeleteCascade-1957490773 None] Snapshots deleted, issuing volume delete {{(pid=87507) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 08 06:55:36 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-fcee8fea-3546-4939-8625-a0d8f1b3a828 tempest-VolumesDeleteCascade-1957490773 None] Acquiring lock "cinder-quobyte-b75474b0-4a4b-49c4-a761-1d452202e036" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:55:36 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-fcee8fea-3546-4939-8625-a0d8f1b3a828 tempest-VolumesDeleteCascade-1957490773 None] Lock "cinder-quobyte-b75474b0-4a4b-49c4-a761-1d452202e036" acquired by "delete_volume" :: waited 0.024s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:55:36 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c675d25-b9fb-439c-9cf6-a11eb9ab0b32]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:55:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-fcee8fea-3546-4939-8625-a0d8f1b3a828 tempest-VolumesDeleteCascade-1957490773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b75474b0-4a4b-49c4-a761-1d452202e036 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:36 devstack sudo[110471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b75474b0-4a4b-49c4-a761-1d452202e036 Sep 08 06:55:36 devstack sudo[110471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:36 devstack sudo[110453]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-11e66676-3263-4e5b-aa80-2357774160a0 tempest-TestServerVolumeAttachScenarioOldVersion-70037735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5b07bd05-5d49-49ca-abfe-f73cbbc818a6 1073741824" returned: 0 in 0.536s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-11e66676-3263-4e5b-aa80-2357774160a0 tempest-TestServerVolumeAttachScenarioOldVersion-70037735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5b07bd05-5d49-49ca-abfe-f73cbbc818a6 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:37 devstack sudo[110480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5b07bd05-5d49-49ca-abfe-f73cbbc818a6 Sep 08 06:55:37 devstack sudo[110480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:37 devstack sudo[110471]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-fcee8fea-3546-4939-8625-a0d8f1b3a828 tempest-VolumesDeleteCascade-1957490773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b75474b0-4a4b-49c4-a761-1d452202e036" returned: 0 in 0.506s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-fcee8fea-3546-4939-8625-a0d8f1b3a828 tempest-VolumesDeleteCascade-1957490773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b75474b0-4a4b-49c4-a761-1d452202e036 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:37 devstack sudo[110495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b75474b0-4a4b-49c4-a761-1d452202e036 Sep 08 06:55:37 devstack sudo[110495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:37 devstack sudo[110480]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-11e66676-3263-4e5b-aa80-2357774160a0 tempest-TestServerVolumeAttachScenarioOldVersion-70037735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5b07bd05-5d49-49ca-abfe-f73cbbc818a6" returned: 0 in 0.315s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:37 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-11e66676-3263-4e5b-aa80-2357774160a0 tempest-TestServerVolumeAttachScenarioOldVersion-70037735 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:55:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-11e66676-3263-4e5b-aa80-2357774160a0 tempest-TestServerVolumeAttachScenarioOldVersion-70037735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:55:37 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-11e66676-3263-4e5b-aa80-2357774160a0 tempest-TestServerVolumeAttachScenarioOldVersion-70037735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4710546b-c22c-4ad2-a300-6845b673b702) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b07bd05-5d49-49ca-abfe-f73cbbc818a6', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:55:37 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-11e66676-3263-4e5b-aa80-2357774160a0 tempest-TestServerVolumeAttachScenarioOldVersion-70037735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aba26914-f89d-4159-9a8d-835ad8f6ebf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:55:37 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-11e66676-3263-4e5b-aa80-2357774160a0 tempest-TestServerVolumeAttachScenarioOldVersion-70037735 None] Volume volume-5b07bd05-5d49-49ca-abfe-f73cbbc818a6 (5b07bd05-5d49-49ca-abfe-f73cbbc818a6): created successfully Sep 08 06:55:37 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-11e66676-3263-4e5b-aa80-2357774160a0 tempest-TestServerVolumeAttachScenarioOldVersion-70037735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aba26914-f89d-4159-9a8d-835ad8f6ebf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:55:37 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-11e66676-3263-4e5b-aa80-2357774160a0 tempest-TestServerVolumeAttachScenarioOldVersion-70037735 None] Flow 'volume_create_manager' (9522f186-f756-4f33-83e2-a893551f0376) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:55:37 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-11e66676-3263-4e5b-aa80-2357774160a0 tempest-TestServerVolumeAttachScenarioOldVersion-70037735 None] Created volume successfully. Sep 08 06:55:37 devstack sudo[110495]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-fcee8fea-3546-4939-8625-a0d8f1b3a828 tempest-VolumesDeleteCascade-1957490773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b75474b0-4a4b-49c4-a761-1d452202e036" returned: 0 in 0.258s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:37 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-fcee8fea-3546-4939-8625-a0d8f1b3a828 tempest-VolumesDeleteCascade-1957490773 None] Lock "cinder-quobyte-b75474b0-4a4b-49c4-a761-1d452202e036" released by "delete_volume" :: held 0.831s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:55:37 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-fcee8fea-3546-4939-8625-a0d8f1b3a828 tempest-VolumesDeleteCascade-1957490773 None] Created reservations ['175dee1f-0537-4185-a1aa-9e04f30be61e', '07ccd2e8-1fe5-484c-bf4d-684395dd0d02', 'ccfdfc2d-5175-4f0d-bba4-5109d510b247', '3a5d87d9-f144-4ac8-b84a-e9465893a1b1'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:55:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-fcee8fea-3546-4939-8625-a0d8f1b3a828 tempest-VolumesDeleteCascade-1957490773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:55:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-fcee8fea-3546-4939-8625-a0d8f1b3a828 tempest-VolumesDeleteCascade-1957490773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:55:37 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-fcee8fea-3546-4939-8625-a0d8f1b3a828 tempest-VolumesDeleteCascade-1957490773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:55:37 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-fcee8fea-3546-4939-8625-a0d8f1b3a828 tempest-VolumesDeleteCascade-1957490773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:55:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-fcee8fea-3546-4939-8625-a0d8f1b3a828 tempest-VolumesDeleteCascade-1957490773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:55:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-fcee8fea-3546-4939-8625-a0d8f1b3a828 tempest-VolumesDeleteCascade-1957490773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:37 devstack sudo[110510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:55:37 devstack sudo[110510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:37 devstack sudo[110510]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-fcee8fea-3546-4939-8625-a0d8f1b3a828 tempest-VolumesDeleteCascade-1957490773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.255s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:37 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-fcee8fea-3546-4939-8625-a0d8f1b3a828 tempest-VolumesDeleteCascade-1957490773 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:55:37 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-fcee8fea-3546-4939-8625-a0d8f1b3a828 tempest-VolumesDeleteCascade-1957490773 None] Deleted volume successfully. Sep 08 06:55:37 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-fcee8fea-3546-4939-8625-a0d8f1b3a828 tempest-VolumesDeleteCascade-1957490773 None] Lock "cinder-b75474b0-4a4b-49c4-a761-1d452202e036-delete_volume" released by "delete_volume" :: held 3.382s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:55:38 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-47f30fa9-e967-48d8-bee7-38ebb693d0c2 tempest-VolumesDeleteCascade-1957490773 None] Acquiring lock "cinder-73b88bdb-7b01-4bcc-914b-a268b222e8c3-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:55:38 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-47f30fa9-e967-48d8-bee7-38ebb693d0c2 tempest-VolumesDeleteCascade-1957490773 None] Lock "cinder-73b88bdb-7b01-4bcc-914b-a268b222e8c3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:55:38 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-47f30fa9-e967-48d8-bee7-38ebb693d0c2 tempest-VolumesDeleteCascade-1957490773 None] Acquiring lock "cinder-quobyte-73b88bdb-7b01-4bcc-914b-a268b222e8c3" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:55:38 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-47f30fa9-e967-48d8-bee7-38ebb693d0c2 tempest-VolumesDeleteCascade-1957490773 None] Lock "cinder-quobyte-73b88bdb-7b01-4bcc-914b-a268b222e8c3" acquired by "delete_volume" :: waited 0.020s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:55:38 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e586d991-32a8-46ac-b4b7-e7bdeab58907]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:55:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-47f30fa9-e967-48d8-bee7-38ebb693d0c2 tempest-VolumesDeleteCascade-1957490773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-73b88bdb-7b01-4bcc-914b-a268b222e8c3 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:38 devstack sudo[110528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-73b88bdb-7b01-4bcc-914b-a268b222e8c3 Sep 08 06:55:38 devstack sudo[110528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:38 devstack sudo[110528]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-47f30fa9-e967-48d8-bee7-38ebb693d0c2 tempest-VolumesDeleteCascade-1957490773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-73b88bdb-7b01-4bcc-914b-a268b222e8c3" returned: 0 in 0.433s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-47f30fa9-e967-48d8-bee7-38ebb693d0c2 tempest-VolumesDeleteCascade-1957490773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-73b88bdb-7b01-4bcc-914b-a268b222e8c3 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:38 devstack sudo[110549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-73b88bdb-7b01-4bcc-914b-a268b222e8c3 Sep 08 06:55:38 devstack sudo[110549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:38 devstack sudo[110549]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-47f30fa9-e967-48d8-bee7-38ebb693d0c2 tempest-VolumesDeleteCascade-1957490773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-73b88bdb-7b01-4bcc-914b-a268b222e8c3" returned: 0 in 0.356s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:39 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-47f30fa9-e967-48d8-bee7-38ebb693d0c2 tempest-VolumesDeleteCascade-1957490773 None] Lock "cinder-quobyte-73b88bdb-7b01-4bcc-914b-a268b222e8c3" released by "delete_volume" :: held 0.838s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:55:39 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-47f30fa9-e967-48d8-bee7-38ebb693d0c2 tempest-VolumesDeleteCascade-1957490773 None] Created reservations ['d2d26a83-0820-4b9d-8c3f-b6f4a95dfa7c', '71ad3ede-ac1d-4548-b4a3-92cfe00ba4a0', 'ce690c16-2db4-4a87-b80e-3542b5430610', 'bb1066ed-1680-4c6c-a31f-3125449623ab'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:55:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-47f30fa9-e967-48d8-bee7-38ebb693d0c2 tempest-VolumesDeleteCascade-1957490773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:55:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-47f30fa9-e967-48d8-bee7-38ebb693d0c2 tempest-VolumesDeleteCascade-1957490773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:55:39 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-47f30fa9-e967-48d8-bee7-38ebb693d0c2 tempest-VolumesDeleteCascade-1957490773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:55:39 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-47f30fa9-e967-48d8-bee7-38ebb693d0c2 tempest-VolumesDeleteCascade-1957490773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:55:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-47f30fa9-e967-48d8-bee7-38ebb693d0c2 tempest-VolumesDeleteCascade-1957490773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:55:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-47f30fa9-e967-48d8-bee7-38ebb693d0c2 tempest-VolumesDeleteCascade-1957490773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:39 devstack sudo[110576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:55:39 devstack sudo[110576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-c60dfa54-1f4a-4336-b39d-2c6516624fcd req-8bd09cd4-0407-42f6-8656-0b75895f7a3d tempest-TestServerVolumeAttachScenarioOldVersion-70037735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:55:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-c60dfa54-1f4a-4336-b39d-2c6516624fcd req-8bd09cd4-0407-42f6-8656-0b75895f7a3d tempest-TestServerVolumeAttachScenarioOldVersion-70037735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:55:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-c60dfa54-1f4a-4336-b39d-2c6516624fcd req-8bd09cd4-0407-42f6-8656-0b75895f7a3d tempest-TestServerVolumeAttachScenarioOldVersion-70037735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:55:39 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-c60dfa54-1f4a-4336-b39d-2c6516624fcd req-8bd09cd4-0407-42f6-8656-0b75895f7a3d tempest-TestServerVolumeAttachScenarioOldVersion-70037735 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d', 'name': 'volume-5b07bd05-5d49-49ca-abfe-f73cbbc818a6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'df2e70f7-1aeb-4531-ae48-93b6ea7e5aad', 'enforce_multipath': True} {{(pid=87507) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 06:55:39 devstack cinder-volume[87507]: INFO cinder.volume.manager [req-c60dfa54-1f4a-4336-b39d-2c6516624fcd req-8bd09cd4-0407-42f6-8656-0b75895f7a3d tempest-TestServerVolumeAttachScenarioOldVersion-70037735 None] attachment_update completed successfully. Sep 08 06:55:39 devstack sudo[110576]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-47f30fa9-e967-48d8-bee7-38ebb693d0c2 tempest-VolumesDeleteCascade-1957490773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.327s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:39 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-47f30fa9-e967-48d8-bee7-38ebb693d0c2 tempest-VolumesDeleteCascade-1957490773 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:55:39 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-47f30fa9-e967-48d8-bee7-38ebb693d0c2 tempest-VolumesDeleteCascade-1957490773 None] Deleted volume successfully. Sep 08 06:55:39 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-47f30fa9-e967-48d8-bee7-38ebb693d0c2 tempest-VolumesDeleteCascade-1957490773 None] Lock "cinder-73b88bdb-7b01-4bcc-914b-a268b222e8c3-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:55:43 devstack cinder-volume[87507]: INFO cinder.volume.manager [req-cdd8f86c-0dbe-4336-b76b-bfb9c1aff7fe req-d376f4cd-7fc5-4830-a520-100fd9f4dd20 tempest-TestServerVolumeAttachScenarioOldVersion-70037735 None] Terminate volume connection completed successfully. Sep 08 06:55:43 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-cdd8f86c-0dbe-4336-b76b-bfb9c1aff7fe req-d376f4cd-7fc5-4830-a520-100fd9f4dd20 tempest-TestServerVolumeAttachScenarioOldVersion-70037735 None] Deleting attachment df2e70f7-1aeb-4531-ae48-93b6ea7e5aad. {{(pid=87507) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 06:55:43 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb3f2963-b4bb-4ae4-994c-5aa61d8f4a10 tempest-VolumesCloneTest-1943909079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:55:43 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-eb3f2963-b4bb-4ae4-994c-5aa61d8f4a10 tempest-VolumesCloneTest-1943909079 None] Flow 'volume_create_manager' (9f13b95a-78c6-4f15-8b59-564a28116ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:55:43 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-eb3f2963-b4bb-4ae4-994c-5aa61d8f4a10 tempest-VolumesCloneTest-1943909079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0b1d5b3-36ba-4e24-8157-02d86a7ec094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:55:43 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-eb3f2963-b4bb-4ae4-994c-5aa61d8f4a10 tempest-VolumesCloneTest-1943909079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0b1d5b3-36ba-4e24-8157-02d86a7ec094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-291434911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ac73461-b108-4390-9d49-c8a6a9fa2e36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff4dffbfa2c84f03b9b6bd925f6f685e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:55:44Z,use_quota=True,user_id='526d9cba848a4816842586c2a02d95d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:55:43 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-eb3f2963-b4bb-4ae4-994c-5aa61d8f4a10 tempest-VolumesCloneTest-1943909079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69b935d9-a4a1-416b-b6dc-29ac212d9a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:55:43 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-eb3f2963-b4bb-4ae4-994c-5aa61d8f4a10 tempest-VolumesCloneTest-1943909079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69b935d9-a4a1-416b-b6dc-29ac212d9a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:55:43 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-eb3f2963-b4bb-4ae4-994c-5aa61d8f4a10 tempest-VolumesCloneTest-1943909079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67db120e-cf6c-44c2-8aa5-b8b6139fcd45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:55:43 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-eb3f2963-b4bb-4ae4-994c-5aa61d8f4a10 tempest-VolumesCloneTest-1943909079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67db120e-cf6c-44c2-8aa5-b8b6139fcd45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ac73461-b108-4390-9d49-c8a6a9fa2e36', 'volume_name': 'volume-6ac73461-b108-4390-9d49-c8a6a9fa2e36', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:55:43 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-eb3f2963-b4bb-4ae4-994c-5aa61d8f4a10 tempest-VolumesCloneTest-1943909079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18cd957b-3663-43c2-95b3-3383df60c33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:55:43 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-eb3f2963-b4bb-4ae4-994c-5aa61d8f4a10 tempest-VolumesCloneTest-1943909079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18cd957b-3663-43c2-95b3-3383df60c33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:55:43 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-eb3f2963-b4bb-4ae4-994c-5aa61d8f4a10 tempest-VolumesCloneTest-1943909079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ad0df4b-e7a8-44d7-9941-11901f7f1716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:55:43 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-eb3f2963-b4bb-4ae4-994c-5aa61d8f4a10 tempest-VolumesCloneTest-1943909079 None] Volume 6ac73461-b108-4390-9d49-c8a6a9fa2e36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ac73461-b108-4390-9d49-c8a6a9fa2e36', 'volume_size': 1} Sep 08 06:55:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-eb3f2963-b4bb-4ae4-994c-5aa61d8f4a10 tempest-VolumesCloneTest-1943909079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:55:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-eb3f2963-b4bb-4ae4-994c-5aa61d8f4a10 tempest-VolumesCloneTest-1943909079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:55:43 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-eb3f2963-b4bb-4ae4-994c-5aa61d8f4a10 tempest-VolumesCloneTest-1943909079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-291434911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ac73461-b108-4390-9d49-c8a6a9fa2e36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff4dffbfa2c84f03b9b6bd925f6f685e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:55:44Z,use_quota=True,user_id='526d9cba848a4816842586c2a02d95d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:55:43 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-eb3f2963-b4bb-4ae4-994c-5aa61d8f4a10 tempest-VolumesCloneTest-1943909079 None] Creating volume 6ac73461-b108-4390-9d49-c8a6a9fa2e36 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:55:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-eb3f2963-b4bb-4ae4-994c-5aa61d8f4a10 tempest-VolumesCloneTest-1943909079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:55:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-eb3f2963-b4bb-4ae4-994c-5aa61d8f4a10 tempest-VolumesCloneTest-1943909079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:55:43 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-eb3f2963-b4bb-4ae4-994c-5aa61d8f4a10 tempest-VolumesCloneTest-1943909079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:55:43 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-eb3f2963-b4bb-4ae4-994c-5aa61d8f4a10 tempest-VolumesCloneTest-1943909079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:55:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-eb3f2963-b4bb-4ae4-994c-5aa61d8f4a10 tempest-VolumesCloneTest-1943909079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:55:43 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-eb3f2963-b4bb-4ae4-994c-5aa61d8f4a10 tempest-VolumesCloneTest-1943909079 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:55:43 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-eb3f2963-b4bb-4ae4-994c-5aa61d8f4a10 tempest-VolumesCloneTest-1943909079 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:55:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-eb3f2963-b4bb-4ae4-994c-5aa61d8f4a10 tempest-VolumesCloneTest-1943909079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6ac73461-b108-4390-9d49-c8a6a9fa2e36 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:43 devstack sudo[111129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6ac73461-b108-4390-9d49-c8a6a9fa2e36 1073741824 Sep 08 06:55:43 devstack sudo[111129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:44 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-7852ef00-1ec4-45cc-a52e-d65ed029ae97 tempest-TestServerVolumeAttachScenarioOldVersion-70037735 None] Acquiring lock "cinder-5b07bd05-5d49-49ca-abfe-f73cbbc818a6-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:55:44 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-7852ef00-1ec4-45cc-a52e-d65ed029ae97 tempest-TestServerVolumeAttachScenarioOldVersion-70037735 None] Lock "cinder-5b07bd05-5d49-49ca-abfe-f73cbbc818a6-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:55:44 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-7852ef00-1ec4-45cc-a52e-d65ed029ae97 tempest-TestServerVolumeAttachScenarioOldVersion-70037735 None] Acquiring lock "cinder-quobyte-5b07bd05-5d49-49ca-abfe-f73cbbc818a6" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:55:44 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-7852ef00-1ec4-45cc-a52e-d65ed029ae97 tempest-TestServerVolumeAttachScenarioOldVersion-70037735 None] Lock "cinder-quobyte-5b07bd05-5d49-49ca-abfe-f73cbbc818a6" acquired by "delete_volume" :: waited 0.018s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:55:44 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3cf66ad-5afa-4f5e-9684-e457809b3519]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:55:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7852ef00-1ec4-45cc-a52e-d65ed029ae97 tempest-TestServerVolumeAttachScenarioOldVersion-70037735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5b07bd05-5d49-49ca-abfe-f73cbbc818a6 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:44 devstack sudo[111143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5b07bd05-5d49-49ca-abfe-f73cbbc818a6 Sep 08 06:55:44 devstack sudo[111143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:44 devstack sudo[111129]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-eb3f2963-b4bb-4ae4-994c-5aa61d8f4a10 tempest-VolumesCloneTest-1943909079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6ac73461-b108-4390-9d49-c8a6a9fa2e36 1073741824" returned: 0 in 0.520s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-eb3f2963-b4bb-4ae4-994c-5aa61d8f4a10 tempest-VolumesCloneTest-1943909079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6ac73461-b108-4390-9d49-c8a6a9fa2e36 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:44 devstack sudo[111155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6ac73461-b108-4390-9d49-c8a6a9fa2e36 Sep 08 06:55:44 devstack sudo[111155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:44 devstack sudo[111143]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7852ef00-1ec4-45cc-a52e-d65ed029ae97 tempest-TestServerVolumeAttachScenarioOldVersion-70037735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5b07bd05-5d49-49ca-abfe-f73cbbc818a6" returned: 0 in 0.436s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7852ef00-1ec4-45cc-a52e-d65ed029ae97 tempest-TestServerVolumeAttachScenarioOldVersion-70037735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5b07bd05-5d49-49ca-abfe-f73cbbc818a6 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:44 devstack sudo[111165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5b07bd05-5d49-49ca-abfe-f73cbbc818a6 Sep 08 06:55:44 devstack sudo[111165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:44 devstack sudo[111155]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-eb3f2963-b4bb-4ae4-994c-5aa61d8f4a10 tempest-VolumesCloneTest-1943909079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6ac73461-b108-4390-9d49-c8a6a9fa2e36" returned: 0 in 0.314s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:44 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-eb3f2963-b4bb-4ae4-994c-5aa61d8f4a10 tempest-VolumesCloneTest-1943909079 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:55:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-eb3f2963-b4bb-4ae4-994c-5aa61d8f4a10 tempest-VolumesCloneTest-1943909079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:55:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-eb3f2963-b4bb-4ae4-994c-5aa61d8f4a10 tempest-VolumesCloneTest-1943909079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ad0df4b-e7a8-44d7-9941-11901f7f1716) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ac73461-b108-4390-9d49-c8a6a9fa2e36', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:55:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-eb3f2963-b4bb-4ae4-994c-5aa61d8f4a10 tempest-VolumesCloneTest-1943909079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cafa695b-4e7b-45b4-9be9-26971c2fabb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:55:44 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-eb3f2963-b4bb-4ae4-994c-5aa61d8f4a10 tempest-VolumesCloneTest-1943909079 None] Volume volume-6ac73461-b108-4390-9d49-c8a6a9fa2e36 (6ac73461-b108-4390-9d49-c8a6a9fa2e36): created successfully Sep 08 06:55:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-eb3f2963-b4bb-4ae4-994c-5aa61d8f4a10 tempest-VolumesCloneTest-1943909079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cafa695b-4e7b-45b4-9be9-26971c2fabb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:55:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-eb3f2963-b4bb-4ae4-994c-5aa61d8f4a10 tempest-VolumesCloneTest-1943909079 None] Flow 'volume_create_manager' (9f13b95a-78c6-4f15-8b59-564a28116ed5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:55:44 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-eb3f2963-b4bb-4ae4-994c-5aa61d8f4a10 tempest-VolumesCloneTest-1943909079 None] Created volume successfully. Sep 08 06:55:44 devstack sudo[111165]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7852ef00-1ec4-45cc-a52e-d65ed029ae97 tempest-TestServerVolumeAttachScenarioOldVersion-70037735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5b07bd05-5d49-49ca-abfe-f73cbbc818a6" returned: 0 in 0.290s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:44 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-7852ef00-1ec4-45cc-a52e-d65ed029ae97 tempest-TestServerVolumeAttachScenarioOldVersion-70037735 None] Lock "cinder-quobyte-5b07bd05-5d49-49ca-abfe-f73cbbc818a6" released by "delete_volume" :: held 0.771s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:55:45 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-7852ef00-1ec4-45cc-a52e-d65ed029ae97 tempest-TestServerVolumeAttachScenarioOldVersion-70037735 None] Created reservations ['e019a1c7-c988-406e-9d3a-dabd1db4dfd3', '21f92517-518e-4795-b183-19b949ced405', 'a1d43907-60e5-4f9e-9aab-2f59f12a5c0e', 'e4bda7a9-d2ba-440a-82a7-79239b3e1026'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:55:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-7852ef00-1ec4-45cc-a52e-d65ed029ae97 tempest-TestServerVolumeAttachScenarioOldVersion-70037735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:55:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-7852ef00-1ec4-45cc-a52e-d65ed029ae97 tempest-TestServerVolumeAttachScenarioOldVersion-70037735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:55:45 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-7852ef00-1ec4-45cc-a52e-d65ed029ae97 tempest-TestServerVolumeAttachScenarioOldVersion-70037735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:55:45 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-7852ef00-1ec4-45cc-a52e-d65ed029ae97 tempest-TestServerVolumeAttachScenarioOldVersion-70037735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:55:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-7852ef00-1ec4-45cc-a52e-d65ed029ae97 tempest-TestServerVolumeAttachScenarioOldVersion-70037735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:55:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7852ef00-1ec4-45cc-a52e-d65ed029ae97 tempest-TestServerVolumeAttachScenarioOldVersion-70037735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:45 devstack sudo[111182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:55:45 devstack sudo[111182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:45 devstack sudo[111182]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7852ef00-1ec4-45cc-a52e-d65ed029ae97 tempest-TestServerVolumeAttachScenarioOldVersion-70037735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.294s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:45 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-7852ef00-1ec4-45cc-a52e-d65ed029ae97 tempest-TestServerVolumeAttachScenarioOldVersion-70037735 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:55:45 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-7852ef00-1ec4-45cc-a52e-d65ed029ae97 tempest-TestServerVolumeAttachScenarioOldVersion-70037735 None] Deleted volume successfully. Sep 08 06:55:45 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-7852ef00-1ec4-45cc-a52e-d65ed029ae97 tempest-TestServerVolumeAttachScenarioOldVersion-70037735 None] Lock "cinder-5b07bd05-5d49-49ca-abfe-f73cbbc818a6-delete_volume" released by "delete_volume" :: held 1.347s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:55:46 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:55:46 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] Flow 'volume_create_manager' (060a8cd4-d970-44ea-8357-d09522034fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:55:46 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97be1398-a553-42e2-9f56-b99b48f14649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:55:46 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97be1398-a553-42e2-9f56-b99b48f14649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:55:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2147460548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12bccf53-6b57-4cbe-9e9a-6489c8acff7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff4dffbfa2c84f03b9b6bd925f6f685e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:55:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=6ac73461-b108-4390-9d49-c8a6a9fa2e36,status='creating',terminated_at=None,updated_at=2026-09-08T04:55:47Z,use_quota=True,user_id='526d9cba848a4816842586c2a02d95d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:55:46 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50479735-673d-49ab-8cd4-bec97725dced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:55:46 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50479735-673d-49ab-8cd4-bec97725dced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:55:46 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64854fa4-be20-41aa-b098-d5ffc76d01f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:55:46 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64854fa4-be20-41aa-b098-d5ffc76d01f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '12bccf53-6b57-4cbe-9e9a-6489c8acff7c', 'volume_name': 'volume-12bccf53-6b57-4cbe-9e9a-6489c8acff7c', 'volume_size': 2, 'source_volid': '6ac73461-b108-4390-9d49-c8a6a9fa2e36', 'source_volstatus': 'available'}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:55:46 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f53591e7-7b8e-4887-8c6a-e7928098f831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:55:46 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f53591e7-7b8e-4887-8c6a-e7928098f831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:55:46 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ddb4efd-f1cd-4fd8-940d-8a269639a882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:55:46 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] Volume 12bccf53-6b57-4cbe-9e9a-6489c8acff7c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-12bccf53-6b57-4cbe-9e9a-6489c8acff7c', 'volume_size': 2, 'source_volid': '6ac73461-b108-4390-9d49-c8a6a9fa2e36', 'source_volstatus': 'available'} Sep 08 06:55:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:55:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:55:46 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] Cloning volume 6ac73461-b108-4390-9d49-c8a6a9fa2e36 to volume 12bccf53-6b57-4cbe-9e9a-6489c8acff7c Sep 08 06:55:46 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] Creating offline snapshot df0d8535-67a2-44de-ab37-a9cffc82f856 of volume 6ac73461-b108-4390-9d49-c8a6a9fa2e36 {{(pid=87507) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 06:55:47 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[87847e0a-d666-4753-9954-1539943fcc66]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:55:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6ac73461-b108-4390-9d49-c8a6a9fa2e36 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:47 devstack sudo[111256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6ac73461-b108-4390-9d49-c8a6a9fa2e36 Sep 08 06:55:47 devstack sudo[111256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:47 devstack sudo[111256]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6ac73461-b108-4390-9d49-c8a6a9fa2e36" returned: 0 in 0.522s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6ac73461-b108-4390-9d49-c8a6a9fa2e36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6ac73461-b108-4390-9d49-c8a6a9fa2e36.df0d8535-67a2-44de-ab37-a9cffc82f856 1G {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:47 devstack sudo[111278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6ac73461-b108-4390-9d49-c8a6a9fa2e36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6ac73461-b108-4390-9d49-c8a6a9fa2e36.df0d8535-67a2-44de-ab37-a9cffc82f856 1G Sep 08 06:55:47 devstack sudo[111278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:48 devstack sudo[111278]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6ac73461-b108-4390-9d49-c8a6a9fa2e36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6ac73461-b108-4390-9d49-c8a6a9fa2e36.df0d8535-67a2-44de-ab37-a9cffc82f856 1G" returned: 0 in 0.551s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ac73461-b108-4390-9d49-c8a6a9fa2e36 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6ac73461-b108-4390-9d49-c8a6a9fa2e36.df0d8535-67a2-44de-ab37-a9cffc82f856 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:48 devstack sudo[111301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ac73461-b108-4390-9d49-c8a6a9fa2e36 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6ac73461-b108-4390-9d49-c8a6a9fa2e36.df0d8535-67a2-44de-ab37-a9cffc82f856 Sep 08 06:55:48 devstack sudo[111301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:48 devstack sudo[111301]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ac73461-b108-4390-9d49-c8a6a9fa2e36 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6ac73461-b108-4390-9d49-c8a6a9fa2e36.df0d8535-67a2-44de-ab37-a9cffc82f856" returned: 0 in 0.426s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:48 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6ac73461-b108-4390-9d49-c8a6a9fa2e36.df0d8535-67a2-44de-ab37-a9cffc82f856 is being set with open permissions: ugo+rw Sep 08 06:55:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6ac73461-b108-4390-9d49-c8a6a9fa2e36.df0d8535-67a2-44de-ab37-a9cffc82f856 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:48 devstack sudo[111320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6ac73461-b108-4390-9d49-c8a6a9fa2e36.df0d8535-67a2-44de-ab37-a9cffc82f856 Sep 08 06:55:48 devstack sudo[111320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:48 devstack sudo[111320]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6ac73461-b108-4390-9d49-c8a6a9fa2e36.df0d8535-67a2-44de-ab37-a9cffc82f856" returned: 0 in 0.363s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6ac73461-b108-4390-9d49-c8a6a9fa2e36.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:48 devstack sudo[111336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6ac73461-b108-4390-9d49-c8a6a9fa2e36.info Sep 08 06:55:48 devstack sudo[111336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:49 devstack sudo[111336]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6ac73461-b108-4390-9d49-c8a6a9fa2e36.info" returned: 0 in 0.312s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:49 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6ac73461-b108-4390-9d49-c8a6a9fa2e36.info is being set with open permissions: ugo+rw Sep 08 06:55:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6ac73461-b108-4390-9d49-c8a6a9fa2e36.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:49 devstack sudo[111348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6ac73461-b108-4390-9d49-c8a6a9fa2e36.info Sep 08 06:55:49 devstack sudo[111348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:49 devstack sudo[111348]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6ac73461-b108-4390-9d49-c8a6a9fa2e36.info" returned: 0 in 0.283s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:49 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] Acquiring lock "cinder-quobyte-12bccf53-6b57-4cbe-9e9a-6489c8acff7c" by "_copy_volume_from_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:55:49 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] Lock "cinder-quobyte-12bccf53-6b57-4cbe-9e9a-6489c8acff7c" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:55:49 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] snapshot: df0d8535-67a2-44de-ab37-a9cffc82f856, volume: 12bccf53-6b57-4cbe-9e9a-6489c8acff7c, {{(pid=87507) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 08 06:55:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:55:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:55:49 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:55:49 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:55:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:55:49 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[10612412-e681-488d-ac97-b47dfbf5a9e8]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:55:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6ac73461-b108-4390-9d49-c8a6a9fa2e36.df0d8535-67a2-44de-ab37-a9cffc82f856 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:49 devstack sudo[111363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6ac73461-b108-4390-9d49-c8a6a9fa2e36.df0d8535-67a2-44de-ab37-a9cffc82f856 Sep 08 06:55:49 devstack sudo[111363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:50 devstack sudo[111363]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6ac73461-b108-4390-9d49-c8a6a9fa2e36.df0d8535-67a2-44de-ab37-a9cffc82f856" returned: 0 in 0.491s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:50 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ac73461-b108-4390-9d49-c8a6a9fa2e36(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 06:55:50 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d431338-e7d3-4b97-bdc3-8128fdcd172d]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:55:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6ac73461-b108-4390-9d49-c8a6a9fa2e36 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:50 devstack sudo[111386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6ac73461-b108-4390-9d49-c8a6a9fa2e36 Sep 08 06:55:50 devstack sudo[111386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:50 devstack sudo[111386]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6ac73461-b108-4390-9d49-c8a6a9fa2e36" returned: 0 in 0.400s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:50 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] will copy from snapshot at /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6ac73461-b108-4390-9d49-c8a6a9fa2e36 {{(pid=87507) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 08 06:55:50 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] Creating direct copy from snapshot {{(pid=87507) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 08 06:55:50 devstack cinder-volume[87507]: DEBUG cinder.utils [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] Path /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12bccf53-6b57-4cbe-9e9a-6489c8acff7c not found in is_blk_device check {{(pid=87507) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 08 06:55:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6ac73461-b108-4390-9d49-c8a6a9fa2e36 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12bccf53-6b57-4cbe-9e9a-6489c8acff7c {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:50 devstack sudo[111403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6ac73461-b108-4390-9d49-c8a6a9fa2e36 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12bccf53-6b57-4cbe-9e9a-6489c8acff7c Sep 08 06:55:50 devstack sudo[111403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:56 devstack sudo[111403]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6ac73461-b108-4390-9d49-c8a6a9fa2e36 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12bccf53-6b57-4cbe-9e9a-6489c8acff7c" returned: 0 in 5.936s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:56 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] Image conversion details: src /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6ac73461-b108-4390-9d49-c8a6a9fa2e36, size 1024.00 MB, duration 5.94 sec, destination /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12bccf53-6b57-4cbe-9e9a-6489c8acff7c {{(pid=87507) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 06:55:56 devstack cinder-volume[87507]: INFO cinder.image.image_utils [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] Converted 1024.00 MB image at 172.46 MB/s Sep 08 06:55:56 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12bccf53-6b57-4cbe-9e9a-6489c8acff7c is being set with open permissions: ugo+rw Sep 08 06:55:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12bccf53-6b57-4cbe-9e9a-6489c8acff7c {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:56 devstack sudo[111592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12bccf53-6b57-4cbe-9e9a-6489c8acff7c Sep 08 06:55:56 devstack sudo[111592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:56 devstack sudo[111592]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12bccf53-6b57-4cbe-9e9a-6489c8acff7c" returned: 0 in 0.292s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:56 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] Lock "cinder-quobyte-12bccf53-6b57-4cbe-9e9a-6489c8acff7c" released by "_copy_volume_from_snapshot" :: held 7.210s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:55:56 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] Acquiring lock "cinder-quobyte-df0d8535-67a2-44de-ab37-a9cffc82f856" by "_delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:55:56 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] Lock "cinder-quobyte-df0d8535-67a2-44de-ab37-a9cffc82f856" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:55:56 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] Deleting offline snapshot df0d8535-67a2-44de-ab37-a9cffc82f856 of volume 6ac73461-b108-4390-9d49-c8a6a9fa2e36 {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 06:55:56 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] snapshot_file for this snap is: volume-6ac73461-b108-4390-9d49-c8a6a9fa2e36.df0d8535-67a2-44de-ab37-a9cffc82f856 {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 06:55:56 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d39d4a-7dfe-441e-be1b-db7aa5c1a3b7]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:55:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6ac73461-b108-4390-9d49-c8a6a9fa2e36.df0d8535-67a2-44de-ab37-a9cffc82f856 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:57 devstack sudo[111607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6ac73461-b108-4390-9d49-c8a6a9fa2e36.df0d8535-67a2-44de-ab37-a9cffc82f856 Sep 08 06:55:57 devstack sudo[111607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:57 devstack sudo[111607]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:57 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6ac73461-b108-4390-9d49-c8a6a9fa2e36.df0d8535-67a2-44de-ab37-a9cffc82f856" returned: 0 in 0.429s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:57 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ac73461-b108-4390-9d49-c8a6a9fa2e36(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 06:55:57 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a3a632-663b-48ab-a832-8fda357bffc5]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:55:57 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6ac73461-b108-4390-9d49-c8a6a9fa2e36 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:57 devstack sudo[111627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6ac73461-b108-4390-9d49-c8a6a9fa2e36 Sep 08 06:55:57 devstack sudo[111627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:57 devstack sudo[111627]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:57 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6ac73461-b108-4390-9d49-c8a6a9fa2e36" returned: 0 in 0.603s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:57 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6ac73461-b108-4390-9d49-c8a6a9fa2e36.df0d8535-67a2-44de-ab37-a9cffc82f856 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:57 devstack sudo[111650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6ac73461-b108-4390-9d49-c8a6a9fa2e36.df0d8535-67a2-44de-ab37-a9cffc82f856 Sep 08 06:55:57 devstack sudo[111650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:58 devstack sudo[111650]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:58 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6ac73461-b108-4390-9d49-c8a6a9fa2e36.df0d8535-67a2-44de-ab37-a9cffc82f856" returned: 0 in 0.372s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:58 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6ac73461-b108-4390-9d49-c8a6a9fa2e36.df0d8535-67a2-44de-ab37-a9cffc82f856 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:58 devstack sudo[111666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6ac73461-b108-4390-9d49-c8a6a9fa2e36.df0d8535-67a2-44de-ab37-a9cffc82f856 Sep 08 06:55:58 devstack sudo[111666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:55:58 devstack sudo[111666]: pam_unix(sudo:session): session closed for user root Sep 08 06:55:58 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6ac73461-b108-4390-9d49-c8a6a9fa2e36.df0d8535-67a2-44de-ab37-a9cffc82f856" returned: 0 in 0.268s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:55:58 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] Lock "cinder-quobyte-df0d8535-67a2-44de-ab37-a9cffc82f856" released by "_delete_snapshot" :: held 1.789s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:55:58 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.743s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:55:58 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ddb4efd-f1cd-4fd8-940d-8a269639a882) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12bccf53-6b57-4cbe-9e9a-6489c8acff7c', 'volume_size': 2, 'source_volid': '6ac73461-b108-4390-9d49-c8a6a9fa2e36', 'source_volstatus': 'available'}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:55:58 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be9fcb5b-86ec-4214-b699-df8159cf327a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:55:58 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] Volume volume-12bccf53-6b57-4cbe-9e9a-6489c8acff7c (12bccf53-6b57-4cbe-9e9a-6489c8acff7c): created successfully Sep 08 06:55:58 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be9fcb5b-86ec-4214-b699-df8159cf327a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:55:58 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] Flow 'volume_create_manager' (060a8cd4-d970-44ea-8357-d09522034fbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:55:58 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-449402b3-9798-4d4f-9fdd-fd1bf040f68f tempest-VolumesCloneTest-1943909079 None] Created volume successfully. Sep 08 06:55:59 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-6a8b71b9-0128-4c34-b2ad-a12a7412a639 tempest-VolumesCloneTest-1943909079 None] Acquiring lock "cinder-12bccf53-6b57-4cbe-9e9a-6489c8acff7c-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:55:59 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-6a8b71b9-0128-4c34-b2ad-a12a7412a639 tempest-VolumesCloneTest-1943909079 None] Lock "cinder-12bccf53-6b57-4cbe-9e9a-6489c8acff7c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:55:59 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-6a8b71b9-0128-4c34-b2ad-a12a7412a639 tempest-VolumesCloneTest-1943909079 None] Acquiring lock "cinder-quobyte-12bccf53-6b57-4cbe-9e9a-6489c8acff7c" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:55:59 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-6a8b71b9-0128-4c34-b2ad-a12a7412a639 tempest-VolumesCloneTest-1943909079 None] Lock "cinder-quobyte-12bccf53-6b57-4cbe-9e9a-6489c8acff7c" acquired by "delete_volume" :: waited 0.018s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:55:59 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[44103533-ca3c-4f0f-8470-fc3b81bc6bfb]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:55:59 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6a8b71b9-0128-4c34-b2ad-a12a7412a639 tempest-VolumesCloneTest-1943909079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12bccf53-6b57-4cbe-9e9a-6489c8acff7c {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:55:59 devstack sudo[111709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12bccf53-6b57-4cbe-9e9a-6489c8acff7c Sep 08 06:55:59 devstack sudo[111709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:00 devstack sudo[111709]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6a8b71b9-0128-4c34-b2ad-a12a7412a639 tempest-VolumesCloneTest-1943909079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12bccf53-6b57-4cbe-9e9a-6489c8acff7c" returned: 0 in 0.446s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6a8b71b9-0128-4c34-b2ad-a12a7412a639 tempest-VolumesCloneTest-1943909079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12bccf53-6b57-4cbe-9e9a-6489c8acff7c {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:00 devstack sudo[111728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12bccf53-6b57-4cbe-9e9a-6489c8acff7c Sep 08 06:56:00 devstack sudo[111728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:00 devstack sudo[111728]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6a8b71b9-0128-4c34-b2ad-a12a7412a639 tempest-VolumesCloneTest-1943909079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12bccf53-6b57-4cbe-9e9a-6489c8acff7c" returned: 0 in 0.275s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:00 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-6a8b71b9-0128-4c34-b2ad-a12a7412a639 tempest-VolumesCloneTest-1943909079 None] Lock "cinder-quobyte-12bccf53-6b57-4cbe-9e9a-6489c8acff7c" released by "delete_volume" :: held 0.778s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:56:00 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-6a8b71b9-0128-4c34-b2ad-a12a7412a639 tempest-VolumesCloneTest-1943909079 None] Created reservations ['79da3a5c-d88d-4e26-ad4c-660ff951c70a', '3d1e332a-a01c-4f30-b87b-14a8c82c650a', '1f79c098-b96a-42e3-b737-7ac0f73db02c', '1be5965a-3a05-4f1c-ab5b-63233cb874b5'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:56:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-6a8b71b9-0128-4c34-b2ad-a12a7412a639 tempest-VolumesCloneTest-1943909079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:56:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-6a8b71b9-0128-4c34-b2ad-a12a7412a639 tempest-VolumesCloneTest-1943909079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:56:00 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-6a8b71b9-0128-4c34-b2ad-a12a7412a639 tempest-VolumesCloneTest-1943909079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:56:00 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-6a8b71b9-0128-4c34-b2ad-a12a7412a639 tempest-VolumesCloneTest-1943909079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:56:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-6a8b71b9-0128-4c34-b2ad-a12a7412a639 tempest-VolumesCloneTest-1943909079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:56:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6a8b71b9-0128-4c34-b2ad-a12a7412a639 tempest-VolumesCloneTest-1943909079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:00 devstack sudo[111746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:56:00 devstack sudo[111746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:00 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-0bd168f1-b875-4ef1-95a6-edde9cd0e687 tempest-VolumesCloneTest-1943909079 None] Acquiring lock "cinder-6ac73461-b108-4390-9d49-c8a6a9fa2e36-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:56:00 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-0bd168f1-b875-4ef1-95a6-edde9cd0e687 tempest-VolumesCloneTest-1943909079 None] Lock "cinder-6ac73461-b108-4390-9d49-c8a6a9fa2e36-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:56:00 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-0bd168f1-b875-4ef1-95a6-edde9cd0e687 tempest-VolumesCloneTest-1943909079 None] Acquiring lock "cinder-quobyte-6ac73461-b108-4390-9d49-c8a6a9fa2e36" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:56:00 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-0bd168f1-b875-4ef1-95a6-edde9cd0e687 tempest-VolumesCloneTest-1943909079 None] Lock "cinder-quobyte-6ac73461-b108-4390-9d49-c8a6a9fa2e36" acquired by "delete_volume" :: waited 0.040s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:56:00 devstack sudo[111746]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6a8b71b9-0128-4c34-b2ad-a12a7412a639 tempest-VolumesCloneTest-1943909079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.531s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:01 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-6a8b71b9-0128-4c34-b2ad-a12a7412a639 tempest-VolumesCloneTest-1943909079 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:56:01 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[125a528d-7aff-4137-9040-edaf75031a9f]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:56:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0bd168f1-b875-4ef1-95a6-edde9cd0e687 tempest-VolumesCloneTest-1943909079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6ac73461-b108-4390-9d49-c8a6a9fa2e36 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:01 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-6a8b71b9-0128-4c34-b2ad-a12a7412a639 tempest-VolumesCloneTest-1943909079 None] Deleted volume successfully. Sep 08 06:56:01 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-6a8b71b9-0128-4c34-b2ad-a12a7412a639 tempest-VolumesCloneTest-1943909079 None] Lock "cinder-12bccf53-6b57-4cbe-9e9a-6489c8acff7c-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:56:01 devstack sudo[111764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6ac73461-b108-4390-9d49-c8a6a9fa2e36 Sep 08 06:56:01 devstack sudo[111764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:01 devstack sudo[111764]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0bd168f1-b875-4ef1-95a6-edde9cd0e687 tempest-VolumesCloneTest-1943909079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6ac73461-b108-4390-9d49-c8a6a9fa2e36" returned: 0 in 0.423s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0bd168f1-b875-4ef1-95a6-edde9cd0e687 tempest-VolumesCloneTest-1943909079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6ac73461-b108-4390-9d49-c8a6a9fa2e36 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:01 devstack sudo[111781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6ac73461-b108-4390-9d49-c8a6a9fa2e36 Sep 08 06:56:01 devstack sudo[111781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:01 devstack sudo[111781]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0bd168f1-b875-4ef1-95a6-edde9cd0e687 tempest-VolumesCloneTest-1943909079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-6ac73461-b108-4390-9d49-c8a6a9fa2e36" returned: 0 in 0.274s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:01 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-0bd168f1-b875-4ef1-95a6-edde9cd0e687 tempest-VolumesCloneTest-1943909079 None] Lock "cinder-quobyte-6ac73461-b108-4390-9d49-c8a6a9fa2e36" released by "delete_volume" :: held 0.805s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:56:01 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-0bd168f1-b875-4ef1-95a6-edde9cd0e687 tempest-VolumesCloneTest-1943909079 None] Created reservations ['b5b1bace-c7a9-4eef-988c-fabeccc18455', '8ce207e8-baf9-46ce-83f3-bba184d7116b', 'dc8afde4-baaa-4316-aff8-554291551c44', '4871d403-fcea-439b-9c96-93e357ebaaf7'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:56:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-0bd168f1-b875-4ef1-95a6-edde9cd0e687 tempest-VolumesCloneTest-1943909079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:56:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-0bd168f1-b875-4ef1-95a6-edde9cd0e687 tempest-VolumesCloneTest-1943909079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:56:01 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-0bd168f1-b875-4ef1-95a6-edde9cd0e687 tempest-VolumesCloneTest-1943909079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:56:01 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-0bd168f1-b875-4ef1-95a6-edde9cd0e687 tempest-VolumesCloneTest-1943909079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:56:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-0bd168f1-b875-4ef1-95a6-edde9cd0e687 tempest-VolumesCloneTest-1943909079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:56:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0bd168f1-b875-4ef1-95a6-edde9cd0e687 tempest-VolumesCloneTest-1943909079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:01 devstack sudo[111799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:56:01 devstack sudo[111799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:02 devstack sudo[111799]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:02 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0bd168f1-b875-4ef1-95a6-edde9cd0e687 tempest-VolumesCloneTest-1943909079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.383s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:02 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-0bd168f1-b875-4ef1-95a6-edde9cd0e687 tempest-VolumesCloneTest-1943909079 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:56:02 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-0bd168f1-b875-4ef1-95a6-edde9cd0e687 tempest-VolumesCloneTest-1943909079 None] Deleted volume successfully. Sep 08 06:56:02 devstack cinder-volume[87507]: DEBUG dbcounter [-] [87507] Writing DB stats cinder:SELECT=101,cinder:UPDATE=126,cinder:DELETE=10,cinder:INSERT=21 {{(pid=87507) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 06:56:02 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-0bd168f1-b875-4ef1-95a6-edde9cd0e687 tempest-VolumesCloneTest-1943909079 None] Lock "cinder-6ac73461-b108-4390-9d49-c8a6a9fa2e36-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:56:09 devstack cinder-volume[87507]: DEBUG dbcounter [-] [87507] Writing DB stats cinder:UPDATE=91,cinder:SELECT=109,cinder:INSERT=33,cinder:DELETE=7 {{(pid=87507) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 06:56:09 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-164cb0df-faed-4e8e-9987-5a54298be35c tempest-TestStampPattern-1549278103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:56:09 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-164cb0df-faed-4e8e-9987-5a54298be35c tempest-TestStampPattern-1549278103 None] Flow 'volume_create_manager' (7b8398c3-186c-4f14-b239-7b7e739bb30b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:56:09 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-164cb0df-faed-4e8e-9987-5a54298be35c tempest-TestStampPattern-1549278103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce2fd24d-9447-41c1-a09a-18ef4aefe3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:09 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-164cb0df-faed-4e8e-9987-5a54298be35c tempest-TestStampPattern-1549278103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce2fd24d-9447-41c1-a09a-18ef4aefe3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:56:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2023358854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d59d0b6e-b8f7-4d08-aff1-01260306dacb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94827773acae4284bedaaef0f1c0d07d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:56:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:56:09Z,use_quota=True,user_id='17201e1f09684cd29b5e0a5fdc65a3f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:09 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-164cb0df-faed-4e8e-9987-5a54298be35c tempest-TestStampPattern-1549278103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f5492e4-9bdc-472a-bca1-4c756acd4c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:09 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-164cb0df-faed-4e8e-9987-5a54298be35c tempest-TestStampPattern-1549278103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f5492e4-9bdc-472a-bca1-4c756acd4c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:09 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-164cb0df-faed-4e8e-9987-5a54298be35c tempest-TestStampPattern-1549278103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9fcf9f2-52c3-4305-8f03-ec718476dfc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:09 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-164cb0df-faed-4e8e-9987-5a54298be35c tempest-TestStampPattern-1549278103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9fcf9f2-52c3-4305-8f03-ec718476dfc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd59d0b6e-b8f7-4d08-aff1-01260306dacb', 'volume_name': 'volume-d59d0b6e-b8f7-4d08-aff1-01260306dacb', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:09 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-164cb0df-faed-4e8e-9987-5a54298be35c tempest-TestStampPattern-1549278103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee44311c-91da-4ac9-816b-a2cc54e7b9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:09 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-164cb0df-faed-4e8e-9987-5a54298be35c tempest-TestStampPattern-1549278103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee44311c-91da-4ac9-816b-a2cc54e7b9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:09 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-164cb0df-faed-4e8e-9987-5a54298be35c tempest-TestStampPattern-1549278103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee1bf8b3-a402-4e08-971d-8daadc1b1637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:09 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-164cb0df-faed-4e8e-9987-5a54298be35c tempest-TestStampPattern-1549278103 None] Volume d59d0b6e-b8f7-4d08-aff1-01260306dacb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d59d0b6e-b8f7-4d08-aff1-01260306dacb', 'volume_size': 1} Sep 08 06:56:09 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-164cb0df-faed-4e8e-9987-5a54298be35c tempest-TestStampPattern-1549278103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:56:09 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-164cb0df-faed-4e8e-9987-5a54298be35c tempest-TestStampPattern-1549278103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:56:09 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-164cb0df-faed-4e8e-9987-5a54298be35c tempest-TestStampPattern-1549278103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:56:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2023358854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d59d0b6e-b8f7-4d08-aff1-01260306dacb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94827773acae4284bedaaef0f1c0d07d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:56:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:56:09Z,use_quota=True,user_id='17201e1f09684cd29b5e0a5fdc65a3f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:56:09 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-164cb0df-faed-4e8e-9987-5a54298be35c tempest-TestStampPattern-1549278103 None] Creating volume d59d0b6e-b8f7-4d08-aff1-01260306dacb {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:56:09 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-164cb0df-faed-4e8e-9987-5a54298be35c tempest-TestStampPattern-1549278103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:56:09 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-164cb0df-faed-4e8e-9987-5a54298be35c tempest-TestStampPattern-1549278103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:56:09 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-164cb0df-faed-4e8e-9987-5a54298be35c tempest-TestStampPattern-1549278103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:56:09 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-164cb0df-faed-4e8e-9987-5a54298be35c tempest-TestStampPattern-1549278103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:56:09 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-164cb0df-faed-4e8e-9987-5a54298be35c tempest-TestStampPattern-1549278103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:56:09 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-164cb0df-faed-4e8e-9987-5a54298be35c tempest-TestStampPattern-1549278103 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:56:09 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-164cb0df-faed-4e8e-9987-5a54298be35c tempest-TestStampPattern-1549278103 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:56:09 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-164cb0df-faed-4e8e-9987-5a54298be35c tempest-TestStampPattern-1549278103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d59d0b6e-b8f7-4d08-aff1-01260306dacb 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:09 devstack sudo[112033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d59d0b6e-b8f7-4d08-aff1-01260306dacb 1073741824 Sep 08 06:56:09 devstack sudo[112033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:10 devstack sudo[112033]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:10 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-164cb0df-faed-4e8e-9987-5a54298be35c tempest-TestStampPattern-1549278103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d59d0b6e-b8f7-4d08-aff1-01260306dacb 1073741824" returned: 0 in 0.585s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:10 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-164cb0df-faed-4e8e-9987-5a54298be35c tempest-TestStampPattern-1549278103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d59d0b6e-b8f7-4d08-aff1-01260306dacb {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:10 devstack sudo[112060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d59d0b6e-b8f7-4d08-aff1-01260306dacb Sep 08 06:56:10 devstack sudo[112060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:10 devstack sudo[112060]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:10 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-164cb0df-faed-4e8e-9987-5a54298be35c tempest-TestStampPattern-1549278103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d59d0b6e-b8f7-4d08-aff1-01260306dacb" returned: 0 in 0.344s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:10 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-164cb0df-faed-4e8e-9987-5a54298be35c tempest-TestStampPattern-1549278103 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:56:10 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-164cb0df-faed-4e8e-9987-5a54298be35c tempest-TestStampPattern-1549278103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:56:10 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-164cb0df-faed-4e8e-9987-5a54298be35c tempest-TestStampPattern-1549278103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee1bf8b3-a402-4e08-971d-8daadc1b1637) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d59d0b6e-b8f7-4d08-aff1-01260306dacb', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:10 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-164cb0df-faed-4e8e-9987-5a54298be35c tempest-TestStampPattern-1549278103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25867fd8-33cc-4012-abfd-7f89a1363d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:10 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-164cb0df-faed-4e8e-9987-5a54298be35c tempest-TestStampPattern-1549278103 None] Volume volume-d59d0b6e-b8f7-4d08-aff1-01260306dacb (d59d0b6e-b8f7-4d08-aff1-01260306dacb): created successfully Sep 08 06:56:10 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-164cb0df-faed-4e8e-9987-5a54298be35c tempest-TestStampPattern-1549278103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25867fd8-33cc-4012-abfd-7f89a1363d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:10 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-164cb0df-faed-4e8e-9987-5a54298be35c tempest-TestStampPattern-1549278103 None] Flow 'volume_create_manager' (7b8398c3-186c-4f14-b239-7b7e739bb30b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:56:10 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-164cb0df-faed-4e8e-9987-5a54298be35c tempest-TestStampPattern-1549278103 None] Created volume successfully. Sep 08 06:56:11 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d14cb97-b880-4b79-8741-da7760f776b1 tempest-CreateVolumesFromImageTest-1799318689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:56:11 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8d14cb97-b880-4b79-8741-da7760f776b1 tempest-CreateVolumesFromImageTest-1799318689 None] Flow 'volume_create_manager' (0b51b870-13a4-4576-9da5-d55a21b795c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:56:11 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8d14cb97-b880-4b79-8741-da7760f776b1 tempest-CreateVolumesFromImageTest-1799318689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5afe170f-9756-4a39-9f38-1dfd4f18a4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:11 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8d14cb97-b880-4b79-8741-da7760f776b1 tempest-CreateVolumesFromImageTest-1799318689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5afe170f-9756-4a39-9f38-1dfd4f18a4b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:56:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1543376296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d37fb77-ebbb-4321-b5cf-4d4b9f8c1fa0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a27ef59d1b974c8bad9a27f7e3db0786',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:56:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:56:12Z,use_quota=True,user_id='9f0102a110714a9c9c02aa1e63c6bb54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:11 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8d14cb97-b880-4b79-8741-da7760f776b1 tempest-CreateVolumesFromImageTest-1799318689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75859a04-046a-418f-ad8b-9192de8da5c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:11 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8d14cb97-b880-4b79-8741-da7760f776b1 tempest-CreateVolumesFromImageTest-1799318689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75859a04-046a-418f-ad8b-9192de8da5c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:11 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8d14cb97-b880-4b79-8741-da7760f776b1 tempest-CreateVolumesFromImageTest-1799318689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ade3c6d4-d6f0-491c-9f08-c85802f222fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:11 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8d14cb97-b880-4b79-8741-da7760f776b1 tempest-CreateVolumesFromImageTest-1799318689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ade3c6d4-d6f0-491c-9f08-c85802f222fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d37fb77-ebbb-4321-b5cf-4d4b9f8c1fa0', 'volume_name': 'volume-0d37fb77-ebbb-4321-b5cf-4d4b9f8c1fa0', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:11 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8d14cb97-b880-4b79-8741-da7760f776b1 tempest-CreateVolumesFromImageTest-1799318689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (befe5730-ead5-41eb-9fe8-f85dc984dacb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:11 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8d14cb97-b880-4b79-8741-da7760f776b1 tempest-CreateVolumesFromImageTest-1799318689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (befe5730-ead5-41eb-9fe8-f85dc984dacb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:11 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8d14cb97-b880-4b79-8741-da7760f776b1 tempest-CreateVolumesFromImageTest-1799318689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c85348e-84b3-415a-8e07-fc95e199aee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:11 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-8d14cb97-b880-4b79-8741-da7760f776b1 tempest-CreateVolumesFromImageTest-1799318689 None] Volume 0d37fb77-ebbb-4321-b5cf-4d4b9f8c1fa0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d37fb77-ebbb-4321-b5cf-4d4b9f8c1fa0', 'volume_size': 1} Sep 08 06:56:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8d14cb97-b880-4b79-8741-da7760f776b1 tempest-CreateVolumesFromImageTest-1799318689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:56:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8d14cb97-b880-4b79-8741-da7760f776b1 tempest-CreateVolumesFromImageTest-1799318689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:56:11 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8d14cb97-b880-4b79-8741-da7760f776b1 tempest-CreateVolumesFromImageTest-1799318689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:56:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1543376296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d37fb77-ebbb-4321-b5cf-4d4b9f8c1fa0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a27ef59d1b974c8bad9a27f7e3db0786',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:56:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:56:12Z,use_quota=True,user_id='9f0102a110714a9c9c02aa1e63c6bb54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:56:11 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-8d14cb97-b880-4b79-8741-da7760f776b1 tempest-CreateVolumesFromImageTest-1799318689 None] Creating volume 0d37fb77-ebbb-4321-b5cf-4d4b9f8c1fa0 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:56:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8d14cb97-b880-4b79-8741-da7760f776b1 tempest-CreateVolumesFromImageTest-1799318689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:56:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8d14cb97-b880-4b79-8741-da7760f776b1 tempest-CreateVolumesFromImageTest-1799318689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:56:11 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8d14cb97-b880-4b79-8741-da7760f776b1 tempest-CreateVolumesFromImageTest-1799318689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:56:11 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8d14cb97-b880-4b79-8741-da7760f776b1 tempest-CreateVolumesFromImageTest-1799318689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:56:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8d14cb97-b880-4b79-8741-da7760f776b1 tempest-CreateVolumesFromImageTest-1799318689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:56:11 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8d14cb97-b880-4b79-8741-da7760f776b1 tempest-CreateVolumesFromImageTest-1799318689 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:56:11 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-8d14cb97-b880-4b79-8741-da7760f776b1 tempest-CreateVolumesFromImageTest-1799318689 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:56:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8d14cb97-b880-4b79-8741-da7760f776b1 tempest-CreateVolumesFromImageTest-1799318689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0d37fb77-ebbb-4321-b5cf-4d4b9f8c1fa0 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:11 devstack sudo[112109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0d37fb77-ebbb-4321-b5cf-4d4b9f8c1fa0 1073741824 Sep 08 06:56:11 devstack sudo[112109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:12 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab1007dc-1216-4ad6-ba27-2a94dacc4935 tempest-VolumesExtendTest-1511794103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:56:12 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ab1007dc-1216-4ad6-ba27-2a94dacc4935 tempest-VolumesExtendTest-1511794103 None] Flow 'volume_create_manager' (6583ce7a-d720-4ffe-a8b7-0b89c410ff90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:56:12 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ab1007dc-1216-4ad6-ba27-2a94dacc4935 tempest-VolumesExtendTest-1511794103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2664ef30-272f-4775-8c9e-1e9fd1266097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:12 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ab1007dc-1216-4ad6-ba27-2a94dacc4935 tempest-VolumesExtendTest-1511794103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2664ef30-272f-4775-8c9e-1e9fd1266097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:56:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-416373254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8f47f4a-fe67-47ab-8217-86e66c817989,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92f6cd589e8544fc971aa1391189d34d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:56:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:56:12Z,use_quota=True,user_id='d13c663628ef44f296ca96fc4495bbe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:12 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ab1007dc-1216-4ad6-ba27-2a94dacc4935 tempest-VolumesExtendTest-1511794103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bab9b2f-72f0-4c74-bc8b-885754f64d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:12 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ab1007dc-1216-4ad6-ba27-2a94dacc4935 tempest-VolumesExtendTest-1511794103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bab9b2f-72f0-4c74-bc8b-885754f64d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:12 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ab1007dc-1216-4ad6-ba27-2a94dacc4935 tempest-VolumesExtendTest-1511794103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36b0e5fc-8678-4d9f-80c4-96b6e9559f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:12 devstack cinder-volume[87507]: DEBUG cinder.image.glance [None req-ab1007dc-1216-4ad6-ba27-2a94dacc4935 tempest-VolumesExtendTest-1511794103 None] Creating Keystone auth plugin from conf {{(pid=87507) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 08 06:56:12 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8f65d30-d3aa-4a26-ac5e-b50a70843be9 tempest-CreateVolumesFromImageTest-1799318689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:56:12 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-e8f65d30-d3aa-4a26-ac5e-b50a70843be9 tempest-CreateVolumesFromImageTest-1799318689 None] Flow 'volume_create_manager' (e7408edb-703d-46a6-b84a-c926f182d47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:56:12 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-e8f65d30-d3aa-4a26-ac5e-b50a70843be9 tempest-CreateVolumesFromImageTest-1799318689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3958eaa-4c1f-429b-a83e-94505f93bbbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:12 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-e8f65d30-d3aa-4a26-ac5e-b50a70843be9 tempest-CreateVolumesFromImageTest-1799318689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3958eaa-4c1f-429b-a83e-94505f93bbbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:56:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-398185241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eea5c0da-a142-408e-930b-19899a7d08bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a27ef59d1b974c8bad9a27f7e3db0786',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:56:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:56:12Z,use_quota=True,user_id='9f0102a110714a9c9c02aa1e63c6bb54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:12 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-e8f65d30-d3aa-4a26-ac5e-b50a70843be9 tempest-CreateVolumesFromImageTest-1799318689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18bc7002-9cf1-4901-a6e1-c90cbbb1b51a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:12 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-e8f65d30-d3aa-4a26-ac5e-b50a70843be9 tempest-CreateVolumesFromImageTest-1799318689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18bc7002-9cf1-4901-a6e1-c90cbbb1b51a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:12 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-e8f65d30-d3aa-4a26-ac5e-b50a70843be9 tempest-CreateVolumesFromImageTest-1799318689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (417e2a4b-74f0-4c6e-b96e-4bdd91ec46f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:12 devstack sudo[112109]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:12 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-e8f65d30-d3aa-4a26-ac5e-b50a70843be9 tempest-CreateVolumesFromImageTest-1799318689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (417e2a4b-74f0-4c6e-b96e-4bdd91ec46f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eea5c0da-a142-408e-930b-19899a7d08bd', 'volume_name': 'volume-eea5c0da-a142-408e-930b-19899a7d08bd', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:12 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-e8f65d30-d3aa-4a26-ac5e-b50a70843be9 tempest-CreateVolumesFromImageTest-1799318689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a13e6d3-1cbb-4c5e-9246-125a29b75ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:12 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-e8f65d30-d3aa-4a26-ac5e-b50a70843be9 tempest-CreateVolumesFromImageTest-1799318689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a13e6d3-1cbb-4c5e-9246-125a29b75ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:12 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-e8f65d30-d3aa-4a26-ac5e-b50a70843be9 tempest-CreateVolumesFromImageTest-1799318689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14880323-5cec-407c-956e-0a0a0fe503a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:12 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-e8f65d30-d3aa-4a26-ac5e-b50a70843be9 tempest-CreateVolumesFromImageTest-1799318689 None] Volume eea5c0da-a142-408e-930b-19899a7d08bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eea5c0da-a142-408e-930b-19899a7d08bd', 'volume_size': 1} Sep 08 06:56:12 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-e8f65d30-d3aa-4a26-ac5e-b50a70843be9 tempest-CreateVolumesFromImageTest-1799318689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:56:12 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8d14cb97-b880-4b79-8741-da7760f776b1 tempest-CreateVolumesFromImageTest-1799318689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0d37fb77-ebbb-4321-b5cf-4d4b9f8c1fa0 1073741824" returned: 0 in 0.682s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:12 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8d14cb97-b880-4b79-8741-da7760f776b1 tempest-CreateVolumesFromImageTest-1799318689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0d37fb77-ebbb-4321-b5cf-4d4b9f8c1fa0 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:12 devstack sudo[112136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0d37fb77-ebbb-4321-b5cf-4d4b9f8c1fa0 Sep 08 06:56:12 devstack sudo[112136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:12 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc7eebc8-9917-49b5-b3cd-86c92d99eda3 tempest-CreateVolumesFromImageTest-1799318689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:56:12 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-dc7eebc8-9917-49b5-b3cd-86c92d99eda3 tempest-CreateVolumesFromImageTest-1799318689 None] Flow 'volume_create_manager' (a4ed92f6-377e-4918-8c30-8c052fd1a688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:56:12 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-dc7eebc8-9917-49b5-b3cd-86c92d99eda3 tempest-CreateVolumesFromImageTest-1799318689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6b2a58a-f4fd-472a-b052-97d30a3bf455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:12 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-dc7eebc8-9917-49b5-b3cd-86c92d99eda3 tempest-CreateVolumesFromImageTest-1799318689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6b2a58a-f4fd-472a-b052-97d30a3bf455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:56:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-288266423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06e79379-3b15-4e70-9ef9-b0423fcedb7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a27ef59d1b974c8bad9a27f7e3db0786',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:56:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:56:13Z,use_quota=True,user_id='9f0102a110714a9c9c02aa1e63c6bb54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:12 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-dc7eebc8-9917-49b5-b3cd-86c92d99eda3 tempest-CreateVolumesFromImageTest-1799318689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df05be32-2a4b-45a6-9043-99767a3af637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:12 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-dc7eebc8-9917-49b5-b3cd-86c92d99eda3 tempest-CreateVolumesFromImageTest-1799318689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df05be32-2a4b-45a6-9043-99767a3af637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:12 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-dc7eebc8-9917-49b5-b3cd-86c92d99eda3 tempest-CreateVolumesFromImageTest-1799318689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e17e3704-0d38-4961-8a36-c489e12795ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:12 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-dc7eebc8-9917-49b5-b3cd-86c92d99eda3 tempest-CreateVolumesFromImageTest-1799318689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e17e3704-0d38-4961-8a36-c489e12795ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06e79379-3b15-4e70-9ef9-b0423fcedb7f', 'volume_name': 'volume-06e79379-3b15-4e70-9ef9-b0423fcedb7f', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:12 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-dc7eebc8-9917-49b5-b3cd-86c92d99eda3 tempest-CreateVolumesFromImageTest-1799318689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80ba7f00-4a44-4b63-bcd9-6edc3745930e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:12 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-dc7eebc8-9917-49b5-b3cd-86c92d99eda3 tempest-CreateVolumesFromImageTest-1799318689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80ba7f00-4a44-4b63-bcd9-6edc3745930e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:12 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-dc7eebc8-9917-49b5-b3cd-86c92d99eda3 tempest-CreateVolumesFromImageTest-1799318689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (688476ee-4e4d-44af-a92f-f50417bcca46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:12 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-dc7eebc8-9917-49b5-b3cd-86c92d99eda3 tempest-CreateVolumesFromImageTest-1799318689 None] Volume 06e79379-3b15-4e70-9ef9-b0423fcedb7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06e79379-3b15-4e70-9ef9-b0423fcedb7f', 'volume_size': 1} Sep 08 06:56:12 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-dc7eebc8-9917-49b5-b3cd-86c92d99eda3 tempest-CreateVolumesFromImageTest-1799318689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:56:12 devstack sudo[112136]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:12 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8d14cb97-b880-4b79-8741-da7760f776b1 tempest-CreateVolumesFromImageTest-1799318689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0d37fb77-ebbb-4321-b5cf-4d4b9f8c1fa0" returned: 0 in 0.541s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:12 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8d14cb97-b880-4b79-8741-da7760f776b1 tempest-CreateVolumesFromImageTest-1799318689 None] <== create_volume: return (1273ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:56:12 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8d14cb97-b880-4b79-8741-da7760f776b1 tempest-CreateVolumesFromImageTest-1799318689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.278s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:56:12 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-e8f65d30-d3aa-4a26-ac5e-b50a70843be9 tempest-CreateVolumesFromImageTest-1799318689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.589s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:56:12 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-e8f65d30-d3aa-4a26-ac5e-b50a70843be9 tempest-CreateVolumesFromImageTest-1799318689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:56:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-398185241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eea5c0da-a142-408e-930b-19899a7d08bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a27ef59d1b974c8bad9a27f7e3db0786',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:56:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:56:12Z,use_quota=True,user_id='9f0102a110714a9c9c02aa1e63c6bb54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:56:12 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-e8f65d30-d3aa-4a26-ac5e-b50a70843be9 tempest-CreateVolumesFromImageTest-1799318689 None] Creating volume eea5c0da-a142-408e-930b-19899a7d08bd {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:56:12 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-e8f65d30-d3aa-4a26-ac5e-b50a70843be9 tempest-CreateVolumesFromImageTest-1799318689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:56:12 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-e8f65d30-d3aa-4a26-ac5e-b50a70843be9 tempest-CreateVolumesFromImageTest-1799318689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:56:12 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-e8f65d30-d3aa-4a26-ac5e-b50a70843be9 tempest-CreateVolumesFromImageTest-1799318689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:56:13 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-e8f65d30-d3aa-4a26-ac5e-b50a70843be9 tempest-CreateVolumesFromImageTest-1799318689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:56:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-e8f65d30-d3aa-4a26-ac5e-b50a70843be9 tempest-CreateVolumesFromImageTest-1799318689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:56:13 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-e8f65d30-d3aa-4a26-ac5e-b50a70843be9 tempest-CreateVolumesFromImageTest-1799318689 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:56:13 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-e8f65d30-d3aa-4a26-ac5e-b50a70843be9 tempest-CreateVolumesFromImageTest-1799318689 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:56:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e8f65d30-d3aa-4a26-ac5e-b50a70843be9 tempest-CreateVolumesFromImageTest-1799318689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-eea5c0da-a142-408e-930b-19899a7d08bd 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:13 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8d14cb97-b880-4b79-8741-da7760f776b1 tempest-CreateVolumesFromImageTest-1799318689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c85348e-84b3-415a-8e07-fc95e199aee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d37fb77-ebbb-4321-b5cf-4d4b9f8c1fa0', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:13 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8d14cb97-b880-4b79-8741-da7760f776b1 tempest-CreateVolumesFromImageTest-1799318689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0723af27-bce3-447e-b9d4-7692969aa39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:13 devstack sudo[112161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-eea5c0da-a142-408e-930b-19899a7d08bd 1073741824 Sep 08 06:56:13 devstack sudo[112161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:13 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-8d14cb97-b880-4b79-8741-da7760f776b1 tempest-CreateVolumesFromImageTest-1799318689 None] Volume volume-0d37fb77-ebbb-4321-b5cf-4d4b9f8c1fa0 (0d37fb77-ebbb-4321-b5cf-4d4b9f8c1fa0): created successfully Sep 08 06:56:13 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8d14cb97-b880-4b79-8741-da7760f776b1 tempest-CreateVolumesFromImageTest-1799318689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0723af27-bce3-447e-b9d4-7692969aa39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:13 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8d14cb97-b880-4b79-8741-da7760f776b1 tempest-CreateVolumesFromImageTest-1799318689 None] Flow 'volume_create_manager' (0b51b870-13a4-4576-9da5-d55a21b795c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:56:13 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ab1007dc-1216-4ad6-ba27-2a94dacc4935 tempest-VolumesExtendTest-1511794103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36b0e5fc-8678-4d9f-80c4-96b6e9559f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e8f47f4a-fe67-47ab-8217-86e66c817989', 'volume_name': 'volume-e8f47f4a-fe67-47ab-8217-86e66c817989', 'volume_size': 1, 'image_id': '69da6bac-8b7b-48c5-af3b-29466563452a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/69da6bac-8b7b-48c5-af3b-29466563452a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '95d2d5dbb3e04d74b8da31fc6ee47f98', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '69da6bac-8b7b-48c5-af3b-29466563452a', 'created_at': datetime.datetime(2026, 9, 8, 4, 36, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 4, 36, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/69da6bac-8b7b-48c5-af3b-29466563452a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:13 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ab1007dc-1216-4ad6-ba27-2a94dacc4935 tempest-VolumesExtendTest-1511794103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cc593de-af1b-4f48-bff6-01f04d390105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:13 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ab1007dc-1216-4ad6-ba27-2a94dacc4935 tempest-VolumesExtendTest-1511794103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cc593de-af1b-4f48-bff6-01f04d390105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:13 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ab1007dc-1216-4ad6-ba27-2a94dacc4935 tempest-VolumesExtendTest-1511794103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ff2a1b6-3591-432f-97cd-9dcd04ca0ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:13 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-ab1007dc-1216-4ad6-ba27-2a94dacc4935 tempest-VolumesExtendTest-1511794103 None] Volume e8f47f4a-fe67-47ab-8217-86e66c817989: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e8f47f4a-fe67-47ab-8217-86e66c817989', 'volume_size': 1, 'image_id': '69da6bac-8b7b-48c5-af3b-29466563452a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/69da6bac-8b7b-48c5-af3b-29466563452a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '95d2d5dbb3e04d74b8da31fc6ee47f98', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '69da6bac-8b7b-48c5-af3b-29466563452a', 'created_at': datetime.datetime(2026, 9, 8, 4, 36, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 4, 36, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/69da6bac-8b7b-48c5-af3b-29466563452a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 08 06:56:13 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab1007dc-1216-4ad6-ba27-2a94dacc4935 tempest-VolumesExtendTest-1511794103 None] Trying to clone e8f47f4a-fe67-47ab-8217-86e66c817989 from image 69da6bac-8b7b-48c5-af3b-29466563452a at location (None, [{'url': 'file:///opt/stack/data/glance/images/69da6bac-8b7b-48c5-af3b-29466563452a', 'metadata': {}}]). {{(pid=87507) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 08 06:56:13 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-8d14cb97-b880-4b79-8741-da7760f776b1 tempest-CreateVolumesFromImageTest-1799318689 None] Created volume successfully. Sep 08 06:56:13 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fefd9a3-df23-478a-aee4-620bae7e1141 tempest-CreateVolumesFromImageTest-1799318689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:56:13 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-3fefd9a3-df23-478a-aee4-620bae7e1141 tempest-CreateVolumesFromImageTest-1799318689 None] Flow 'volume_create_manager' (8b0e612f-3737-489b-a06e-31a4f2561320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:56:13 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-3fefd9a3-df23-478a-aee4-620bae7e1141 tempest-CreateVolumesFromImageTest-1799318689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36257955-37ca-49b4-928b-ff9a6de47f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:13 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-3fefd9a3-df23-478a-aee4-620bae7e1141 tempest-CreateVolumesFromImageTest-1799318689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36257955-37ca-49b4-928b-ff9a6de47f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:56:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-6164048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=887242e7-0543-4761-8d3f-0321bee5af7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a27ef59d1b974c8bad9a27f7e3db0786',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:56:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:56:14Z,use_quota=True,user_id='9f0102a110714a9c9c02aa1e63c6bb54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:13 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-3fefd9a3-df23-478a-aee4-620bae7e1141 tempest-CreateVolumesFromImageTest-1799318689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c4fb393-f056-4574-8e25-d9090e7aa6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:13 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-3fefd9a3-df23-478a-aee4-620bae7e1141 tempest-CreateVolumesFromImageTest-1799318689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c4fb393-f056-4574-8e25-d9090e7aa6da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:13 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-3fefd9a3-df23-478a-aee4-620bae7e1141 tempest-CreateVolumesFromImageTest-1799318689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b9be499-f995-4f40-86f9-662f06e78727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:13 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-3fefd9a3-df23-478a-aee4-620bae7e1141 tempest-CreateVolumesFromImageTest-1799318689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b9be499-f995-4f40-86f9-662f06e78727) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '887242e7-0543-4761-8d3f-0321bee5af7e', 'volume_name': 'volume-887242e7-0543-4761-8d3f-0321bee5af7e', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:13 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-3fefd9a3-df23-478a-aee4-620bae7e1141 tempest-CreateVolumesFromImageTest-1799318689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e97ad67-e9de-4361-9ecd-f11f16e04bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:13 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-3fefd9a3-df23-478a-aee4-620bae7e1141 tempest-CreateVolumesFromImageTest-1799318689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e97ad67-e9de-4361-9ecd-f11f16e04bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:13 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-3fefd9a3-df23-478a-aee4-620bae7e1141 tempest-CreateVolumesFromImageTest-1799318689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (668938ed-8fa1-489f-97bf-4b5c974ec154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:13 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-3fefd9a3-df23-478a-aee4-620bae7e1141 tempest-CreateVolumesFromImageTest-1799318689 None] Volume 887242e7-0543-4761-8d3f-0321bee5af7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-887242e7-0543-4761-8d3f-0321bee5af7e', 'volume_size': 1} Sep 08 06:56:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-3fefd9a3-df23-478a-aee4-620bae7e1141 tempest-CreateVolumesFromImageTest-1799318689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:56:13 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-ab1007dc-1216-4ad6-ba27-2a94dacc4935 tempest-VolumesExtendTest-1511794103 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_0xamubkcdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87507) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 08 06:56:13 devstack cinder-volume[87507]: INFO cinder.image.image_utils [None req-ab1007dc-1216-4ad6-ba27-2a94dacc4935 tempest-VolumesExtendTest-1511794103 None] Image download 20.69 MB at 20.69 MB/s Sep 08 06:56:14 devstack sudo[112161]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e8f65d30-d3aa-4a26-ac5e-b50a70843be9 tempest-CreateVolumesFromImageTest-1799318689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-eea5c0da-a142-408e-930b-19899a7d08bd 1073741824" returned: 0 in 0.989s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:14 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2315267a-63e9-4d5a-84e4-2cb1f8e3b216]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:56:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ab1007dc-1216-4ad6-ba27-2a94dacc4935 tempest-VolumesExtendTest-1511794103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_0xamubkcdevstack@QuobyteHD {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e8f65d30-d3aa-4a26-ac5e-b50a70843be9 tempest-CreateVolumesFromImageTest-1799318689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-eea5c0da-a142-408e-930b-19899a7d08bd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:14 devstack sudo[112217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-eea5c0da-a142-408e-930b-19899a7d08bd Sep 08 06:56:14 devstack sudo[112217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:14 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-8df8bb5a-ac4f-49c8-a54e-6a0ab23f103c tempest-CreateVolumesFromImageTest-1799318689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:56:14 devstack sudo[112214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_0xamubkcdevstack@QuobyteHD Sep 08 06:56:14 devstack sudo[112214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8df8bb5a-ac4f-49c8-a54e-6a0ab23f103c tempest-CreateVolumesFromImageTest-1799318689 None] Flow 'volume_create_manager' (edc72e8b-e988-45ce-99e3-a3effb4f48da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:56:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8df8bb5a-ac4f-49c8-a54e-6a0ab23f103c tempest-CreateVolumesFromImageTest-1799318689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (681eff76-c02c-424f-a5b5-eb91c9f1af8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8df8bb5a-ac4f-49c8-a54e-6a0ab23f103c tempest-CreateVolumesFromImageTest-1799318689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (681eff76-c02c-424f-a5b5-eb91c9f1af8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:56:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-581678727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=634ccd0f-0c31-41c8-a2ba-ec2bb0ec3fce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a27ef59d1b974c8bad9a27f7e3db0786',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:56:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:56:14Z,use_quota=True,user_id='9f0102a110714a9c9c02aa1e63c6bb54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8df8bb5a-ac4f-49c8-a54e-6a0ab23f103c tempest-CreateVolumesFromImageTest-1799318689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3cff5d1-9097-45aa-92c7-8a96ea5ee37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8df8bb5a-ac4f-49c8-a54e-6a0ab23f103c tempest-CreateVolumesFromImageTest-1799318689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3cff5d1-9097-45aa-92c7-8a96ea5ee37e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8df8bb5a-ac4f-49c8-a54e-6a0ab23f103c tempest-CreateVolumesFromImageTest-1799318689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4749eb64-5c07-4d6a-a156-ae50c0af016c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8df8bb5a-ac4f-49c8-a54e-6a0ab23f103c tempest-CreateVolumesFromImageTest-1799318689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4749eb64-5c07-4d6a-a156-ae50c0af016c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '634ccd0f-0c31-41c8-a2ba-ec2bb0ec3fce', 'volume_name': 'volume-634ccd0f-0c31-41c8-a2ba-ec2bb0ec3fce', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8df8bb5a-ac4f-49c8-a54e-6a0ab23f103c tempest-CreateVolumesFromImageTest-1799318689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3cafa46-d9f4-43c8-b782-404cc7d6689d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8df8bb5a-ac4f-49c8-a54e-6a0ab23f103c tempest-CreateVolumesFromImageTest-1799318689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3cafa46-d9f4-43c8-b782-404cc7d6689d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8df8bb5a-ac4f-49c8-a54e-6a0ab23f103c tempest-CreateVolumesFromImageTest-1799318689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e72c40ac-062f-420f-9807-ed866c1e96b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:14 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-8df8bb5a-ac4f-49c8-a54e-6a0ab23f103c tempest-CreateVolumesFromImageTest-1799318689 None] Volume 634ccd0f-0c31-41c8-a2ba-ec2bb0ec3fce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-634ccd0f-0c31-41c8-a2ba-ec2bb0ec3fce', 'volume_size': 1} Sep 08 06:56:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8df8bb5a-ac4f-49c8-a54e-6a0ab23f103c tempest-CreateVolumesFromImageTest-1799318689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:56:14 devstack sudo[112217]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e8f65d30-d3aa-4a26-ac5e-b50a70843be9 tempest-CreateVolumesFromImageTest-1799318689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-eea5c0da-a142-408e-930b-19899a7d08bd" returned: 0 in 0.397s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:14 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-e8f65d30-d3aa-4a26-ac5e-b50a70843be9 tempest-CreateVolumesFromImageTest-1799318689 None] <== create_volume: return (1486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:56:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-e8f65d30-d3aa-4a26-ac5e-b50a70843be9 tempest-CreateVolumesFromImageTest-1799318689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.491s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:56:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-dc7eebc8-9917-49b5-b3cd-86c92d99eda3 tempest-CreateVolumesFromImageTest-1799318689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.613s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:56:14 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-dc7eebc8-9917-49b5-b3cd-86c92d99eda3 tempest-CreateVolumesFromImageTest-1799318689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:56:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-288266423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06e79379-3b15-4e70-9ef9-b0423fcedb7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a27ef59d1b974c8bad9a27f7e3db0786',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:56:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:56:13Z,use_quota=True,user_id='9f0102a110714a9c9c02aa1e63c6bb54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:56:14 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-dc7eebc8-9917-49b5-b3cd-86c92d99eda3 tempest-CreateVolumesFromImageTest-1799318689 None] Creating volume 06e79379-3b15-4e70-9ef9-b0423fcedb7f {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:56:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-dc7eebc8-9917-49b5-b3cd-86c92d99eda3 tempest-CreateVolumesFromImageTest-1799318689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:56:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-dc7eebc8-9917-49b5-b3cd-86c92d99eda3 tempest-CreateVolumesFromImageTest-1799318689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:56:14 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-dc7eebc8-9917-49b5-b3cd-86c92d99eda3 tempest-CreateVolumesFromImageTest-1799318689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:56:14 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-dc7eebc8-9917-49b5-b3cd-86c92d99eda3 tempest-CreateVolumesFromImageTest-1799318689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:56:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-dc7eebc8-9917-49b5-b3cd-86c92d99eda3 tempest-CreateVolumesFromImageTest-1799318689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:56:14 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-dc7eebc8-9917-49b5-b3cd-86c92d99eda3 tempest-CreateVolumesFromImageTest-1799318689 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:56:14 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-dc7eebc8-9917-49b5-b3cd-86c92d99eda3 tempest-CreateVolumesFromImageTest-1799318689 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:56:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-dc7eebc8-9917-49b5-b3cd-86c92d99eda3 tempest-CreateVolumesFromImageTest-1799318689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-06e79379-3b15-4e70-9ef9-b0423fcedb7f 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:14 devstack sudo[112214]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-e8f65d30-d3aa-4a26-ac5e-b50a70843be9 tempest-CreateVolumesFromImageTest-1799318689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14880323-5cec-407c-956e-0a0a0fe503a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eea5c0da-a142-408e-930b-19899a7d08bd', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-e8f65d30-d3aa-4a26-ac5e-b50a70843be9 tempest-CreateVolumesFromImageTest-1799318689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14e86ed0-8767-4ac3-8fe2-4cfd644c7513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:14 devstack sudo[112239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-06e79379-3b15-4e70-9ef9-b0423fcedb7f 1073741824 Sep 08 06:56:14 devstack sudo[112239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ab1007dc-1216-4ad6-ba27-2a94dacc4935 tempest-VolumesExtendTest-1511794103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_0xamubkcdevstack@QuobyteHD" returned: 0 in 0.558s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:14 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-ab1007dc-1216-4ad6-ba27-2a94dacc4935 tempest-VolumesExtendTest-1511794103 None] Temporary image 69da6bac-8b7b-48c5-af3b-29466563452a is fetched for user d13c663628ef44f296ca96fc4495bbe7. {{(pid=87507) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 08 06:56:14 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-e8f65d30-d3aa-4a26-ac5e-b50a70843be9 tempest-CreateVolumesFromImageTest-1799318689 None] Volume volume-eea5c0da-a142-408e-930b-19899a7d08bd (eea5c0da-a142-408e-930b-19899a7d08bd): created successfully Sep 08 06:56:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-e8f65d30-d3aa-4a26-ac5e-b50a70843be9 tempest-CreateVolumesFromImageTest-1799318689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14e86ed0-8767-4ac3-8fe2-4cfd644c7513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-e8f65d30-d3aa-4a26-ac5e-b50a70843be9 tempest-CreateVolumesFromImageTest-1799318689 None] Flow 'volume_create_manager' (e7408edb-703d-46a6-b84a-c926f182d47e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:56:14 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-e8f65d30-d3aa-4a26-ac5e-b50a70843be9 tempest-CreateVolumesFromImageTest-1799318689 None] Created volume successfully. Sep 08 06:56:14 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2013720-30d5-4f2e-87c9-0010f94c31dd]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:56:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ab1007dc-1216-4ad6-ba27-2a94dacc4935 tempest-VolumesExtendTest-1511794103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_0xamubkcdevstack@QuobyteHD {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:14 devstack sudo[112247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_0xamubkcdevstack@QuobyteHD Sep 08 06:56:14 devstack sudo[112247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:15 devstack sudo[112239]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-dc7eebc8-9917-49b5-b3cd-86c92d99eda3 tempest-CreateVolumesFromImageTest-1799318689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-06e79379-3b15-4e70-9ef9-b0423fcedb7f 1073741824" returned: 0 in 0.586s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:15 devstack sudo[112247]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ab1007dc-1216-4ad6-ba27-2a94dacc4935 tempest-VolumesExtendTest-1511794103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_0xamubkcdevstack@QuobyteHD" returned: 0 in 0.440s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-ab1007dc-1216-4ad6-ba27-2a94dacc4935 tempest-VolumesExtendTest-1511794103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:56:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-dc7eebc8-9917-49b5-b3cd-86c92d99eda3 tempest-CreateVolumesFromImageTest-1799318689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-06e79379-3b15-4e70-9ef9-b0423fcedb7f {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:15 devstack sudo[112268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-06e79379-3b15-4e70-9ef9-b0423fcedb7f Sep 08 06:56:15 devstack sudo[112268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:15 devstack sudo[112268]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-dc7eebc8-9917-49b5-b3cd-86c92d99eda3 tempest-CreateVolumesFromImageTest-1799318689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-06e79379-3b15-4e70-9ef9-b0423fcedb7f" returned: 0 in 0.268s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:15 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-dc7eebc8-9917-49b5-b3cd-86c92d99eda3 tempest-CreateVolumesFromImageTest-1799318689 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:56:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-dc7eebc8-9917-49b5-b3cd-86c92d99eda3 tempest-CreateVolumesFromImageTest-1799318689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:56:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-3fefd9a3-df23-478a-aee4-620bae7e1141 tempest-CreateVolumesFromImageTest-1799318689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.569s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:56:15 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-3fefd9a3-df23-478a-aee4-620bae7e1141 tempest-CreateVolumesFromImageTest-1799318689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:56:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-6164048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=887242e7-0543-4761-8d3f-0321bee5af7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a27ef59d1b974c8bad9a27f7e3db0786',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:56:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:56:14Z,use_quota=True,user_id='9f0102a110714a9c9c02aa1e63c6bb54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:56:15 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-3fefd9a3-df23-478a-aee4-620bae7e1141 tempest-CreateVolumesFromImageTest-1799318689 None] Creating volume 887242e7-0543-4761-8d3f-0321bee5af7e {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:56:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-3fefd9a3-df23-478a-aee4-620bae7e1141 tempest-CreateVolumesFromImageTest-1799318689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:56:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-3fefd9a3-df23-478a-aee4-620bae7e1141 tempest-CreateVolumesFromImageTest-1799318689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:56:15 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-3fefd9a3-df23-478a-aee4-620bae7e1141 tempest-CreateVolumesFromImageTest-1799318689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:56:15 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-3fefd9a3-df23-478a-aee4-620bae7e1141 tempest-CreateVolumesFromImageTest-1799318689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:56:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-3fefd9a3-df23-478a-aee4-620bae7e1141 tempest-CreateVolumesFromImageTest-1799318689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:56:15 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-3fefd9a3-df23-478a-aee4-620bae7e1141 tempest-CreateVolumesFromImageTest-1799318689 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:56:15 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-3fefd9a3-df23-478a-aee4-620bae7e1141 tempest-CreateVolumesFromImageTest-1799318689 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:56:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3fefd9a3-df23-478a-aee4-620bae7e1141 tempest-CreateVolumesFromImageTest-1799318689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-887242e7-0543-4761-8d3f-0321bee5af7e 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:15 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-dc7eebc8-9917-49b5-b3cd-86c92d99eda3 tempest-CreateVolumesFromImageTest-1799318689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (688476ee-4e4d-44af-a92f-f50417bcca46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06e79379-3b15-4e70-9ef9-b0423fcedb7f', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:15 devstack sudo[112280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-887242e7-0543-4761-8d3f-0321bee5af7e 1073741824 Sep 08 06:56:15 devstack sudo[112280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:15 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-dc7eebc8-9917-49b5-b3cd-86c92d99eda3 tempest-CreateVolumesFromImageTest-1799318689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (788c86f8-2d51-47bf-a934-5e6ff12a1ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:15 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-dc7eebc8-9917-49b5-b3cd-86c92d99eda3 tempest-CreateVolumesFromImageTest-1799318689 None] Volume volume-06e79379-3b15-4e70-9ef9-b0423fcedb7f (06e79379-3b15-4e70-9ef9-b0423fcedb7f): created successfully Sep 08 06:56:15 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-dc7eebc8-9917-49b5-b3cd-86c92d99eda3 tempest-CreateVolumesFromImageTest-1799318689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (788c86f8-2d51-47bf-a934-5e6ff12a1ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:15 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-dc7eebc8-9917-49b5-b3cd-86c92d99eda3 tempest-CreateVolumesFromImageTest-1799318689 None] Flow 'volume_create_manager' (a4ed92f6-377e-4918-8c30-8c052fd1a688) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:56:15 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-dc7eebc8-9917-49b5-b3cd-86c92d99eda3 tempest-CreateVolumesFromImageTest-1799318689 None] Created volume successfully. Sep 08 06:56:15 devstack sudo[112280]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3fefd9a3-df23-478a-aee4-620bae7e1141 tempest-CreateVolumesFromImageTest-1799318689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-887242e7-0543-4761-8d3f-0321bee5af7e 1073741824" returned: 0 in 0.540s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3fefd9a3-df23-478a-aee4-620bae7e1141 tempest-CreateVolumesFromImageTest-1799318689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-887242e7-0543-4761-8d3f-0321bee5af7e {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:16 devstack sudo[112305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-887242e7-0543-4761-8d3f-0321bee5af7e Sep 08 06:56:16 devstack sudo[112305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:16 devstack sudo[112305]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3fefd9a3-df23-478a-aee4-620bae7e1141 tempest-CreateVolumesFromImageTest-1799318689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-887242e7-0543-4761-8d3f-0321bee5af7e" returned: 0 in 0.257s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:16 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-3fefd9a3-df23-478a-aee4-620bae7e1141 tempest-CreateVolumesFromImageTest-1799318689 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:56:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-3fefd9a3-df23-478a-aee4-620bae7e1141 tempest-CreateVolumesFromImageTest-1799318689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:56:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8df8bb5a-ac4f-49c8-a54e-6a0ab23f103c tempest-CreateVolumesFromImageTest-1799318689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.862s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:56:16 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8df8bb5a-ac4f-49c8-a54e-6a0ab23f103c tempest-CreateVolumesFromImageTest-1799318689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:56:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-581678727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=634ccd0f-0c31-41c8-a2ba-ec2bb0ec3fce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a27ef59d1b974c8bad9a27f7e3db0786',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:56:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:56:14Z,use_quota=True,user_id='9f0102a110714a9c9c02aa1e63c6bb54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:56:16 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-8df8bb5a-ac4f-49c8-a54e-6a0ab23f103c tempest-CreateVolumesFromImageTest-1799318689 None] Creating volume 634ccd0f-0c31-41c8-a2ba-ec2bb0ec3fce {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:56:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8df8bb5a-ac4f-49c8-a54e-6a0ab23f103c tempest-CreateVolumesFromImageTest-1799318689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:56:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8df8bb5a-ac4f-49c8-a54e-6a0ab23f103c tempest-CreateVolumesFromImageTest-1799318689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:56:16 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8df8bb5a-ac4f-49c8-a54e-6a0ab23f103c tempest-CreateVolumesFromImageTest-1799318689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:56:16 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8df8bb5a-ac4f-49c8-a54e-6a0ab23f103c tempest-CreateVolumesFromImageTest-1799318689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:56:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8df8bb5a-ac4f-49c8-a54e-6a0ab23f103c tempest-CreateVolumesFromImageTest-1799318689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:56:16 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8df8bb5a-ac4f-49c8-a54e-6a0ab23f103c tempest-CreateVolumesFromImageTest-1799318689 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:56:16 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-8df8bb5a-ac4f-49c8-a54e-6a0ab23f103c tempest-CreateVolumesFromImageTest-1799318689 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:56:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8df8bb5a-ac4f-49c8-a54e-6a0ab23f103c tempest-CreateVolumesFromImageTest-1799318689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-634ccd0f-0c31-41c8-a2ba-ec2bb0ec3fce 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:16 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-3fefd9a3-df23-478a-aee4-620bae7e1141 tempest-CreateVolumesFromImageTest-1799318689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (668938ed-8fa1-489f-97bf-4b5c974ec154) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-887242e7-0543-4761-8d3f-0321bee5af7e', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:16 devstack sudo[112314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-634ccd0f-0c31-41c8-a2ba-ec2bb0ec3fce 1073741824 Sep 08 06:56:16 devstack sudo[112314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:16 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-3fefd9a3-df23-478a-aee4-620bae7e1141 tempest-CreateVolumesFromImageTest-1799318689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8571eaca-33ec-4992-a67c-9a49e89f9a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:16 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-3fefd9a3-df23-478a-aee4-620bae7e1141 tempest-CreateVolumesFromImageTest-1799318689 None] Volume volume-887242e7-0543-4761-8d3f-0321bee5af7e (887242e7-0543-4761-8d3f-0321bee5af7e): created successfully Sep 08 06:56:16 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-3fefd9a3-df23-478a-aee4-620bae7e1141 tempest-CreateVolumesFromImageTest-1799318689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8571eaca-33ec-4992-a67c-9a49e89f9a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:16 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-3fefd9a3-df23-478a-aee4-620bae7e1141 tempest-CreateVolumesFromImageTest-1799318689 None] Flow 'volume_create_manager' (8b0e612f-3737-489b-a06e-31a4f2561320) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:56:16 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-3fefd9a3-df23-478a-aee4-620bae7e1141 tempest-CreateVolumesFromImageTest-1799318689 None] Created volume successfully. Sep 08 06:56:16 devstack sudo[112314]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8df8bb5a-ac4f-49c8-a54e-6a0ab23f103c tempest-CreateVolumesFromImageTest-1799318689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-634ccd0f-0c31-41c8-a2ba-ec2bb0ec3fce 1073741824" returned: 0 in 0.647s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8df8bb5a-ac4f-49c8-a54e-6a0ab23f103c tempest-CreateVolumesFromImageTest-1799318689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-634ccd0f-0c31-41c8-a2ba-ec2bb0ec3fce {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:17 devstack sudo[112381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-634ccd0f-0c31-41c8-a2ba-ec2bb0ec3fce Sep 08 06:56:17 devstack sudo[112381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:17 devstack sudo[112381]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8df8bb5a-ac4f-49c8-a54e-6a0ab23f103c tempest-CreateVolumesFromImageTest-1799318689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-634ccd0f-0c31-41c8-a2ba-ec2bb0ec3fce" returned: 0 in 0.353s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:17 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8df8bb5a-ac4f-49c8-a54e-6a0ab23f103c tempest-CreateVolumesFromImageTest-1799318689 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:56:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8df8bb5a-ac4f-49c8-a54e-6a0ab23f103c tempest-CreateVolumesFromImageTest-1799318689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:56:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-ab1007dc-1216-4ad6-ba27-2a94dacc4935 tempest-VolumesExtendTest-1511794103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.219s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:56:17 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-ab1007dc-1216-4ad6-ba27-2a94dacc4935 tempest-VolumesExtendTest-1511794103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:56:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-416373254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8f47f4a-fe67-47ab-8217-86e66c817989,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92f6cd589e8544fc971aa1391189d34d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:56:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:56:12Z,use_quota=True,user_id='d13c663628ef44f296ca96fc4495bbe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:56:17 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-ab1007dc-1216-4ad6-ba27-2a94dacc4935 tempest-VolumesExtendTest-1511794103 None] Creating volume e8f47f4a-fe67-47ab-8217-86e66c817989 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:56:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-ab1007dc-1216-4ad6-ba27-2a94dacc4935 tempest-VolumesExtendTest-1511794103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:56:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-ab1007dc-1216-4ad6-ba27-2a94dacc4935 tempest-VolumesExtendTest-1511794103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:56:17 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-ab1007dc-1216-4ad6-ba27-2a94dacc4935 tempest-VolumesExtendTest-1511794103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:56:17 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-ab1007dc-1216-4ad6-ba27-2a94dacc4935 tempest-VolumesExtendTest-1511794103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:56:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-ab1007dc-1216-4ad6-ba27-2a94dacc4935 tempest-VolumesExtendTest-1511794103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:56:17 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-ab1007dc-1216-4ad6-ba27-2a94dacc4935 tempest-VolumesExtendTest-1511794103 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:56:17 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-ab1007dc-1216-4ad6-ba27-2a94dacc4935 tempest-VolumesExtendTest-1511794103 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:56:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ab1007dc-1216-4ad6-ba27-2a94dacc4935 tempest-VolumesExtendTest-1511794103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e8f47f4a-fe67-47ab-8217-86e66c817989 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:17 devstack sudo[112416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e8f47f4a-fe67-47ab-8217-86e66c817989 1073741824 Sep 08 06:56:17 devstack sudo[112416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:17 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8df8bb5a-ac4f-49c8-a54e-6a0ab23f103c tempest-CreateVolumesFromImageTest-1799318689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e72c40ac-062f-420f-9807-ed866c1e96b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-634ccd0f-0c31-41c8-a2ba-ec2bb0ec3fce', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:17 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8df8bb5a-ac4f-49c8-a54e-6a0ab23f103c tempest-CreateVolumesFromImageTest-1799318689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a646bb84-1f18-485d-bdd8-70ea109984ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:17 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-8df8bb5a-ac4f-49c8-a54e-6a0ab23f103c tempest-CreateVolumesFromImageTest-1799318689 None] Volume volume-634ccd0f-0c31-41c8-a2ba-ec2bb0ec3fce (634ccd0f-0c31-41c8-a2ba-ec2bb0ec3fce): created successfully Sep 08 06:56:17 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8df8bb5a-ac4f-49c8-a54e-6a0ab23f103c tempest-CreateVolumesFromImageTest-1799318689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a646bb84-1f18-485d-bdd8-70ea109984ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:17 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8df8bb5a-ac4f-49c8-a54e-6a0ab23f103c tempest-CreateVolumesFromImageTest-1799318689 None] Flow 'volume_create_manager' (edc72e8b-e988-45ce-99e3-a3effb4f48da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:56:17 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-8df8bb5a-ac4f-49c8-a54e-6a0ab23f103c tempest-CreateVolumesFromImageTest-1799318689 None] Created volume successfully. Sep 08 06:56:17 devstack sudo[112416]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ab1007dc-1216-4ad6-ba27-2a94dacc4935 tempest-VolumesExtendTest-1511794103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e8f47f4a-fe67-47ab-8217-86e66c817989 1073741824" returned: 0 in 0.577s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ab1007dc-1216-4ad6-ba27-2a94dacc4935 tempest-VolumesExtendTest-1511794103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e8f47f4a-fe67-47ab-8217-86e66c817989 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:18 devstack sudo[112445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e8f47f4a-fe67-47ab-8217-86e66c817989 Sep 08 06:56:18 devstack sudo[112445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:18 devstack sudo[112445]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ab1007dc-1216-4ad6-ba27-2a94dacc4935 tempest-VolumesExtendTest-1511794103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e8f47f4a-fe67-47ab-8217-86e66c817989" returned: 0 in 0.304s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:18 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-ab1007dc-1216-4ad6-ba27-2a94dacc4935 tempest-VolumesExtendTest-1511794103 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:56:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-ab1007dc-1216-4ad6-ba27-2a94dacc4935 tempest-VolumesExtendTest-1511794103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:56:18 devstack cinder-volume[87507]: DEBUG cinder.volume.volume_utils [None req-ab1007dc-1216-4ad6-ba27-2a94dacc4935 tempest-VolumesExtendTest-1511794103 None] Attempting download of 69da6bac-8b7b-48c5-af3b-29466563452a ((None, [{'url': 'file:///opt/stack/data/glance/images/69da6bac-8b7b-48c5-af3b-29466563452a', 'metadata': {}}])) to volume e8f47f4a-fe67-47ab-8217-86e66c817989. {{(pid=87507) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 08 06:56:18 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[383a3485-529c-4995-85e2-36b117fafcf7]: (4, 'raw') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:56:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ab1007dc-1216-4ad6-ba27-2a94dacc4935 tempest-VolumesExtendTest-1511794103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_69da6bac-8b7b-48c5-af3b-29466563452a_zmdg87be {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:18 devstack sudo[112462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_69da6bac-8b7b-48c5-af3b-29466563452a_zmdg87be Sep 08 06:56:18 devstack sudo[112462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:18 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-32cb0d82-ded9-4cac-bba3-967cdaa1cdf8 tempest-CreateVolumesFromImageTest-1799318689 None] Acquiring lock "cinder-634ccd0f-0c31-41c8-a2ba-ec2bb0ec3fce-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:56:18 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-32cb0d82-ded9-4cac-bba3-967cdaa1cdf8 tempest-CreateVolumesFromImageTest-1799318689 None] Lock "cinder-634ccd0f-0c31-41c8-a2ba-ec2bb0ec3fce-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:56:18 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-32cb0d82-ded9-4cac-bba3-967cdaa1cdf8 tempest-CreateVolumesFromImageTest-1799318689 None] Acquiring lock "cinder-quobyte-634ccd0f-0c31-41c8-a2ba-ec2bb0ec3fce" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:56:18 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-32cb0d82-ded9-4cac-bba3-967cdaa1cdf8 tempest-CreateVolumesFromImageTest-1799318689 None] Lock "cinder-quobyte-634ccd0f-0c31-41c8-a2ba-ec2bb0ec3fce" acquired by "delete_volume" :: waited 0.035s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:56:18 devstack sudo[112462]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ab1007dc-1216-4ad6-ba27-2a94dacc4935 tempest-VolumesExtendTest-1511794103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_69da6bac-8b7b-48c5-af3b-29466563452a_zmdg87be" returned: 0 in 0.482s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ab1007dc-1216-4ad6-ba27-2a94dacc4935 tempest-VolumesExtendTest-1511794103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_69da6bac-8b7b-48c5-af3b-29466563452a_zmdg87be {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:18 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dcc237d-10e9-4de0-836f-cdcde03e93e5]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:56:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-32cb0d82-ded9-4cac-bba3-967cdaa1cdf8 tempest-CreateVolumesFromImageTest-1799318689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-634ccd0f-0c31-41c8-a2ba-ec2bb0ec3fce {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:19 devstack sudo[112481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_69da6bac-8b7b-48c5-af3b-29466563452a_zmdg87be Sep 08 06:56:19 devstack sudo[112481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:19 devstack sudo[112482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-634ccd0f-0c31-41c8-a2ba-ec2bb0ec3fce Sep 08 06:56:19 devstack sudo[112482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:19 devstack sudo[112481]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ab1007dc-1216-4ad6-ba27-2a94dacc4935 tempest-VolumesExtendTest-1511794103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_69da6bac-8b7b-48c5-af3b-29466563452a_zmdg87be" returned: 1 in 0.451s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ab1007dc-1216-4ad6-ba27-2a94dacc4935 tempest-VolumesExtendTest-1511794103 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_69da6bac-8b7b-48c5-af3b-29466563452a_zmdg87be' failed. Not Retrying. {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 06:56:19 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[eadaff46-5076-49c6-9d2e-e4f1340d3e46]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:56:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ab1007dc-1216-4ad6-ba27-2a94dacc4935 tempest-VolumesExtendTest-1511794103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_0xamubkcdevstack@QuobyteHD {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:19 devstack sudo[112482]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-32cb0d82-ded9-4cac-bba3-967cdaa1cdf8 tempest-CreateVolumesFromImageTest-1799318689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-634ccd0f-0c31-41c8-a2ba-ec2bb0ec3fce" returned: 0 in 0.461s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-32cb0d82-ded9-4cac-bba3-967cdaa1cdf8 tempest-CreateVolumesFromImageTest-1799318689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-634ccd0f-0c31-41c8-a2ba-ec2bb0ec3fce {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:19 devstack sudo[112507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-634ccd0f-0c31-41c8-a2ba-ec2bb0ec3fce Sep 08 06:56:19 devstack sudo[112507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:19 devstack sudo[112505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_0xamubkcdevstack@QuobyteHD Sep 08 06:56:19 devstack sudo[112505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:19 devstack sudo[112507]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-32cb0d82-ded9-4cac-bba3-967cdaa1cdf8 tempest-CreateVolumesFromImageTest-1799318689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-634ccd0f-0c31-41c8-a2ba-ec2bb0ec3fce" returned: 0 in 0.283s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:19 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-32cb0d82-ded9-4cac-bba3-967cdaa1cdf8 tempest-CreateVolumesFromImageTest-1799318689 None] Lock "cinder-quobyte-634ccd0f-0c31-41c8-a2ba-ec2bb0ec3fce" released by "delete_volume" :: held 0.821s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:56:19 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-32cb0d82-ded9-4cac-bba3-967cdaa1cdf8 tempest-CreateVolumesFromImageTest-1799318689 None] Created reservations ['d33c93fb-d10a-4099-bb0e-c7d682d04bc1', '845bdedf-5b3f-47bc-b031-69bcffd0f0f6', 'ada9a738-2ae7-4dab-8469-d5bc3dc527b6', 'fea094f2-52eb-4cbe-b5b4-661c584e2940'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:56:19 devstack sudo[112505]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ab1007dc-1216-4ad6-ba27-2a94dacc4935 tempest-VolumesExtendTest-1511794103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_0xamubkcdevstack@QuobyteHD" returned: 0 in 0.470s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:19 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-ab1007dc-1216-4ad6-ba27-2a94dacc4935 tempest-VolumesExtendTest-1511794103 None] 69da6bac-8b7b-48c5-af3b-29466563452a was qcow2, converting to qcow2 {{(pid=87507) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 08 06:56:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ab1007dc-1216-4ad6-ba27-2a94dacc4935 tempest-VolumesExtendTest-1511794103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_0xamubkcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e8f47f4a-fe67-47ab-8217-86e66c817989 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:19 devstack sudo[112526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_0xamubkcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e8f47f4a-fe67-47ab-8217-86e66c817989 Sep 08 06:56:19 devstack sudo[112526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-32cb0d82-ded9-4cac-bba3-967cdaa1cdf8 tempest-CreateVolumesFromImageTest-1799318689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:56:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-32cb0d82-ded9-4cac-bba3-967cdaa1cdf8 tempest-CreateVolumesFromImageTest-1799318689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:56:19 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-32cb0d82-ded9-4cac-bba3-967cdaa1cdf8 tempest-CreateVolumesFromImageTest-1799318689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:56:19 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-32cb0d82-ded9-4cac-bba3-967cdaa1cdf8 tempest-CreateVolumesFromImageTest-1799318689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:56:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-32cb0d82-ded9-4cac-bba3-967cdaa1cdf8 tempest-CreateVolumesFromImageTest-1799318689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:56:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-32cb0d82-ded9-4cac-bba3-967cdaa1cdf8 tempest-CreateVolumesFromImageTest-1799318689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:19 devstack sudo[112531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:56:19 devstack sudo[112531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:20 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-dfbe3057-1b9c-49d6-a171-ead689fd1bdc tempest-CreateVolumesFromImageTest-1799318689 None] Acquiring lock "cinder-887242e7-0543-4761-8d3f-0321bee5af7e-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:56:20 devstack cinder-volume[87507]: DEBUG oslo_service.periodic_task [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87507) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 06:56:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:56:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:56:20 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:56:20 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:56:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:56:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:20 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-dfbe3057-1b9c-49d6-a171-ead689fd1bdc tempest-CreateVolumesFromImageTest-1799318689 None] Lock "cinder-887242e7-0543-4761-8d3f-0321bee5af7e-delete_volume" acquired by "delete_volume" :: waited 0.134s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:56:20 devstack sudo[112539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:56:20 devstack sudo[112539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:20 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-dfbe3057-1b9c-49d6-a171-ead689fd1bdc tempest-CreateVolumesFromImageTest-1799318689 None] Acquiring lock "cinder-quobyte-887242e7-0543-4761-8d3f-0321bee5af7e" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:56:20 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-dfbe3057-1b9c-49d6-a171-ead689fd1bdc tempest-CreateVolumesFromImageTest-1799318689 None] Lock "cinder-quobyte-887242e7-0543-4761-8d3f-0321bee5af7e" acquired by "delete_volume" :: waited 0.037s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:56:20 devstack sudo[112531]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:20 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd67acb-6598-4ba0-abfd-d264147b2d29]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:56:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-dfbe3057-1b9c-49d6-a171-ead689fd1bdc tempest-CreateVolumesFromImageTest-1799318689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-887242e7-0543-4761-8d3f-0321bee5af7e {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-32cb0d82-ded9-4cac-bba3-967cdaa1cdf8 tempest-CreateVolumesFromImageTest-1799318689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.553s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:20 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-32cb0d82-ded9-4cac-bba3-967cdaa1cdf8 tempest-CreateVolumesFromImageTest-1799318689 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:56:20 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-32cb0d82-ded9-4cac-bba3-967cdaa1cdf8 tempest-CreateVolumesFromImageTest-1799318689 None] Deleted volume successfully. Sep 08 06:56:20 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-32cb0d82-ded9-4cac-bba3-967cdaa1cdf8 tempest-CreateVolumesFromImageTest-1799318689 None] Lock "cinder-634ccd0f-0c31-41c8-a2ba-ec2bb0ec3fce-delete_volume" released by "delete_volume" :: held 1.769s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:56:20 devstack sudo[112539]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.545s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:20 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:56:20 devstack cinder-volume[87507]: DEBUG oslo_service.periodic_task [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Running periodic task VolumeManager._thread_info {{(pid=87507) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 06:56:20 devstack sudo[112555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-887242e7-0543-4761-8d3f-0321bee5af7e Sep 08 06:56:20 devstack sudo[112555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:20 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] thread count: 29 {{(pid=87507) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 06:56:20 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] thread info: [<_MainThread(MainThread, started 127913129345152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87507) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 06:56:20 devstack sudo[112555]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-dfbe3057-1b9c-49d6-a171-ead689fd1bdc tempest-CreateVolumesFromImageTest-1799318689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-887242e7-0543-4761-8d3f-0321bee5af7e" returned: 0 in 0.513s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-dfbe3057-1b9c-49d6-a171-ead689fd1bdc tempest-CreateVolumesFromImageTest-1799318689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-887242e7-0543-4761-8d3f-0321bee5af7e {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:20 devstack sudo[112578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-887242e7-0543-4761-8d3f-0321bee5af7e Sep 08 06:56:20 devstack sudo[112578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:21 devstack sudo[112578]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:21 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-dfbe3057-1b9c-49d6-a171-ead689fd1bdc tempest-CreateVolumesFromImageTest-1799318689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-887242e7-0543-4761-8d3f-0321bee5af7e" returned: 0 in 0.442s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:21 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-dfbe3057-1b9c-49d6-a171-ead689fd1bdc tempest-CreateVolumesFromImageTest-1799318689 None] Lock "cinder-quobyte-887242e7-0543-4761-8d3f-0321bee5af7e" released by "delete_volume" :: held 1.012s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:56:21 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-dfbe3057-1b9c-49d6-a171-ead689fd1bdc tempest-CreateVolumesFromImageTest-1799318689 None] Created reservations ['ef8364c6-e1d5-4557-ab31-38e4f918c99c', 'bb552d61-690c-4469-a805-5aa791adf479', 'abbe2cfb-cd58-4841-ae25-071adeebe3fb', '4e66da92-e516-43f5-a847-0a9e79963485'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:56:21 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-dfbe3057-1b9c-49d6-a171-ead689fd1bdc tempest-CreateVolumesFromImageTest-1799318689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:56:21 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-dfbe3057-1b9c-49d6-a171-ead689fd1bdc tempest-CreateVolumesFromImageTest-1799318689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:56:21 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-dfbe3057-1b9c-49d6-a171-ead689fd1bdc tempest-CreateVolumesFromImageTest-1799318689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:56:21 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-dfbe3057-1b9c-49d6-a171-ead689fd1bdc tempest-CreateVolumesFromImageTest-1799318689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:56:21 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-dfbe3057-1b9c-49d6-a171-ead689fd1bdc tempest-CreateVolumesFromImageTest-1799318689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:56:21 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-dfbe3057-1b9c-49d6-a171-ead689fd1bdc tempest-CreateVolumesFromImageTest-1799318689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:21 devstack sudo[112601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:56:21 devstack sudo[112601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:21 devstack sudo[112601]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:21 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-dfbe3057-1b9c-49d6-a171-ead689fd1bdc tempest-CreateVolumesFromImageTest-1799318689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.295s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:21 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-dfbe3057-1b9c-49d6-a171-ead689fd1bdc tempest-CreateVolumesFromImageTest-1799318689 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:56:21 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-dfbe3057-1b9c-49d6-a171-ead689fd1bdc tempest-CreateVolumesFromImageTest-1799318689 None] Deleted volume successfully. Sep 08 06:56:21 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-dfbe3057-1b9c-49d6-a171-ead689fd1bdc tempest-CreateVolumesFromImageTest-1799318689 None] Lock "cinder-887242e7-0543-4761-8d3f-0321bee5af7e-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:56:22 devstack sudo[112526]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:22 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ab1007dc-1216-4ad6-ba27-2a94dacc4935 tempest-VolumesExtendTest-1511794103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_0xamubkcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e8f47f4a-fe67-47ab-8217-86e66c817989" returned: 0 in 2.589s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:22 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-ab1007dc-1216-4ad6-ba27-2a94dacc4935 tempest-VolumesExtendTest-1511794103 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_69da6bac-8b7b-48c5-af3b-29466563452a_0xamubkcdevstack@QuobyteHD, size 112.00 MB, duration 2.59 sec, destination /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e8f47f4a-fe67-47ab-8217-86e66c817989 {{(pid=87507) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 06:56:22 devstack cinder-volume[87507]: INFO cinder.image.image_utils [None req-ab1007dc-1216-4ad6-ba27-2a94dacc4935 tempest-VolumesExtendTest-1511794103 None] Converted 112.00 MB image at 43.16 MB/s Sep 08 06:56:22 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ab1007dc-1216-4ad6-ba27-2a94dacc4935 tempest-VolumesExtendTest-1511794103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e8f47f4a-fe67-47ab-8217-86e66c817989 1G {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:22 devstack sudo[112630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e8f47f4a-fe67-47ab-8217-86e66c817989 1G Sep 08 06:56:22 devstack sudo[112630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:22 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-4514b679-7d85-4f35-bf91-c8b112db592c tempest-CreateVolumesFromImageTest-1799318689 None] Acquiring lock "cinder-06e79379-3b15-4e70-9ef9-b0423fcedb7f-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:56:22 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-4514b679-7d85-4f35-bf91-c8b112db592c tempest-CreateVolumesFromImageTest-1799318689 None] Lock "cinder-06e79379-3b15-4e70-9ef9-b0423fcedb7f-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:56:22 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-4514b679-7d85-4f35-bf91-c8b112db592c tempest-CreateVolumesFromImageTest-1799318689 None] Acquiring lock "cinder-quobyte-06e79379-3b15-4e70-9ef9-b0423fcedb7f" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:56:22 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-4514b679-7d85-4f35-bf91-c8b112db592c tempest-CreateVolumesFromImageTest-1799318689 None] Lock "cinder-quobyte-06e79379-3b15-4e70-9ef9-b0423fcedb7f" acquired by "delete_volume" :: waited 0.021s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:56:22 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4251a322-9d46-4d5b-9dd0-9cecdf039e7b]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:56:22 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4514b679-7d85-4f35-bf91-c8b112db592c tempest-CreateVolumesFromImageTest-1799318689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-06e79379-3b15-4e70-9ef9-b0423fcedb7f {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:22 devstack sudo[112643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-06e79379-3b15-4e70-9ef9-b0423fcedb7f Sep 08 06:56:22 devstack sudo[112643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:22 devstack sudo[112630]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:22 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ab1007dc-1216-4ad6-ba27-2a94dacc4935 tempest-VolumesExtendTest-1511794103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e8f47f4a-fe67-47ab-8217-86e66c817989 1G" returned: 0 in 0.541s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:22 devstack cinder-volume[87507]: DEBUG cinder.volume.volume_utils [None req-ab1007dc-1216-4ad6-ba27-2a94dacc4935 tempest-VolumesExtendTest-1511794103 None] Downloaded image 69da6bac-8b7b-48c5-af3b-29466563452a ((None, [{'url': 'file:///opt/stack/data/glance/images/69da6bac-8b7b-48c5-af3b-29466563452a', 'metadata': {}}])) to volume e8f47f4a-fe67-47ab-8217-86e66c817989 successfully. {{(pid=87507) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 08 06:56:22 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-ab1007dc-1216-4ad6-ba27-2a94dacc4935 tempest-VolumesExtendTest-1511794103 None] Temporary image 69da6bac-8b7b-48c5-af3b-29466563452a for user d13c663628ef44f296ca96fc4495bbe7 is deleted. {{(pid=87507) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 08 06:56:22 devstack cinder-volume[87507]: DEBUG cinder.volume.volume_utils [None req-ab1007dc-1216-4ad6-ba27-2a94dacc4935 tempest-VolumesExtendTest-1511794103 None] Marking volume e8f47f4a-fe67-47ab-8217-86e66c817989 as bootable. {{(pid=87507) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 08 06:56:22 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab1007dc-1216-4ad6-ba27-2a94dacc4935 tempest-VolumesExtendTest-1511794103 None] Copying metadata from image 69da6bac-8b7b-48c5-af3b-29466563452a to e8f47f4a-fe67-47ab-8217-86e66c817989. {{(pid=87507) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 08 06:56:22 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab1007dc-1216-4ad6-ba27-2a94dacc4935 tempest-VolumesExtendTest-1511794103 None] Creating volume glance metadata for volume e8f47f4a-fe67-47ab-8217-86e66c817989 backed by image 69da6bac-8b7b-48c5-af3b-29466563452a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '69da6bac-8b7b-48c5-af3b-29466563452a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87507) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 08 06:56:23 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ab1007dc-1216-4ad6-ba27-2a94dacc4935 tempest-VolumesExtendTest-1511794103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ff2a1b6-3591-432f-97cd-9dcd04ca0ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8f47f4a-fe67-47ab-8217-86e66c817989', 'volume_size': 1, 'image_id': '69da6bac-8b7b-48c5-af3b-29466563452a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/69da6bac-8b7b-48c5-af3b-29466563452a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '95d2d5dbb3e04d74b8da31fc6ee47f98', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '69da6bac-8b7b-48c5-af3b-29466563452a', 'created_at': datetime.datetime(2026, 9, 8, 4, 36, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 4, 36, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/69da6bac-8b7b-48c5-af3b-29466563452a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:23 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ab1007dc-1216-4ad6-ba27-2a94dacc4935 tempest-VolumesExtendTest-1511794103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01abff8f-7f61-49f3-b509-3a4f072dd596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:23 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-ab1007dc-1216-4ad6-ba27-2a94dacc4935 tempest-VolumesExtendTest-1511794103 None] Volume volume-e8f47f4a-fe67-47ab-8217-86e66c817989 (e8f47f4a-fe67-47ab-8217-86e66c817989): created successfully Sep 08 06:56:23 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ab1007dc-1216-4ad6-ba27-2a94dacc4935 tempest-VolumesExtendTest-1511794103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01abff8f-7f61-49f3-b509-3a4f072dd596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:23 devstack sudo[112643]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:23 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ab1007dc-1216-4ad6-ba27-2a94dacc4935 tempest-VolumesExtendTest-1511794103 None] Flow 'volume_create_manager' (6583ce7a-d720-4ffe-a8b7-0b89c410ff90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:56:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4514b679-7d85-4f35-bf91-c8b112db592c tempest-CreateVolumesFromImageTest-1799318689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-06e79379-3b15-4e70-9ef9-b0423fcedb7f" returned: 0 in 0.490s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4514b679-7d85-4f35-bf91-c8b112db592c tempest-CreateVolumesFromImageTest-1799318689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-06e79379-3b15-4e70-9ef9-b0423fcedb7f {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:23 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-ab1007dc-1216-4ad6-ba27-2a94dacc4935 tempest-VolumesExtendTest-1511794103 None] Created volume successfully. Sep 08 06:56:23 devstack sudo[112666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-06e79379-3b15-4e70-9ef9-b0423fcedb7f Sep 08 06:56:23 devstack sudo[112666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:23 devstack sudo[112666]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4514b679-7d85-4f35-bf91-c8b112db592c tempest-CreateVolumesFromImageTest-1799318689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-06e79379-3b15-4e70-9ef9-b0423fcedb7f" returned: 0 in 0.288s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:23 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-4514b679-7d85-4f35-bf91-c8b112db592c tempest-CreateVolumesFromImageTest-1799318689 None] Lock "cinder-quobyte-06e79379-3b15-4e70-9ef9-b0423fcedb7f" released by "delete_volume" :: held 0.833s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:56:23 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-4514b679-7d85-4f35-bf91-c8b112db592c tempest-CreateVolumesFromImageTest-1799318689 None] Created reservations ['bd47a442-98fc-40ec-ac47-7b8b0f51877a', 'd454b603-0efb-4ca8-9c82-2580427babd1', 'd32aeb9b-559e-4e54-b493-b53c9d381661', '2d1e239d-5969-4639-9653-b7e1647cf49e'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:56:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4514b679-7d85-4f35-bf91-c8b112db592c tempest-CreateVolumesFromImageTest-1799318689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:56:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4514b679-7d85-4f35-bf91-c8b112db592c tempest-CreateVolumesFromImageTest-1799318689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:56:23 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-4514b679-7d85-4f35-bf91-c8b112db592c tempest-CreateVolumesFromImageTest-1799318689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:56:23 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-4514b679-7d85-4f35-bf91-c8b112db592c tempest-CreateVolumesFromImageTest-1799318689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:56:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4514b679-7d85-4f35-bf91-c8b112db592c tempest-CreateVolumesFromImageTest-1799318689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:56:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4514b679-7d85-4f35-bf91-c8b112db592c tempest-CreateVolumesFromImageTest-1799318689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:23 devstack sudo[112681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:56:23 devstack sudo[112681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:23 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-4d9a1262-54f1-469d-bcc6-6e65f69b0887 tempest-CreateVolumesFromImageTest-1799318689 None] Acquiring lock "cinder-eea5c0da-a142-408e-930b-19899a7d08bd-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:56:23 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-4d9a1262-54f1-469d-bcc6-6e65f69b0887 tempest-CreateVolumesFromImageTest-1799318689 None] Lock "cinder-eea5c0da-a142-408e-930b-19899a7d08bd-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:56:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-2c8fa177-b53b-41a1-ac0b-4a80d4208262 tempest-VolumesExtendTest-1511794103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:56:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-2c8fa177-b53b-41a1-ac0b-4a80d4208262 tempest-VolumesExtendTest-1511794103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:56:23 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[89934d64-cc9b-4c21-ad5a-665c6544c126]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:56:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2c8fa177-b53b-41a1-ac0b-4a80d4208262 tempest-VolumesExtendTest-1511794103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e8f47f4a-fe67-47ab-8217-86e66c817989 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:23 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-4d9a1262-54f1-469d-bcc6-6e65f69b0887 tempest-CreateVolumesFromImageTest-1799318689 None] Acquiring lock "cinder-quobyte-eea5c0da-a142-408e-930b-19899a7d08bd" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:56:23 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-4d9a1262-54f1-469d-bcc6-6e65f69b0887 tempest-CreateVolumesFromImageTest-1799318689 None] Lock "cinder-quobyte-eea5c0da-a142-408e-930b-19899a7d08bd" acquired by "delete_volume" :: waited 0.027s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:56:24 devstack sudo[112725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e8f47f4a-fe67-47ab-8217-86e66c817989 Sep 08 06:56:24 devstack sudo[112725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:24 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6850e066-67be-4fd8-8f83-505e80ea5f05]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:56:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4d9a1262-54f1-469d-bcc6-6e65f69b0887 tempest-CreateVolumesFromImageTest-1799318689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-eea5c0da-a142-408e-930b-19899a7d08bd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:24 devstack sudo[112681]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4514b679-7d85-4f35-bf91-c8b112db592c tempest-CreateVolumesFromImageTest-1799318689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.550s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:24 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-4514b679-7d85-4f35-bf91-c8b112db592c tempest-CreateVolumesFromImageTest-1799318689 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:56:24 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-4514b679-7d85-4f35-bf91-c8b112db592c tempest-CreateVolumesFromImageTest-1799318689 None] Deleted volume successfully. Sep 08 06:56:24 devstack sudo[112731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-eea5c0da-a142-408e-930b-19899a7d08bd Sep 08 06:56:24 devstack sudo[112731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:24 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-4514b679-7d85-4f35-bf91-c8b112db592c tempest-CreateVolumesFromImageTest-1799318689 None] Lock "cinder-06e79379-3b15-4e70-9ef9-b0423fcedb7f-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:56:24 devstack sudo[112725]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2c8fa177-b53b-41a1-ac0b-4a80d4208262 tempest-VolumesExtendTest-1511794103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e8f47f4a-fe67-47ab-8217-86e66c817989" returned: 0 in 0.485s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2c8fa177-b53b-41a1-ac0b-4a80d4208262 tempest-VolumesExtendTest-1511794103 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e8f47f4a-fe67-47ab-8217-86e66c817989 2G {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2c8fa177-b53b-41a1-ac0b-4a80d4208262 tempest-VolumesExtendTest-1511794103 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e8f47f4a-fe67-47ab-8217-86e66c817989 2G" returned: 0 in 0.144s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-2c8fa177-b53b-41a1-ac0b-4a80d4208262 tempest-VolumesExtendTest-1511794103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.678s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:56:24 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-2c8fa177-b53b-41a1-ac0b-4a80d4208262 tempest-VolumesExtendTest-1511794103 None] Extend volume completed successfully. Sep 08 06:56:24 devstack sudo[112731]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4d9a1262-54f1-469d-bcc6-6e65f69b0887 tempest-CreateVolumesFromImageTest-1799318689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-eea5c0da-a142-408e-930b-19899a7d08bd" returned: 0 in 0.515s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4d9a1262-54f1-469d-bcc6-6e65f69b0887 tempest-CreateVolumesFromImageTest-1799318689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-eea5c0da-a142-408e-930b-19899a7d08bd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:24 devstack sudo[112760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-eea5c0da-a142-408e-930b-19899a7d08bd Sep 08 06:56:24 devstack sudo[112760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:24 devstack sudo[112760]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4d9a1262-54f1-469d-bcc6-6e65f69b0887 tempest-CreateVolumesFromImageTest-1799318689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-eea5c0da-a142-408e-930b-19899a7d08bd" returned: 0 in 0.256s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:24 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-4d9a1262-54f1-469d-bcc6-6e65f69b0887 tempest-CreateVolumesFromImageTest-1799318689 None] Lock "cinder-quobyte-eea5c0da-a142-408e-930b-19899a7d08bd" released by "delete_volume" :: held 0.891s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:56:24 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-4d9a1262-54f1-469d-bcc6-6e65f69b0887 tempest-CreateVolumesFromImageTest-1799318689 None] Created reservations ['117b1996-e5df-454d-8a01-ccb1c3daa0dc', '83b16016-306a-4939-b373-dc4659be8d84', 'b88f4f62-9ac3-4b69-8981-2232fc2b6e48', 'f5fadcc3-32ec-448d-a1d8-98d0e50b10a4'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:56:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4d9a1262-54f1-469d-bcc6-6e65f69b0887 tempest-CreateVolumesFromImageTest-1799318689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:56:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4d9a1262-54f1-469d-bcc6-6e65f69b0887 tempest-CreateVolumesFromImageTest-1799318689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:56:24 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-4d9a1262-54f1-469d-bcc6-6e65f69b0887 tempest-CreateVolumesFromImageTest-1799318689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:56:24 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-4d9a1262-54f1-469d-bcc6-6e65f69b0887 tempest-CreateVolumesFromImageTest-1799318689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:56:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4d9a1262-54f1-469d-bcc6-6e65f69b0887 tempest-CreateVolumesFromImageTest-1799318689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:56:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4d9a1262-54f1-469d-bcc6-6e65f69b0887 tempest-CreateVolumesFromImageTest-1799318689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:25 devstack sudo[112775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:56:25 devstack sudo[112775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:25 devstack sudo[112775]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4d9a1262-54f1-469d-bcc6-6e65f69b0887 tempest-CreateVolumesFromImageTest-1799318689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.272s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:25 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-4d9a1262-54f1-469d-bcc6-6e65f69b0887 tempest-CreateVolumesFromImageTest-1799318689 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:56:25 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-4d9a1262-54f1-469d-bcc6-6e65f69b0887 tempest-CreateVolumesFromImageTest-1799318689 None] Deleted volume successfully. Sep 08 06:56:25 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-4d9a1262-54f1-469d-bcc6-6e65f69b0887 tempest-CreateVolumesFromImageTest-1799318689 None] Lock "cinder-eea5c0da-a142-408e-930b-19899a7d08bd-delete_volume" released by "delete_volume" :: held 1.508s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:56:25 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-d0239892-f831-45e9-b301-335e6742560f tempest-VolumesExtendTest-1511794103 None] Acquiring lock "cinder-e8f47f4a-fe67-47ab-8217-86e66c817989-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:56:25 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-d0239892-f831-45e9-b301-335e6742560f tempest-VolumesExtendTest-1511794103 None] Lock "cinder-e8f47f4a-fe67-47ab-8217-86e66c817989-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:56:25 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-d0239892-f831-45e9-b301-335e6742560f tempest-VolumesExtendTest-1511794103 None] Acquiring lock "cinder-quobyte-e8f47f4a-fe67-47ab-8217-86e66c817989" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:56:25 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-d0239892-f831-45e9-b301-335e6742560f tempest-VolumesExtendTest-1511794103 None] Lock "cinder-quobyte-e8f47f4a-fe67-47ab-8217-86e66c817989" acquired by "delete_volume" :: waited 0.016s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:56:25 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2769e5a2-eee3-4f92-bb2c-839590726e66]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:56:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-d0239892-f831-45e9-b301-335e6742560f tempest-VolumesExtendTest-1511794103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e8f47f4a-fe67-47ab-8217-86e66c817989 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:25 devstack sudo[112793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e8f47f4a-fe67-47ab-8217-86e66c817989 Sep 08 06:56:25 devstack sudo[112793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:25 devstack sudo[112793]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-d0239892-f831-45e9-b301-335e6742560f tempest-VolumesExtendTest-1511794103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e8f47f4a-fe67-47ab-8217-86e66c817989" returned: 0 in 0.362s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-d0239892-f831-45e9-b301-335e6742560f tempest-VolumesExtendTest-1511794103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e8f47f4a-fe67-47ab-8217-86e66c817989 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:25 devstack sudo[112810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e8f47f4a-fe67-47ab-8217-86e66c817989 Sep 08 06:56:25 devstack sudo[112810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:26 devstack sudo[112810]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:26 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-6c5c8c89-7266-4197-ad33-e03ec0bc1f18 tempest-CreateVolumesFromImageTest-1799318689 None] Acquiring lock "cinder-0d37fb77-ebbb-4321-b5cf-4d4b9f8c1fa0-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:56:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-d0239892-f831-45e9-b301-335e6742560f tempest-VolumesExtendTest-1511794103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e8f47f4a-fe67-47ab-8217-86e66c817989" returned: 0 in 0.270s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:26 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-d0239892-f831-45e9-b301-335e6742560f tempest-VolumesExtendTest-1511794103 None] Lock "cinder-quobyte-e8f47f4a-fe67-47ab-8217-86e66c817989" released by "delete_volume" :: held 0.690s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:56:26 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-6c5c8c89-7266-4197-ad33-e03ec0bc1f18 tempest-CreateVolumesFromImageTest-1799318689 None] Lock "cinder-0d37fb77-ebbb-4321-b5cf-4d4b9f8c1fa0-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:56:26 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-6c5c8c89-7266-4197-ad33-e03ec0bc1f18 tempest-CreateVolumesFromImageTest-1799318689 None] Acquiring lock "cinder-quobyte-0d37fb77-ebbb-4321-b5cf-4d4b9f8c1fa0" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:56:26 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-6c5c8c89-7266-4197-ad33-e03ec0bc1f18 tempest-CreateVolumesFromImageTest-1799318689 None] Lock "cinder-quobyte-0d37fb77-ebbb-4321-b5cf-4d4b9f8c1fa0" acquired by "delete_volume" :: waited 0.030s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:56:26 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-d0239892-f831-45e9-b301-335e6742560f tempest-VolumesExtendTest-1511794103 None] Created reservations ['360739c0-70e6-4c18-a823-96cb9e338e4a', '2f3ce1bb-0298-427d-a44e-29f840f88039', 'b9ab5eb8-35f6-4f84-9247-291e7f429bd2', 'bbdb07d2-a21f-4d4d-b8dc-a78ea5589ad6'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:56:26 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e975f744-46fe-491e-8fc9-4ed92e32fb2e]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:56:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6c5c8c89-7266-4197-ad33-e03ec0bc1f18 tempest-CreateVolumesFromImageTest-1799318689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0d37fb77-ebbb-4321-b5cf-4d4b9f8c1fa0 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-d0239892-f831-45e9-b301-335e6742560f tempest-VolumesExtendTest-1511794103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:56:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-d0239892-f831-45e9-b301-335e6742560f tempest-VolumesExtendTest-1511794103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:56:26 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-d0239892-f831-45e9-b301-335e6742560f tempest-VolumesExtendTest-1511794103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:56:26 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-d0239892-f831-45e9-b301-335e6742560f tempest-VolumesExtendTest-1511794103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:56:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-d0239892-f831-45e9-b301-335e6742560f tempest-VolumesExtendTest-1511794103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:56:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-d0239892-f831-45e9-b301-335e6742560f tempest-VolumesExtendTest-1511794103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:26 devstack sudo[112829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:56:26 devstack sudo[112829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:26 devstack sudo[112825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0d37fb77-ebbb-4321-b5cf-4d4b9f8c1fa0 Sep 08 06:56:26 devstack sudo[112825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:26 devstack sudo[112829]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-d0239892-f831-45e9-b301-335e6742560f tempest-VolumesExtendTest-1511794103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.293s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:26 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-d0239892-f831-45e9-b301-335e6742560f tempest-VolumesExtendTest-1511794103 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:56:26 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-d0239892-f831-45e9-b301-335e6742560f tempest-VolumesExtendTest-1511794103 None] Deleted volume successfully. Sep 08 06:56:26 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-d0239892-f831-45e9-b301-335e6742560f tempest-VolumesExtendTest-1511794103 None] Lock "cinder-e8f47f4a-fe67-47ab-8217-86e66c817989-delete_volume" released by "delete_volume" :: held 1.294s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:56:26 devstack sudo[112825]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6c5c8c89-7266-4197-ad33-e03ec0bc1f18 tempest-CreateVolumesFromImageTest-1799318689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0d37fb77-ebbb-4321-b5cf-4d4b9f8c1fa0" returned: 0 in 0.494s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6c5c8c89-7266-4197-ad33-e03ec0bc1f18 tempest-CreateVolumesFromImageTest-1799318689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0d37fb77-ebbb-4321-b5cf-4d4b9f8c1fa0 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:26 devstack sudo[112848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0d37fb77-ebbb-4321-b5cf-4d4b9f8c1fa0 Sep 08 06:56:26 devstack sudo[112848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:27 devstack sudo[112848]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:27 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6c5c8c89-7266-4197-ad33-e03ec0bc1f18 tempest-CreateVolumesFromImageTest-1799318689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0d37fb77-ebbb-4321-b5cf-4d4b9f8c1fa0" returned: 0 in 0.292s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:27 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-6c5c8c89-7266-4197-ad33-e03ec0bc1f18 tempest-CreateVolumesFromImageTest-1799318689 None] Lock "cinder-quobyte-0d37fb77-ebbb-4321-b5cf-4d4b9f8c1fa0" released by "delete_volume" :: held 0.836s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:56:27 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-6c5c8c89-7266-4197-ad33-e03ec0bc1f18 tempest-CreateVolumesFromImageTest-1799318689 None] Created reservations ['828c1409-d90e-4dcc-937d-133aa937f4a0', '879cd362-0aa6-47da-a93d-701b65159e1a', '03ae1f50-fa15-4382-8e81-87d379944eea', '812f9a63-b0fa-496d-a5da-0af4568d4116'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:56:27 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc6bc941-5c77-4552-9c6c-23a09bf138f6 tempest-VolumesExtendTest-1511794103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:56:27 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-fc6bc941-5c77-4552-9c6c-23a09bf138f6 tempest-VolumesExtendTest-1511794103 None] Flow 'volume_create_manager' (93b19af6-3cb3-48a4-b2ea-eea3929174eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:56:27 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-fc6bc941-5c77-4552-9c6c-23a09bf138f6 tempest-VolumesExtendTest-1511794103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91120061-1332-45d6-abbe-848370473bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:27 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-fc6bc941-5c77-4552-9c6c-23a09bf138f6 tempest-VolumesExtendTest-1511794103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91120061-1332-45d6-abbe-848370473bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:56:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-626156038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74e91bf7-73d6-4824-ad2d-f55874c4e7f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92f6cd589e8544fc971aa1391189d34d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:56:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:56:27Z,use_quota=True,user_id='d13c663628ef44f296ca96fc4495bbe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:27 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-fc6bc941-5c77-4552-9c6c-23a09bf138f6 tempest-VolumesExtendTest-1511794103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9dfe1c6-5f28-4fe3-a22a-b508ee296855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:27 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-fc6bc941-5c77-4552-9c6c-23a09bf138f6 tempest-VolumesExtendTest-1511794103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9dfe1c6-5f28-4fe3-a22a-b508ee296855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:27 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-fc6bc941-5c77-4552-9c6c-23a09bf138f6 tempest-VolumesExtendTest-1511794103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (024d9cf5-2dcb-478e-a20a-bfdbf09e7962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:27 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-fc6bc941-5c77-4552-9c6c-23a09bf138f6 tempest-VolumesExtendTest-1511794103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (024d9cf5-2dcb-478e-a20a-bfdbf09e7962) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74e91bf7-73d6-4824-ad2d-f55874c4e7f1', 'volume_name': 'volume-74e91bf7-73d6-4824-ad2d-f55874c4e7f1', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:27 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-fc6bc941-5c77-4552-9c6c-23a09bf138f6 tempest-VolumesExtendTest-1511794103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (331f7f20-8c20-4ef3-a671-6119ac55caaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:27 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-fc6bc941-5c77-4552-9c6c-23a09bf138f6 tempest-VolumesExtendTest-1511794103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (331f7f20-8c20-4ef3-a671-6119ac55caaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:27 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-fc6bc941-5c77-4552-9c6c-23a09bf138f6 tempest-VolumesExtendTest-1511794103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0605f03-e024-49ea-adf5-ba661b16d029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:27 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-fc6bc941-5c77-4552-9c6c-23a09bf138f6 tempest-VolumesExtendTest-1511794103 None] Volume 74e91bf7-73d6-4824-ad2d-f55874c4e7f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74e91bf7-73d6-4824-ad2d-f55874c4e7f1', 'volume_size': 1} Sep 08 06:56:27 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-fc6bc941-5c77-4552-9c6c-23a09bf138f6 tempest-VolumesExtendTest-1511794103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:56:27 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-fc6bc941-5c77-4552-9c6c-23a09bf138f6 tempest-VolumesExtendTest-1511794103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:56:27 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-fc6bc941-5c77-4552-9c6c-23a09bf138f6 tempest-VolumesExtendTest-1511794103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:56:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-626156038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74e91bf7-73d6-4824-ad2d-f55874c4e7f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92f6cd589e8544fc971aa1391189d34d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:56:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:56:27Z,use_quota=True,user_id='d13c663628ef44f296ca96fc4495bbe7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:56:27 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-fc6bc941-5c77-4552-9c6c-23a09bf138f6 tempest-VolumesExtendTest-1511794103 None] Creating volume 74e91bf7-73d6-4824-ad2d-f55874c4e7f1 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:56:27 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-fc6bc941-5c77-4552-9c6c-23a09bf138f6 tempest-VolumesExtendTest-1511794103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:56:27 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-fc6bc941-5c77-4552-9c6c-23a09bf138f6 tempest-VolumesExtendTest-1511794103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:56:27 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-fc6bc941-5c77-4552-9c6c-23a09bf138f6 tempest-VolumesExtendTest-1511794103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:56:27 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-fc6bc941-5c77-4552-9c6c-23a09bf138f6 tempest-VolumesExtendTest-1511794103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:56:27 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-fc6bc941-5c77-4552-9c6c-23a09bf138f6 tempest-VolumesExtendTest-1511794103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:56:27 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-fc6bc941-5c77-4552-9c6c-23a09bf138f6 tempest-VolumesExtendTest-1511794103 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:56:27 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-fc6bc941-5c77-4552-9c6c-23a09bf138f6 tempest-VolumesExtendTest-1511794103 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:56:27 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-fc6bc941-5c77-4552-9c6c-23a09bf138f6 tempest-VolumesExtendTest-1511794103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-74e91bf7-73d6-4824-ad2d-f55874c4e7f1 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:27 devstack sudo[112866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-74e91bf7-73d6-4824-ad2d-f55874c4e7f1 1073741824 Sep 08 06:56:27 devstack sudo[112866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:27 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-6c5c8c89-7266-4197-ad33-e03ec0bc1f18 tempest-CreateVolumesFromImageTest-1799318689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:56:27 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-6c5c8c89-7266-4197-ad33-e03ec0bc1f18 tempest-CreateVolumesFromImageTest-1799318689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:56:27 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-6c5c8c89-7266-4197-ad33-e03ec0bc1f18 tempest-CreateVolumesFromImageTest-1799318689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:56:27 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-6c5c8c89-7266-4197-ad33-e03ec0bc1f18 tempest-CreateVolumesFromImageTest-1799318689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:56:27 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-6c5c8c89-7266-4197-ad33-e03ec0bc1f18 tempest-CreateVolumesFromImageTest-1799318689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:56:27 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6c5c8c89-7266-4197-ad33-e03ec0bc1f18 tempest-CreateVolumesFromImageTest-1799318689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:27 devstack sudo[112871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:56:27 devstack sudo[112871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:27 devstack sudo[112871]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:27 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6c5c8c89-7266-4197-ad33-e03ec0bc1f18 tempest-CreateVolumesFromImageTest-1799318689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.264s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:27 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-6c5c8c89-7266-4197-ad33-e03ec0bc1f18 tempest-CreateVolumesFromImageTest-1799318689 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:56:27 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-6c5c8c89-7266-4197-ad33-e03ec0bc1f18 tempest-CreateVolumesFromImageTest-1799318689 None] Deleted volume successfully. Sep 08 06:56:27 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-6c5c8c89-7266-4197-ad33-e03ec0bc1f18 tempest-CreateVolumesFromImageTest-1799318689 None] Lock "cinder-0d37fb77-ebbb-4321-b5cf-4d4b9f8c1fa0-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:56:27 devstack sudo[112866]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:27 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-fc6bc941-5c77-4552-9c6c-23a09bf138f6 tempest-VolumesExtendTest-1511794103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-74e91bf7-73d6-4824-ad2d-f55874c4e7f1 1073741824" returned: 0 in 0.463s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:27 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-fc6bc941-5c77-4552-9c6c-23a09bf138f6 tempest-VolumesExtendTest-1511794103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-74e91bf7-73d6-4824-ad2d-f55874c4e7f1 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:27 devstack sudo[112890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-74e91bf7-73d6-4824-ad2d-f55874c4e7f1 Sep 08 06:56:27 devstack sudo[112890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:27 devstack sudo[112890]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:28 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-fc6bc941-5c77-4552-9c6c-23a09bf138f6 tempest-VolumesExtendTest-1511794103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-74e91bf7-73d6-4824-ad2d-f55874c4e7f1" returned: 0 in 0.253s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:28 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-fc6bc941-5c77-4552-9c6c-23a09bf138f6 tempest-VolumesExtendTest-1511794103 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:56:28 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-fc6bc941-5c77-4552-9c6c-23a09bf138f6 tempest-VolumesExtendTest-1511794103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:56:28 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-fc6bc941-5c77-4552-9c6c-23a09bf138f6 tempest-VolumesExtendTest-1511794103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0605f03-e024-49ea-adf5-ba661b16d029) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74e91bf7-73d6-4824-ad2d-f55874c4e7f1', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:28 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-fc6bc941-5c77-4552-9c6c-23a09bf138f6 tempest-VolumesExtendTest-1511794103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e481d5e-cdf0-418b-b40d-3af2029e2adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:28 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-fc6bc941-5c77-4552-9c6c-23a09bf138f6 tempest-VolumesExtendTest-1511794103 None] Volume volume-74e91bf7-73d6-4824-ad2d-f55874c4e7f1 (74e91bf7-73d6-4824-ad2d-f55874c4e7f1): created successfully Sep 08 06:56:28 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-fc6bc941-5c77-4552-9c6c-23a09bf138f6 tempest-VolumesExtendTest-1511794103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e481d5e-cdf0-418b-b40d-3af2029e2adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:28 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-fc6bc941-5c77-4552-9c6c-23a09bf138f6 tempest-VolumesExtendTest-1511794103 None] Flow 'volume_create_manager' (93b19af6-3cb3-48a4-b2ea-eea3929174eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:56:28 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-fc6bc941-5c77-4552-9c6c-23a09bf138f6 tempest-VolumesExtendTest-1511794103 None] Created volume successfully. Sep 08 06:56:29 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a7ee5feb-e008-4723-a22b-72ec7ee9e927 tempest-VolumesExtendTest-1511794103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:56:29 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a7ee5feb-e008-4723-a22b-72ec7ee9e927 tempest-VolumesExtendTest-1511794103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:56:29 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-a7ee5feb-e008-4723-a22b-72ec7ee9e927 tempest-VolumesExtendTest-1511794103 None] Creating offline snapshot fca6339a-fbc6-4055-b0bc-9b5ca2b92fc9 of volume 74e91bf7-73d6-4824-ad2d-f55874c4e7f1 {{(pid=87507) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 06:56:29 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3a8ccf-4520-4cc2-aaf5-5b39a842bd0b]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:56:29 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a7ee5feb-e008-4723-a22b-72ec7ee9e927 tempest-VolumesExtendTest-1511794103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-74e91bf7-73d6-4824-ad2d-f55874c4e7f1 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:29 devstack sudo[112945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-74e91bf7-73d6-4824-ad2d-f55874c4e7f1 Sep 08 06:56:29 devstack sudo[112945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:29 devstack sudo[112945]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:29 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a7ee5feb-e008-4723-a22b-72ec7ee9e927 tempest-VolumesExtendTest-1511794103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-74e91bf7-73d6-4824-ad2d-f55874c4e7f1" returned: 0 in 0.427s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:29 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a7ee5feb-e008-4723-a22b-72ec7ee9e927 tempest-VolumesExtendTest-1511794103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-74e91bf7-73d6-4824-ad2d-f55874c4e7f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-74e91bf7-73d6-4824-ad2d-f55874c4e7f1.fca6339a-fbc6-4055-b0bc-9b5ca2b92fc9 1G {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:29 devstack sudo[112962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-74e91bf7-73d6-4824-ad2d-f55874c4e7f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-74e91bf7-73d6-4824-ad2d-f55874c4e7f1.fca6339a-fbc6-4055-b0bc-9b5ca2b92fc9 1G Sep 08 06:56:29 devstack sudo[112962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:30 devstack sudo[112962]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:30 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a7ee5feb-e008-4723-a22b-72ec7ee9e927 tempest-VolumesExtendTest-1511794103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-74e91bf7-73d6-4824-ad2d-f55874c4e7f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-74e91bf7-73d6-4824-ad2d-f55874c4e7f1.fca6339a-fbc6-4055-b0bc-9b5ca2b92fc9 1G" returned: 0 in 0.475s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:30 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a7ee5feb-e008-4723-a22b-72ec7ee9e927 tempest-VolumesExtendTest-1511794103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74e91bf7-73d6-4824-ad2d-f55874c4e7f1 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-74e91bf7-73d6-4824-ad2d-f55874c4e7f1.fca6339a-fbc6-4055-b0bc-9b5ca2b92fc9 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:30 devstack sudo[112982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74e91bf7-73d6-4824-ad2d-f55874c4e7f1 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-74e91bf7-73d6-4824-ad2d-f55874c4e7f1.fca6339a-fbc6-4055-b0bc-9b5ca2b92fc9 Sep 08 06:56:30 devstack sudo[112982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:30 devstack sudo[112982]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:30 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a7ee5feb-e008-4723-a22b-72ec7ee9e927 tempest-VolumesExtendTest-1511794103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74e91bf7-73d6-4824-ad2d-f55874c4e7f1 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-74e91bf7-73d6-4824-ad2d-f55874c4e7f1.fca6339a-fbc6-4055-b0bc-9b5ca2b92fc9" returned: 0 in 0.369s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:30 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-a7ee5feb-e008-4723-a22b-72ec7ee9e927 tempest-VolumesExtendTest-1511794103 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-74e91bf7-73d6-4824-ad2d-f55874c4e7f1.fca6339a-fbc6-4055-b0bc-9b5ca2b92fc9 is being set with open permissions: ugo+rw Sep 08 06:56:30 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a7ee5feb-e008-4723-a22b-72ec7ee9e927 tempest-VolumesExtendTest-1511794103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-74e91bf7-73d6-4824-ad2d-f55874c4e7f1.fca6339a-fbc6-4055-b0bc-9b5ca2b92fc9 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:30 devstack sudo[113017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-74e91bf7-73d6-4824-ad2d-f55874c4e7f1.fca6339a-fbc6-4055-b0bc-9b5ca2b92fc9 Sep 08 06:56:30 devstack sudo[113017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:31 devstack sudo[113017]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a7ee5feb-e008-4723-a22b-72ec7ee9e927 tempest-VolumesExtendTest-1511794103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-74e91bf7-73d6-4824-ad2d-f55874c4e7f1.fca6339a-fbc6-4055-b0bc-9b5ca2b92fc9" returned: 0 in 0.286s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a7ee5feb-e008-4723-a22b-72ec7ee9e927 tempest-VolumesExtendTest-1511794103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-74e91bf7-73d6-4824-ad2d-f55874c4e7f1.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:31 devstack sudo[113029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-74e91bf7-73d6-4824-ad2d-f55874c4e7f1.info Sep 08 06:56:31 devstack sudo[113029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:31 devstack sudo[113029]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a7ee5feb-e008-4723-a22b-72ec7ee9e927 tempest-VolumesExtendTest-1511794103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-74e91bf7-73d6-4824-ad2d-f55874c4e7f1.info" returned: 0 in 0.274s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:31 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-a7ee5feb-e008-4723-a22b-72ec7ee9e927 tempest-VolumesExtendTest-1511794103 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-74e91bf7-73d6-4824-ad2d-f55874c4e7f1.info is being set with open permissions: ugo+rw Sep 08 06:56:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a7ee5feb-e008-4723-a22b-72ec7ee9e927 tempest-VolumesExtendTest-1511794103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-74e91bf7-73d6-4824-ad2d-f55874c4e7f1.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:31 devstack sudo[113041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-74e91bf7-73d6-4824-ad2d-f55874c4e7f1.info Sep 08 06:56:31 devstack sudo[113041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:31 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f0b3863-6577-4fc9-a66e-088cc73cabe5 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:56:31 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0f0b3863-6577-4fc9-a66e-088cc73cabe5 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Flow 'volume_create_manager' (0f8d7d1e-e4d3-4ae0-8006-2b29223a4161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:56:31 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0f0b3863-6577-4fc9-a66e-088cc73cabe5 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eb80afe-df5b-4888-b260-38f6e2b205b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:31 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0f0b3863-6577-4fc9-a66e-088cc73cabe5 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eb80afe-df5b-4888-b260-38f6e2b205b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1526436031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00713280-f459-4258-b389-6f95fd468e02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6daae036c04409697d4990e6ca9f8b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:56:31Z,use_quota=True,user_id='6b124de2315544da8b28d1a52cbf7a22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:31 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0f0b3863-6577-4fc9-a66e-088cc73cabe5 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8450c564-152b-4805-98ab-31b01b729ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:31 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0f0b3863-6577-4fc9-a66e-088cc73cabe5 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8450c564-152b-4805-98ab-31b01b729ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:31 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0f0b3863-6577-4fc9-a66e-088cc73cabe5 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69cc3c53-2f60-45e8-9142-3ed57c44e283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:31 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0f0b3863-6577-4fc9-a66e-088cc73cabe5 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69cc3c53-2f60-45e8-9142-3ed57c44e283) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00713280-f459-4258-b389-6f95fd468e02', 'volume_name': 'volume-00713280-f459-4258-b389-6f95fd468e02', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:31 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0f0b3863-6577-4fc9-a66e-088cc73cabe5 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c292b61-ab98-4434-9461-e4a8df8b787d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:31 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0f0b3863-6577-4fc9-a66e-088cc73cabe5 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c292b61-ab98-4434-9461-e4a8df8b787d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:31 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0f0b3863-6577-4fc9-a66e-088cc73cabe5 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d373d98-90b1-4690-bda5-1ba27686f63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:31 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-0f0b3863-6577-4fc9-a66e-088cc73cabe5 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Volume 00713280-f459-4258-b389-6f95fd468e02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00713280-f459-4258-b389-6f95fd468e02', 'volume_size': 1} Sep 08 06:56:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-0f0b3863-6577-4fc9-a66e-088cc73cabe5 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:56:31 devstack sudo[113041]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a7ee5feb-e008-4723-a22b-72ec7ee9e927 tempest-VolumesExtendTest-1511794103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-74e91bf7-73d6-4824-ad2d-f55874c4e7f1.info" returned: 0 in 0.249s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a7ee5feb-e008-4723-a22b-72ec7ee9e927 tempest-VolumesExtendTest-1511794103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.207s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:56:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-0f0b3863-6577-4fc9-a66e-088cc73cabe5 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.098s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:56:31 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-0f0b3863-6577-4fc9-a66e-088cc73cabe5 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1526436031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00713280-f459-4258-b389-6f95fd468e02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6daae036c04409697d4990e6ca9f8b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:56:31Z,use_quota=True,user_id='6b124de2315544da8b28d1a52cbf7a22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:56:31 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-0f0b3863-6577-4fc9-a66e-088cc73cabe5 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Creating volume 00713280-f459-4258-b389-6f95fd468e02 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:56:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-0f0b3863-6577-4fc9-a66e-088cc73cabe5 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:56:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-0f0b3863-6577-4fc9-a66e-088cc73cabe5 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:56:31 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-0f0b3863-6577-4fc9-a66e-088cc73cabe5 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:56:31 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-0f0b3863-6577-4fc9-a66e-088cc73cabe5 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:56:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-0f0b3863-6577-4fc9-a66e-088cc73cabe5 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:56:31 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-0f0b3863-6577-4fc9-a66e-088cc73cabe5 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:56:31 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-0f0b3863-6577-4fc9-a66e-088cc73cabe5 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:56:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0f0b3863-6577-4fc9-a66e-088cc73cabe5 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-00713280-f459-4258-b389-6f95fd468e02 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:31 devstack sudo[113050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-00713280-f459-4258-b389-6f95fd468e02 1073741824 Sep 08 06:56:31 devstack sudo[113050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:31 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-a7ee5feb-e008-4723-a22b-72ec7ee9e927 tempest-VolumesExtendTest-1511794103 None] Create snapshot completed successfully Sep 08 06:56:32 devstack sudo[113050]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0f0b3863-6577-4fc9-a66e-088cc73cabe5 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-00713280-f459-4258-b389-6f95fd468e02 1073741824" returned: 0 in 0.411s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0f0b3863-6577-4fc9-a66e-088cc73cabe5 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-00713280-f459-4258-b389-6f95fd468e02 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:32 devstack sudo[113070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-00713280-f459-4258-b389-6f95fd468e02 Sep 08 06:56:32 devstack sudo[113070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:32 devstack sudo[113070]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0f0b3863-6577-4fc9-a66e-088cc73cabe5 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-00713280-f459-4258-b389-6f95fd468e02" returned: 0 in 0.245s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:32 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-0f0b3863-6577-4fc9-a66e-088cc73cabe5 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:56:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-0f0b3863-6577-4fc9-a66e-088cc73cabe5 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:56:32 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0f0b3863-6577-4fc9-a66e-088cc73cabe5 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d373d98-90b1-4690-bda5-1ba27686f63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00713280-f459-4258-b389-6f95fd468e02', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:32 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0f0b3863-6577-4fc9-a66e-088cc73cabe5 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea4d8ca5-9a51-404e-96ed-254c46257e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:32 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-0f0b3863-6577-4fc9-a66e-088cc73cabe5 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Volume volume-00713280-f459-4258-b389-6f95fd468e02 (00713280-f459-4258-b389-6f95fd468e02): created successfully Sep 08 06:56:32 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0f0b3863-6577-4fc9-a66e-088cc73cabe5 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea4d8ca5-9a51-404e-96ed-254c46257e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:32 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0f0b3863-6577-4fc9-a66e-088cc73cabe5 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Flow 'volume_create_manager' (0f8d7d1e-e4d3-4ae0-8006-2b29223a4161) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:56:32 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-0f0b3863-6577-4fc9-a66e-088cc73cabe5 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Created volume successfully. Sep 08 06:56:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-37e68ce5-a08a-4d16-84ca-01781c8520c1 tempest-VolumesExtendTest-1511794103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:56:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-37e68ce5-a08a-4d16-84ca-01781c8520c1 tempest-VolumesExtendTest-1511794103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:56:32 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12fbcdb-e51e-4ca4-afd9-11bf1144bf58]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:56:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-37e68ce5-a08a-4d16-84ca-01781c8520c1 tempest-VolumesExtendTest-1511794103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-74e91bf7-73d6-4824-ad2d-f55874c4e7f1 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:32 devstack sudo[113091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-74e91bf7-73d6-4824-ad2d-f55874c4e7f1 Sep 08 06:56:32 devstack sudo[113091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:33 devstack sudo[113091]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-37e68ce5-a08a-4d16-84ca-01781c8520c1 tempest-VolumesExtendTest-1511794103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-74e91bf7-73d6-4824-ad2d-f55874c4e7f1" returned: 0 in 0.350s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-37e68ce5-a08a-4d16-84ca-01781c8520c1 tempest-VolumesExtendTest-1511794103 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-74e91bf7-73d6-4824-ad2d-f55874c4e7f1.fca6339a-fbc6-4055-b0bc-9b5ca2b92fc9 2G {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-37e68ce5-a08a-4d16-84ca-01781c8520c1 tempest-VolumesExtendTest-1511794103 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-74e91bf7-73d6-4824-ad2d-f55874c4e7f1.fca6339a-fbc6-4055-b0bc-9b5ca2b92fc9 2G" returned: 0 in 0.112s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-37e68ce5-a08a-4d16-84ca-01781c8520c1 tempest-VolumesExtendTest-1511794103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.499s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:56:33 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-37e68ce5-a08a-4d16-84ca-01781c8520c1 tempest-VolumesExtendTest-1511794103 None] Extend volume completed successfully. Sep 08 06:56:33 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-29fd9cf1-2e27-4149-8fc0-6f3e0609a6b2 tempest-VolumesExtendTest-1511794103 None] Acquiring lock "cinder-fca6339a-fbc6-4055-b0bc-9b5ca2b92fc9-delete_snapshot" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:56:33 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a4f9a94-5acc-4642-b2f8-0da662252d2f tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:56:33 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1a4f9a94-5acc-4642-b2f8-0da662252d2f tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Flow 'volume_create_manager' (e09e56da-acf0-4194-aa2d-64d5f6c00bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:56:33 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1a4f9a94-5acc-4642-b2f8-0da662252d2f tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cc5f96e-3a98-4a07-a149-8d863698669a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:33 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-29fd9cf1-2e27-4149-8fc0-6f3e0609a6b2 tempest-VolumesExtendTest-1511794103 None] Lock "cinder-fca6339a-fbc6-4055-b0bc-9b5ca2b92fc9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.068s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:56:33 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-29fd9cf1-2e27-4149-8fc0-6f3e0609a6b2 tempest-VolumesExtendTest-1511794103 None] Acquiring lock "cinder-quobyte-74e91bf7-73d6-4824-ad2d-f55874c4e7f1" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:56:34 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1a4f9a94-5acc-4642-b2f8-0da662252d2f tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cc5f96e-3a98-4a07-a149-8d863698669a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:56:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-906572190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84ca266b-dca4-4344-adc9-c2c7c7518060,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6daae036c04409697d4990e6ca9f8b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:56:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:56:34Z,use_quota=True,user_id='6b124de2315544da8b28d1a52cbf7a22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:34 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1a4f9a94-5acc-4642-b2f8-0da662252d2f tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f13d3a2f-ee6e-49d8-b8b3-ec21c25cbf12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:34 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1a4f9a94-5acc-4642-b2f8-0da662252d2f tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f13d3a2f-ee6e-49d8-b8b3-ec21c25cbf12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:34 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1a4f9a94-5acc-4642-b2f8-0da662252d2f tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (946d7093-d36c-4d7b-b942-f9a62462e08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:34 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1a4f9a94-5acc-4642-b2f8-0da662252d2f tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (946d7093-d36c-4d7b-b942-f9a62462e08d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84ca266b-dca4-4344-adc9-c2c7c7518060', 'volume_name': 'volume-84ca266b-dca4-4344-adc9-c2c7c7518060', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:34 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1a4f9a94-5acc-4642-b2f8-0da662252d2f tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2bdbfaf-d836-4388-b414-570fbb178c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:34 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1a4f9a94-5acc-4642-b2f8-0da662252d2f tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2bdbfaf-d836-4388-b414-570fbb178c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:34 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1a4f9a94-5acc-4642-b2f8-0da662252d2f tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c320abd2-d1cf-4f16-9655-43b2d85a99a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:34 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-1a4f9a94-5acc-4642-b2f8-0da662252d2f tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Volume 84ca266b-dca4-4344-adc9-c2c7c7518060: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84ca266b-dca4-4344-adc9-c2c7c7518060', 'volume_size': 1} Sep 08 06:56:34 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-1a4f9a94-5acc-4642-b2f8-0da662252d2f tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:56:34 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-1a4f9a94-5acc-4642-b2f8-0da662252d2f tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:56:34 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-1a4f9a94-5acc-4642-b2f8-0da662252d2f tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:56:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-906572190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84ca266b-dca4-4344-adc9-c2c7c7518060,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6daae036c04409697d4990e6ca9f8b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:56:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:56:34Z,use_quota=True,user_id='6b124de2315544da8b28d1a52cbf7a22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:56:34 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-1a4f9a94-5acc-4642-b2f8-0da662252d2f tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Creating volume 84ca266b-dca4-4344-adc9-c2c7c7518060 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:56:34 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-1a4f9a94-5acc-4642-b2f8-0da662252d2f tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:56:34 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-1a4f9a94-5acc-4642-b2f8-0da662252d2f tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:56:34 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-1a4f9a94-5acc-4642-b2f8-0da662252d2f tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:56:34 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-1a4f9a94-5acc-4642-b2f8-0da662252d2f tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:56:34 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-1a4f9a94-5acc-4642-b2f8-0da662252d2f tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:56:34 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-1a4f9a94-5acc-4642-b2f8-0da662252d2f tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:56:34 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-1a4f9a94-5acc-4642-b2f8-0da662252d2f tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:56:34 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1a4f9a94-5acc-4642-b2f8-0da662252d2f tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-84ca266b-dca4-4344-adc9-c2c7c7518060 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:34 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-29fd9cf1-2e27-4149-8fc0-6f3e0609a6b2 tempest-VolumesExtendTest-1511794103 None] Lock "cinder-quobyte-74e91bf7-73d6-4824-ad2d-f55874c4e7f1" acquired by "delete_snapshot" :: waited 0.097s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:56:34 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-29fd9cf1-2e27-4149-8fc0-6f3e0609a6b2 tempest-VolumesExtendTest-1511794103 None] Acquiring lock "cinder-quobyte-fca6339a-fbc6-4055-b0bc-9b5ca2b92fc9" by "_delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:56:34 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-29fd9cf1-2e27-4149-8fc0-6f3e0609a6b2 tempest-VolumesExtendTest-1511794103 None] Lock "cinder-quobyte-fca6339a-fbc6-4055-b0bc-9b5ca2b92fc9" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:56:34 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-29fd9cf1-2e27-4149-8fc0-6f3e0609a6b2 tempest-VolumesExtendTest-1511794103 None] Deleting offline snapshot fca6339a-fbc6-4055-b0bc-9b5ca2b92fc9 of volume 74e91bf7-73d6-4824-ad2d-f55874c4e7f1 {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 06:56:34 devstack sudo[113139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-84ca266b-dca4-4344-adc9-c2c7c7518060 1073741824 Sep 08 06:56:34 devstack sudo[113139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:34 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-29fd9cf1-2e27-4149-8fc0-6f3e0609a6b2 tempest-VolumesExtendTest-1511794103 None] snapshot_file for this snap is: volume-74e91bf7-73d6-4824-ad2d-f55874c4e7f1.fca6339a-fbc6-4055-b0bc-9b5ca2b92fc9 {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 06:56:34 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[92427cae-9246-411d-8c2f-05db320b52fc]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:56:34 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-29fd9cf1-2e27-4149-8fc0-6f3e0609a6b2 tempest-VolumesExtendTest-1511794103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-74e91bf7-73d6-4824-ad2d-f55874c4e7f1.fca6339a-fbc6-4055-b0bc-9b5ca2b92fc9 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:34 devstack sudo[113143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-74e91bf7-73d6-4824-ad2d-f55874c4e7f1.fca6339a-fbc6-4055-b0bc-9b5ca2b92fc9 Sep 08 06:56:34 devstack sudo[113143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:34 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-73397a25-14c0-4595-8cc9-d03330c2d242 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:56:34 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-73397a25-14c0-4595-8cc9-d03330c2d242 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Flow 'volume_create_manager' (12a466d6-191d-4a9d-b640-2cd10f2fad0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:56:34 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-73397a25-14c0-4595-8cc9-d03330c2d242 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9342965a-fba9-40d4-8863-076d2787392a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:34 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-73397a25-14c0-4595-8cc9-d03330c2d242 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9342965a-fba9-40d4-8863-076d2787392a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:56:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-460767341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=499773f1-a5fe-4fd4-bb4e-2174df1eb011,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6daae036c04409697d4990e6ca9f8b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:56:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:56:34Z,use_quota=True,user_id='6b124de2315544da8b28d1a52cbf7a22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:34 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-73397a25-14c0-4595-8cc9-d03330c2d242 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ebc75f2-5546-45fb-8f95-9716fe0df3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:34 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-73397a25-14c0-4595-8cc9-d03330c2d242 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ebc75f2-5546-45fb-8f95-9716fe0df3a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:34 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-73397a25-14c0-4595-8cc9-d03330c2d242 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fed6ab4-d75e-42f4-96c4-d12e93a3e5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:34 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-73397a25-14c0-4595-8cc9-d03330c2d242 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fed6ab4-d75e-42f4-96c4-d12e93a3e5df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '499773f1-a5fe-4fd4-bb4e-2174df1eb011', 'volume_name': 'volume-499773f1-a5fe-4fd4-bb4e-2174df1eb011', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:34 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-73397a25-14c0-4595-8cc9-d03330c2d242 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90391005-ea46-4844-ac4b-95c950978fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:34 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-73397a25-14c0-4595-8cc9-d03330c2d242 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90391005-ea46-4844-ac4b-95c950978fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:34 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-73397a25-14c0-4595-8cc9-d03330c2d242 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e06e5db4-db5d-4e4e-891f-3acbce3eadd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:34 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-73397a25-14c0-4595-8cc9-d03330c2d242 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Volume 499773f1-a5fe-4fd4-bb4e-2174df1eb011: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-499773f1-a5fe-4fd4-bb4e-2174df1eb011', 'volume_size': 1} Sep 08 06:56:34 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-73397a25-14c0-4595-8cc9-d03330c2d242 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:56:34 devstack sudo[113139]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:34 devstack sudo[113143]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:34 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-29fd9cf1-2e27-4149-8fc0-6f3e0609a6b2 tempest-VolumesExtendTest-1511794103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-74e91bf7-73d6-4824-ad2d-f55874c4e7f1.fca6339a-fbc6-4055-b0bc-9b5ca2b92fc9" returned: 0 in 0.476s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:34 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1a4f9a94-5acc-4642-b2f8-0da662252d2f tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-84ca266b-dca4-4344-adc9-c2c7c7518060 1073741824" returned: 0 in 0.557s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:34 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-29fd9cf1-2e27-4149-8fc0-6f3e0609a6b2 tempest-VolumesExtendTest-1511794103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74e91bf7-73d6-4824-ad2d-f55874c4e7f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 06:56:34 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[895646a3-342f-4869-adfe-fd7da4312fdf]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:56:34 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-29fd9cf1-2e27-4149-8fc0-6f3e0609a6b2 tempest-VolumesExtendTest-1511794103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-74e91bf7-73d6-4824-ad2d-f55874c4e7f1 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:34 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1a4f9a94-5acc-4642-b2f8-0da662252d2f tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-84ca266b-dca4-4344-adc9-c2c7c7518060 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:34 devstack sudo[113171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-84ca266b-dca4-4344-adc9-c2c7c7518060 Sep 08 06:56:34 devstack sudo[113171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:34 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-7273e6b5-00c0-42dc-b2b7-337046743eff tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:56:34 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7273e6b5-00c0-42dc-b2b7-337046743eff tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Flow 'volume_create_manager' (287cdcf5-07f1-4d48-b55e-1a8fcc84d28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:56:34 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7273e6b5-00c0-42dc-b2b7-337046743eff tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae324bd8-5424-4b9f-952a-30294f425dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:34 devstack sudo[113167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-74e91bf7-73d6-4824-ad2d-f55874c4e7f1 Sep 08 06:56:34 devstack sudo[113167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:34 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7273e6b5-00c0-42dc-b2b7-337046743eff tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae324bd8-5424-4b9f-952a-30294f425dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:56:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1491813203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bb6d024-7afe-4f5e-a253-127679b9b78e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6daae036c04409697d4990e6ca9f8b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:56:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:56:35Z,use_quota=True,user_id='6b124de2315544da8b28d1a52cbf7a22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:34 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7273e6b5-00c0-42dc-b2b7-337046743eff tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a386985-54b6-40bd-a255-6bc4c14c73b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:34 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7273e6b5-00c0-42dc-b2b7-337046743eff tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a386985-54b6-40bd-a255-6bc4c14c73b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:34 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7273e6b5-00c0-42dc-b2b7-337046743eff tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (899d468f-513b-4a40-b1b7-967eb57f6fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:34 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7273e6b5-00c0-42dc-b2b7-337046743eff tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (899d468f-513b-4a40-b1b7-967eb57f6fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bb6d024-7afe-4f5e-a253-127679b9b78e', 'volume_name': 'volume-2bb6d024-7afe-4f5e-a253-127679b9b78e', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:34 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7273e6b5-00c0-42dc-b2b7-337046743eff tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3966d20f-56e8-4e09-89f1-a1993eaf093b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:34 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7273e6b5-00c0-42dc-b2b7-337046743eff tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3966d20f-56e8-4e09-89f1-a1993eaf093b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:34 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7273e6b5-00c0-42dc-b2b7-337046743eff tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d50d553-8694-411e-8c9f-a89eb48390af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:34 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-7273e6b5-00c0-42dc-b2b7-337046743eff tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Volume 2bb6d024-7afe-4f5e-a253-127679b9b78e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bb6d024-7afe-4f5e-a253-127679b9b78e', 'volume_size': 1} Sep 08 06:56:34 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-7273e6b5-00c0-42dc-b2b7-337046743eff tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:56:34 devstack sudo[113171]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1a4f9a94-5acc-4642-b2f8-0da662252d2f tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-84ca266b-dca4-4344-adc9-c2c7c7518060" returned: 0 in 0.298s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:35 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-1a4f9a94-5acc-4642-b2f8-0da662252d2f tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:56:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-1a4f9a94-5acc-4642-b2f8-0da662252d2f tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:56:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-73397a25-14c0-4595-8cc9-d03330c2d242 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.548s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:56:35 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-73397a25-14c0-4595-8cc9-d03330c2d242 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:56:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-460767341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=499773f1-a5fe-4fd4-bb4e-2174df1eb011,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6daae036c04409697d4990e6ca9f8b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:56:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:56:34Z,use_quota=True,user_id='6b124de2315544da8b28d1a52cbf7a22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:56:35 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-73397a25-14c0-4595-8cc9-d03330c2d242 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Creating volume 499773f1-a5fe-4fd4-bb4e-2174df1eb011 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:56:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-73397a25-14c0-4595-8cc9-d03330c2d242 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:56:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-73397a25-14c0-4595-8cc9-d03330c2d242 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:56:35 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-73397a25-14c0-4595-8cc9-d03330c2d242 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:56:35 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-73397a25-14c0-4595-8cc9-d03330c2d242 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:56:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-73397a25-14c0-4595-8cc9-d03330c2d242 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:56:35 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-73397a25-14c0-4595-8cc9-d03330c2d242 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:56:35 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-73397a25-14c0-4595-8cc9-d03330c2d242 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:56:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-73397a25-14c0-4595-8cc9-d03330c2d242 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-499773f1-a5fe-4fd4-bb4e-2174df1eb011 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1a4f9a94-5acc-4642-b2f8-0da662252d2f tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c320abd2-d1cf-4f16-9655-43b2d85a99a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84ca266b-dca4-4344-adc9-c2c7c7518060', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1a4f9a94-5acc-4642-b2f8-0da662252d2f tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17e758d7-7503-479e-a40a-baf99d958666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:35 devstack sudo[113184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-499773f1-a5fe-4fd4-bb4e-2174df1eb011 1073741824 Sep 08 06:56:35 devstack sudo[113184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:35 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-1a4f9a94-5acc-4642-b2f8-0da662252d2f tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Volume volume-84ca266b-dca4-4344-adc9-c2c7c7518060 (84ca266b-dca4-4344-adc9-c2c7c7518060): created successfully Sep 08 06:56:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1a4f9a94-5acc-4642-b2f8-0da662252d2f tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17e758d7-7503-479e-a40a-baf99d958666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1a4f9a94-5acc-4642-b2f8-0da662252d2f tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Flow 'volume_create_manager' (e09e56da-acf0-4194-aa2d-64d5f6c00bd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:56:35 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-1a4f9a94-5acc-4642-b2f8-0da662252d2f tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Created volume successfully. Sep 08 06:56:35 devstack sudo[113167]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-29fd9cf1-2e27-4149-8fc0-6f3e0609a6b2 tempest-VolumesExtendTest-1511794103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-74e91bf7-73d6-4824-ad2d-f55874c4e7f1" returned: 0 in 0.551s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-29fd9cf1-2e27-4149-8fc0-6f3e0609a6b2 tempest-VolumesExtendTest-1511794103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-74e91bf7-73d6-4824-ad2d-f55874c4e7f1.fca6339a-fbc6-4055-b0bc-9b5ca2b92fc9 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:35 devstack sudo[113198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-74e91bf7-73d6-4824-ad2d-f55874c4e7f1.fca6339a-fbc6-4055-b0bc-9b5ca2b92fc9 Sep 08 06:56:35 devstack sudo[113198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:35 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-b342ba0f-f7d7-4dc4-89b8-6e114b8d47a2 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:56:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b342ba0f-f7d7-4dc4-89b8-6e114b8d47a2 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Flow 'volume_create_manager' (ad2a28fe-741d-4c2e-bced-9467ec8354fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:56:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b342ba0f-f7d7-4dc4-89b8-6e114b8d47a2 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c087ceff-8cce-4170-8759-bdc5cba925ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b342ba0f-f7d7-4dc4-89b8-6e114b8d47a2 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c087ceff-8cce-4170-8759-bdc5cba925ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:56:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-191111971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cf43c9e-fd50-4601-bedb-aae1cc52ef41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6daae036c04409697d4990e6ca9f8b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:56:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:56:35Z,use_quota=True,user_id='6b124de2315544da8b28d1a52cbf7a22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b342ba0f-f7d7-4dc4-89b8-6e114b8d47a2 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc71bfa4-cb58-4e99-8fa5-fe3c8b4cb824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b342ba0f-f7d7-4dc4-89b8-6e114b8d47a2 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc71bfa4-cb58-4e99-8fa5-fe3c8b4cb824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b342ba0f-f7d7-4dc4-89b8-6e114b8d47a2 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15db752f-01ba-4f49-ad8f-e5ebeb560321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b342ba0f-f7d7-4dc4-89b8-6e114b8d47a2 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15db752f-01ba-4f49-ad8f-e5ebeb560321) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cf43c9e-fd50-4601-bedb-aae1cc52ef41', 'volume_name': 'volume-3cf43c9e-fd50-4601-bedb-aae1cc52ef41', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b342ba0f-f7d7-4dc4-89b8-6e114b8d47a2 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8043c1c6-77cc-4942-be6d-d6df9d6a144e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b342ba0f-f7d7-4dc4-89b8-6e114b8d47a2 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8043c1c6-77cc-4942-be6d-d6df9d6a144e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b342ba0f-f7d7-4dc4-89b8-6e114b8d47a2 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (796d0ba9-ba1c-42e3-8213-a49eded24d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:35 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-b342ba0f-f7d7-4dc4-89b8-6e114b8d47a2 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Volume 3cf43c9e-fd50-4601-bedb-aae1cc52ef41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cf43c9e-fd50-4601-bedb-aae1cc52ef41', 'volume_size': 1} Sep 08 06:56:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b342ba0f-f7d7-4dc4-89b8-6e114b8d47a2 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:56:35 devstack sudo[113184]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-73397a25-14c0-4595-8cc9-d03330c2d242 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-499773f1-a5fe-4fd4-bb4e-2174df1eb011 1073741824" returned: 0 in 0.584s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-73397a25-14c0-4595-8cc9-d03330c2d242 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-499773f1-a5fe-4fd4-bb4e-2174df1eb011 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:35 devstack sudo[113223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-499773f1-a5fe-4fd4-bb4e-2174df1eb011 Sep 08 06:56:35 devstack sudo[113223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:35 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-816aee83-a7f2-49bf-bf37-3df64818ad17 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:56:35 devstack sudo[113198]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-816aee83-a7f2-49bf-bf37-3df64818ad17 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Flow 'volume_create_manager' (d2e0a79f-c1dc-4bbc-8415-4d8d57aeae80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:56:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-816aee83-a7f2-49bf-bf37-3df64818ad17 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (963ffe67-4ab0-49f9-96ad-dba40d62ae95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-29fd9cf1-2e27-4149-8fc0-6f3e0609a6b2 tempest-VolumesExtendTest-1511794103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-74e91bf7-73d6-4824-ad2d-f55874c4e7f1.fca6339a-fbc6-4055-b0bc-9b5ca2b92fc9" returned: 0 in 0.519s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-29fd9cf1-2e27-4149-8fc0-6f3e0609a6b2 tempest-VolumesExtendTest-1511794103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-74e91bf7-73d6-4824-ad2d-f55874c4e7f1.fca6339a-fbc6-4055-b0bc-9b5ca2b92fc9 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-816aee83-a7f2-49bf-bf37-3df64818ad17 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (963ffe67-4ab0-49f9-96ad-dba40d62ae95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:56:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-384721938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73edbaed-417b-4cbb-9cb7-af369330d77b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6daae036c04409697d4990e6ca9f8b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:56:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:56:36Z,use_quota=True,user_id='6b124de2315544da8b28d1a52cbf7a22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:35 devstack sudo[113228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-74e91bf7-73d6-4824-ad2d-f55874c4e7f1.fca6339a-fbc6-4055-b0bc-9b5ca2b92fc9 Sep 08 06:56:35 devstack sudo[113228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-816aee83-a7f2-49bf-bf37-3df64818ad17 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20a43ab7-5798-47a2-94c1-a3f5da540091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-816aee83-a7f2-49bf-bf37-3df64818ad17 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20a43ab7-5798-47a2-94c1-a3f5da540091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-816aee83-a7f2-49bf-bf37-3df64818ad17 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d3b91d1-9c4a-4409-8a2f-92202be8102f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-816aee83-a7f2-49bf-bf37-3df64818ad17 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d3b91d1-9c4a-4409-8a2f-92202be8102f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73edbaed-417b-4cbb-9cb7-af369330d77b', 'volume_name': 'volume-73edbaed-417b-4cbb-9cb7-af369330d77b', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-816aee83-a7f2-49bf-bf37-3df64818ad17 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be37d326-01f4-44fc-a135-741256ee7837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-816aee83-a7f2-49bf-bf37-3df64818ad17 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be37d326-01f4-44fc-a135-741256ee7837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-816aee83-a7f2-49bf-bf37-3df64818ad17 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23b344c5-468b-44f9-bb60-bd9112bbe6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:35 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-816aee83-a7f2-49bf-bf37-3df64818ad17 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Volume 73edbaed-417b-4cbb-9cb7-af369330d77b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73edbaed-417b-4cbb-9cb7-af369330d77b', 'volume_size': 1} Sep 08 06:56:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-816aee83-a7f2-49bf-bf37-3df64818ad17 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:56:35 devstack sudo[113223]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-73397a25-14c0-4595-8cc9-d03330c2d242 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-499773f1-a5fe-4fd4-bb4e-2174df1eb011" returned: 0 in 0.275s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:35 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-73397a25-14c0-4595-8cc9-d03330c2d242 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:56:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-73397a25-14c0-4595-8cc9-d03330c2d242 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:56:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-7273e6b5-00c0-42dc-b2b7-337046743eff tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.081s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:56:35 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-7273e6b5-00c0-42dc-b2b7-337046743eff tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:56:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1491813203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bb6d024-7afe-4f5e-a253-127679b9b78e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6daae036c04409697d4990e6ca9f8b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:56:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:56:35Z,use_quota=True,user_id='6b124de2315544da8b28d1a52cbf7a22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:56:35 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-7273e6b5-00c0-42dc-b2b7-337046743eff tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Creating volume 2bb6d024-7afe-4f5e-a253-127679b9b78e {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:56:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-7273e6b5-00c0-42dc-b2b7-337046743eff tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:56:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-7273e6b5-00c0-42dc-b2b7-337046743eff tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:56:35 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-7273e6b5-00c0-42dc-b2b7-337046743eff tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:56:35 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-7273e6b5-00c0-42dc-b2b7-337046743eff tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:56:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-7273e6b5-00c0-42dc-b2b7-337046743eff tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:56:35 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-7273e6b5-00c0-42dc-b2b7-337046743eff tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:56:35 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-7273e6b5-00c0-42dc-b2b7-337046743eff tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:56:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7273e6b5-00c0-42dc-b2b7-337046743eff tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2bb6d024-7afe-4f5e-a253-127679b9b78e 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-73397a25-14c0-4595-8cc9-d03330c2d242 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e06e5db4-db5d-4e4e-891f-3acbce3eadd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-499773f1-a5fe-4fd4-bb4e-2174df1eb011', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-73397a25-14c0-4595-8cc9-d03330c2d242 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa43ab32-78a1-4267-8f28-747365b19e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:35 devstack sudo[113238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2bb6d024-7afe-4f5e-a253-127679b9b78e 1073741824 Sep 08 06:56:35 devstack sudo[113238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:35 devstack sudo[113228]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-29fd9cf1-2e27-4149-8fc0-6f3e0609a6b2 tempest-VolumesExtendTest-1511794103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-74e91bf7-73d6-4824-ad2d-f55874c4e7f1.fca6339a-fbc6-4055-b0bc-9b5ca2b92fc9" returned: 0 in 0.258s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:36 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-73397a25-14c0-4595-8cc9-d03330c2d242 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Volume volume-499773f1-a5fe-4fd4-bb4e-2174df1eb011 (499773f1-a5fe-4fd4-bb4e-2174df1eb011): created successfully Sep 08 06:56:36 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-73397a25-14c0-4595-8cc9-d03330c2d242 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa43ab32-78a1-4267-8f28-747365b19e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:36 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-73397a25-14c0-4595-8cc9-d03330c2d242 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Flow 'volume_create_manager' (12a466d6-191d-4a9d-b640-2cd10f2fad0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:56:36 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-29fd9cf1-2e27-4149-8fc0-6f3e0609a6b2 tempest-VolumesExtendTest-1511794103 None] Lock "cinder-quobyte-fca6339a-fbc6-4055-b0bc-9b5ca2b92fc9" released by "_delete_snapshot" :: held 1.957s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:56:36 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-73397a25-14c0-4595-8cc9-d03330c2d242 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Created volume successfully. Sep 08 06:56:36 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-29fd9cf1-2e27-4149-8fc0-6f3e0609a6b2 tempest-VolumesExtendTest-1511794103 None] Lock "cinder-quobyte-74e91bf7-73d6-4824-ad2d-f55874c4e7f1" released by "delete_snapshot" :: held 1.992s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:56:36 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-29fd9cf1-2e27-4149-8fc0-6f3e0609a6b2 tempest-VolumesExtendTest-1511794103 None] Created reservations ['ee0ed60f-0484-45db-9666-9b30a50ea975', 'd20e7374-176a-405f-9912-eb7942f79d4d', '4d27063a-0e17-4b5f-80dd-517d86721d3a', '8a422e84-6d30-4bdf-aa80-9664e20a68e9'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:56:36 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-29fd9cf1-2e27-4149-8fc0-6f3e0609a6b2 tempest-VolumesExtendTest-1511794103 None] Delete snapshot completed successfully. Sep 08 06:56:36 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-29fd9cf1-2e27-4149-8fc0-6f3e0609a6b2 tempest-VolumesExtendTest-1511794103 None] Lock "cinder-fca6339a-fbc6-4055-b0bc-9b5ca2b92fc9-delete_snapshot" released by "delete_snapshot" :: held 2.212s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:56:36 devstack sudo[113238]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7273e6b5-00c0-42dc-b2b7-337046743eff tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2bb6d024-7afe-4f5e-a253-127679b9b78e 1073741824" returned: 0 in 0.441s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7273e6b5-00c0-42dc-b2b7-337046743eff tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2bb6d024-7afe-4f5e-a253-127679b9b78e {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:36 devstack sudo[113259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2bb6d024-7afe-4f5e-a253-127679b9b78e Sep 08 06:56:36 devstack sudo[113259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:36 devstack sudo[113259]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7273e6b5-00c0-42dc-b2b7-337046743eff tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2bb6d024-7afe-4f5e-a253-127679b9b78e" returned: 0 in 0.259s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:36 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-7273e6b5-00c0-42dc-b2b7-337046743eff tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:56:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-7273e6b5-00c0-42dc-b2b7-337046743eff tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:56:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b342ba0f-f7d7-4dc4-89b8-6e114b8d47a2 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.311s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:56:36 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-b342ba0f-f7d7-4dc4-89b8-6e114b8d47a2 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:56:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-191111971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cf43c9e-fd50-4601-bedb-aae1cc52ef41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6daae036c04409697d4990e6ca9f8b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:56:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:56:35Z,use_quota=True,user_id='6b124de2315544da8b28d1a52cbf7a22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:56:36 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-b342ba0f-f7d7-4dc4-89b8-6e114b8d47a2 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Creating volume 3cf43c9e-fd50-4601-bedb-aae1cc52ef41 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:56:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b342ba0f-f7d7-4dc4-89b8-6e114b8d47a2 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:56:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b342ba0f-f7d7-4dc4-89b8-6e114b8d47a2 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:56:36 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-b342ba0f-f7d7-4dc4-89b8-6e114b8d47a2 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:56:36 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-b342ba0f-f7d7-4dc4-89b8-6e114b8d47a2 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:56:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b342ba0f-f7d7-4dc4-89b8-6e114b8d47a2 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:56:36 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-b342ba0f-f7d7-4dc4-89b8-6e114b8d47a2 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:56:36 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-b342ba0f-f7d7-4dc4-89b8-6e114b8d47a2 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:56:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b342ba0f-f7d7-4dc4-89b8-6e114b8d47a2 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-3cf43c9e-fd50-4601-bedb-aae1cc52ef41 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:36 devstack sudo[113271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-3cf43c9e-fd50-4601-bedb-aae1cc52ef41 1073741824 Sep 08 06:56:36 devstack sudo[113271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:36 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7273e6b5-00c0-42dc-b2b7-337046743eff tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d50d553-8694-411e-8c9f-a89eb48390af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bb6d024-7afe-4f5e-a253-127679b9b78e', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:36 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7273e6b5-00c0-42dc-b2b7-337046743eff tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f033c1c-f61c-45ee-9775-fbe8b4e4889a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:36 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-7273e6b5-00c0-42dc-b2b7-337046743eff tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Volume volume-2bb6d024-7afe-4f5e-a253-127679b9b78e (2bb6d024-7afe-4f5e-a253-127679b9b78e): created successfully Sep 08 06:56:36 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7273e6b5-00c0-42dc-b2b7-337046743eff tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f033c1c-f61c-45ee-9775-fbe8b4e4889a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:36 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7273e6b5-00c0-42dc-b2b7-337046743eff tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Flow 'volume_create_manager' (287cdcf5-07f1-4d48-b55e-1a8fcc84d28c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:56:36 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-7273e6b5-00c0-42dc-b2b7-337046743eff tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Created volume successfully. Sep 08 06:56:37 devstack sudo[113271]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b342ba0f-f7d7-4dc4-89b8-6e114b8d47a2 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-3cf43c9e-fd50-4601-bedb-aae1cc52ef41 1073741824" returned: 0 in 0.456s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b342ba0f-f7d7-4dc4-89b8-6e114b8d47a2 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-3cf43c9e-fd50-4601-bedb-aae1cc52ef41 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:37 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-c27767a4-15c1-4337-8512-19f325d06344 tempest-VolumesExtendTest-1511794103 None] Acquiring lock "cinder-74e91bf7-73d6-4824-ad2d-f55874c4e7f1-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:56:37 devstack sudo[113292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-3cf43c9e-fd50-4601-bedb-aae1cc52ef41 Sep 08 06:56:37 devstack sudo[113292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:37 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-c27767a4-15c1-4337-8512-19f325d06344 tempest-VolumesExtendTest-1511794103 None] Lock "cinder-74e91bf7-73d6-4824-ad2d-f55874c4e7f1-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:56:37 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-c27767a4-15c1-4337-8512-19f325d06344 tempest-VolumesExtendTest-1511794103 None] Acquiring lock "cinder-quobyte-74e91bf7-73d6-4824-ad2d-f55874c4e7f1" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:56:37 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-c27767a4-15c1-4337-8512-19f325d06344 tempest-VolumesExtendTest-1511794103 None] Lock "cinder-quobyte-74e91bf7-73d6-4824-ad2d-f55874c4e7f1" acquired by "delete_volume" :: waited 0.015s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:56:37 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d343dc6-b7ab-46f9-8db0-0de2b9779386]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:56:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-c27767a4-15c1-4337-8512-19f325d06344 tempest-VolumesExtendTest-1511794103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-74e91bf7-73d6-4824-ad2d-f55874c4e7f1 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:37 devstack sudo[113297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-74e91bf7-73d6-4824-ad2d-f55874c4e7f1 Sep 08 06:56:37 devstack sudo[113297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:37 devstack sudo[113292]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b342ba0f-f7d7-4dc4-89b8-6e114b8d47a2 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-3cf43c9e-fd50-4601-bedb-aae1cc52ef41" returned: 0 in 0.276s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:37 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-b342ba0f-f7d7-4dc4-89b8-6e114b8d47a2 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:56:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b342ba0f-f7d7-4dc4-89b8-6e114b8d47a2 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:56:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-816aee83-a7f2-49bf-bf37-3df64818ad17 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.676s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:56:37 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-816aee83-a7f2-49bf-bf37-3df64818ad17 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:56:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-384721938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73edbaed-417b-4cbb-9cb7-af369330d77b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6daae036c04409697d4990e6ca9f8b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:56:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:56:36Z,use_quota=True,user_id='6b124de2315544da8b28d1a52cbf7a22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:56:37 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-816aee83-a7f2-49bf-bf37-3df64818ad17 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Creating volume 73edbaed-417b-4cbb-9cb7-af369330d77b {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:56:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-816aee83-a7f2-49bf-bf37-3df64818ad17 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:56:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-816aee83-a7f2-49bf-bf37-3df64818ad17 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:56:37 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-816aee83-a7f2-49bf-bf37-3df64818ad17 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:56:37 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-816aee83-a7f2-49bf-bf37-3df64818ad17 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:56:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-816aee83-a7f2-49bf-bf37-3df64818ad17 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:56:37 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-816aee83-a7f2-49bf-bf37-3df64818ad17 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:56:37 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-816aee83-a7f2-49bf-bf37-3df64818ad17 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:56:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-816aee83-a7f2-49bf-bf37-3df64818ad17 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-73edbaed-417b-4cbb-9cb7-af369330d77b 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:37 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b342ba0f-f7d7-4dc4-89b8-6e114b8d47a2 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (796d0ba9-ba1c-42e3-8213-a49eded24d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cf43c9e-fd50-4601-bedb-aae1cc52ef41', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:37 devstack sudo[113303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-73edbaed-417b-4cbb-9cb7-af369330d77b 1073741824 Sep 08 06:56:37 devstack sudo[113303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:37 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b342ba0f-f7d7-4dc4-89b8-6e114b8d47a2 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61a61800-a19c-4541-b34a-4375d29c5d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:37 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-b342ba0f-f7d7-4dc4-89b8-6e114b8d47a2 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Volume volume-3cf43c9e-fd50-4601-bedb-aae1cc52ef41 (3cf43c9e-fd50-4601-bedb-aae1cc52ef41): created successfully Sep 08 06:56:37 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b342ba0f-f7d7-4dc4-89b8-6e114b8d47a2 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61a61800-a19c-4541-b34a-4375d29c5d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:37 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b342ba0f-f7d7-4dc4-89b8-6e114b8d47a2 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Flow 'volume_create_manager' (ad2a28fe-741d-4c2e-bced-9467ec8354fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:56:37 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-b342ba0f-f7d7-4dc4-89b8-6e114b8d47a2 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Created volume successfully. Sep 08 06:56:37 devstack sudo[113297]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-c27767a4-15c1-4337-8512-19f325d06344 tempest-VolumesExtendTest-1511794103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-74e91bf7-73d6-4824-ad2d-f55874c4e7f1" returned: 0 in 0.359s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-c27767a4-15c1-4337-8512-19f325d06344 tempest-VolumesExtendTest-1511794103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-74e91bf7-73d6-4824-ad2d-f55874c4e7f1 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:37 devstack sudo[113318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-74e91bf7-73d6-4824-ad2d-f55874c4e7f1 Sep 08 06:56:37 devstack sudo[113318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:37 devstack sudo[113318]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-c27767a4-15c1-4337-8512-19f325d06344 tempest-VolumesExtendTest-1511794103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-74e91bf7-73d6-4824-ad2d-f55874c4e7f1" returned: 0 in 0.292s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:37 devstack sudo[113303]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-816aee83-a7f2-49bf-bf37-3df64818ad17 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-73edbaed-417b-4cbb-9cb7-af369330d77b 1073741824" returned: 0 in 0.527s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:38 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-c27767a4-15c1-4337-8512-19f325d06344 tempest-VolumesExtendTest-1511794103 None] Lock "cinder-quobyte-74e91bf7-73d6-4824-ad2d-f55874c4e7f1" released by "delete_volume" :: held 0.736s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:56:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-816aee83-a7f2-49bf-bf37-3df64818ad17 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-73edbaed-417b-4cbb-9cb7-af369330d77b {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:38 devstack sudo[113333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-73edbaed-417b-4cbb-9cb7-af369330d77b Sep 08 06:56:38 devstack sudo[113333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:38 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-c27767a4-15c1-4337-8512-19f325d06344 tempest-VolumesExtendTest-1511794103 None] Created reservations ['2b292827-c4ba-4333-ae2c-90b6cc806351', 'b9317a5f-322f-42ae-9cc9-abfb7ff68d92', '9929eded-8d2e-4855-9df5-b433478417a2', '4a9264a2-53a6-4afc-96dc-2de6e9b98074'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:56:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-c27767a4-15c1-4337-8512-19f325d06344 tempest-VolumesExtendTest-1511794103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:56:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-c27767a4-15c1-4337-8512-19f325d06344 tempest-VolumesExtendTest-1511794103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:56:38 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-c27767a4-15c1-4337-8512-19f325d06344 tempest-VolumesExtendTest-1511794103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:56:38 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-c27767a4-15c1-4337-8512-19f325d06344 tempest-VolumesExtendTest-1511794103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:56:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-c27767a4-15c1-4337-8512-19f325d06344 tempest-VolumesExtendTest-1511794103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:56:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-c27767a4-15c1-4337-8512-19f325d06344 tempest-VolumesExtendTest-1511794103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:38 devstack sudo[113338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:56:38 devstack sudo[113338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:38 devstack sudo[113333]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-816aee83-a7f2-49bf-bf37-3df64818ad17 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-73edbaed-417b-4cbb-9cb7-af369330d77b" returned: 0 in 0.341s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:38 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-816aee83-a7f2-49bf-bf37-3df64818ad17 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:56:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-816aee83-a7f2-49bf-bf37-3df64818ad17 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:56:38 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-816aee83-a7f2-49bf-bf37-3df64818ad17 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23b344c5-468b-44f9-bb60-bd9112bbe6c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73edbaed-417b-4cbb-9cb7-af369330d77b', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:38 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-816aee83-a7f2-49bf-bf37-3df64818ad17 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f09463c3-46a7-4962-812b-f1e9ac691544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:38 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-816aee83-a7f2-49bf-bf37-3df64818ad17 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Volume volume-73edbaed-417b-4cbb-9cb7-af369330d77b (73edbaed-417b-4cbb-9cb7-af369330d77b): created successfully Sep 08 06:56:38 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-816aee83-a7f2-49bf-bf37-3df64818ad17 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f09463c3-46a7-4962-812b-f1e9ac691544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:38 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-816aee83-a7f2-49bf-bf37-3df64818ad17 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Flow 'volume_create_manager' (d2e0a79f-c1dc-4bbc-8415-4d8d57aeae80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:56:38 devstack sudo[113338]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-c27767a4-15c1-4337-8512-19f325d06344 tempest-VolumesExtendTest-1511794103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.303s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:38 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-c27767a4-15c1-4337-8512-19f325d06344 tempest-VolumesExtendTest-1511794103 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:56:38 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-816aee83-a7f2-49bf-bf37-3df64818ad17 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Created volume successfully. Sep 08 06:56:38 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-c27767a4-15c1-4337-8512-19f325d06344 tempest-VolumesExtendTest-1511794103 None] Deleted volume successfully. Sep 08 06:56:38 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-c27767a4-15c1-4337-8512-19f325d06344 tempest-VolumesExtendTest-1511794103 None] Lock "cinder-74e91bf7-73d6-4824-ad2d-f55874c4e7f1-delete_volume" released by "delete_volume" :: held 1.311s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:56:39 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-a1224843-2285-48f6-8903-9e61407bfc9b tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Acquiring lock "cinder-73edbaed-417b-4cbb-9cb7-af369330d77b-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:56:39 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-a1224843-2285-48f6-8903-9e61407bfc9b tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Lock "cinder-73edbaed-417b-4cbb-9cb7-af369330d77b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:56:39 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-a1224843-2285-48f6-8903-9e61407bfc9b tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Acquiring lock "cinder-quobyte-73edbaed-417b-4cbb-9cb7-af369330d77b" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:56:39 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-a1224843-2285-48f6-8903-9e61407bfc9b tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Lock "cinder-quobyte-73edbaed-417b-4cbb-9cb7-af369330d77b" acquired by "delete_volume" :: waited 0.021s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:56:39 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31df6be-81b3-40dc-9645-3e81ffdc0540]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:56:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a1224843-2285-48f6-8903-9e61407bfc9b tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-73edbaed-417b-4cbb-9cb7-af369330d77b {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:39 devstack sudo[113379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-73edbaed-417b-4cbb-9cb7-af369330d77b Sep 08 06:56:39 devstack sudo[113379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:39 devstack sudo[113379]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a1224843-2285-48f6-8903-9e61407bfc9b tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-73edbaed-417b-4cbb-9cb7-af369330d77b" returned: 0 in 0.419s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a1224843-2285-48f6-8903-9e61407bfc9b tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-73edbaed-417b-4cbb-9cb7-af369330d77b {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:39 devstack sudo[113396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-73edbaed-417b-4cbb-9cb7-af369330d77b Sep 08 06:56:39 devstack sudo[113396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:40 devstack sudo[113396]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a1224843-2285-48f6-8903-9e61407bfc9b tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-73edbaed-417b-4cbb-9cb7-af369330d77b" returned: 0 in 0.357s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:40 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-a1224843-2285-48f6-8903-9e61407bfc9b tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Lock "cinder-quobyte-73edbaed-417b-4cbb-9cb7-af369330d77b" released by "delete_volume" :: held 0.841s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:56:40 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-a1224843-2285-48f6-8903-9e61407bfc9b tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Created reservations ['0f498234-8da9-4950-ac0b-813be0cf29c9', 'edcd8aef-9365-43e4-84c8-22831be78df6', '2d2e2561-fab4-40f4-a05f-95aee6ec6010', '158edd7e-6184-4593-97ae-9fc5912cc999'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:56:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a1224843-2285-48f6-8903-9e61407bfc9b tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:56:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a1224843-2285-48f6-8903-9e61407bfc9b tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:56:40 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-a1224843-2285-48f6-8903-9e61407bfc9b tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:56:40 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-a1224843-2285-48f6-8903-9e61407bfc9b tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:56:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a1224843-2285-48f6-8903-9e61407bfc9b tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:56:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a1224843-2285-48f6-8903-9e61407bfc9b tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:40 devstack sudo[113414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:56:40 devstack sudo[113414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:40 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-2ef38c1b-daff-4afb-8919-84894179b2b7 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Acquiring lock "cinder-3cf43c9e-fd50-4601-bedb-aae1cc52ef41-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:56:40 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-2ef38c1b-daff-4afb-8919-84894179b2b7 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Lock "cinder-3cf43c9e-fd50-4601-bedb-aae1cc52ef41-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:56:40 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-2ef38c1b-daff-4afb-8919-84894179b2b7 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Acquiring lock "cinder-quobyte-3cf43c9e-fd50-4601-bedb-aae1cc52ef41" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:56:40 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-2ef38c1b-daff-4afb-8919-84894179b2b7 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Lock "cinder-quobyte-3cf43c9e-fd50-4601-bedb-aae1cc52ef41" acquired by "delete_volume" :: waited 0.032s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:56:40 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b886376e-c227-4c99-bb9e-0e0b9d06629a]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:56:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2ef38c1b-daff-4afb-8919-84894179b2b7 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-3cf43c9e-fd50-4601-bedb-aae1cc52ef41 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:40 devstack sudo[113414]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a1224843-2285-48f6-8903-9e61407bfc9b tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.424s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:40 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-a1224843-2285-48f6-8903-9e61407bfc9b tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:56:40 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-a1224843-2285-48f6-8903-9e61407bfc9b tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Deleted volume successfully. Sep 08 06:56:40 devstack sudo[113425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-3cf43c9e-fd50-4601-bedb-aae1cc52ef41 Sep 08 06:56:40 devstack sudo[113425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:40 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-a1224843-2285-48f6-8903-9e61407bfc9b tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Lock "cinder-73edbaed-417b-4cbb-9cb7-af369330d77b-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:56:40 devstack sudo[113425]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2ef38c1b-daff-4afb-8919-84894179b2b7 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-3cf43c9e-fd50-4601-bedb-aae1cc52ef41" returned: 0 in 0.429s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2ef38c1b-daff-4afb-8919-84894179b2b7 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-3cf43c9e-fd50-4601-bedb-aae1cc52ef41 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:41 devstack sudo[113443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-3cf43c9e-fd50-4601-bedb-aae1cc52ef41 Sep 08 06:56:41 devstack sudo[113443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:41 devstack sudo[113443]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2ef38c1b-daff-4afb-8919-84894179b2b7 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-3cf43c9e-fd50-4601-bedb-aae1cc52ef41" returned: 0 in 0.276s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:41 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-2ef38c1b-daff-4afb-8919-84894179b2b7 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Lock "cinder-quobyte-3cf43c9e-fd50-4601-bedb-aae1cc52ef41" released by "delete_volume" :: held 0.760s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:56:41 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-2ef38c1b-daff-4afb-8919-84894179b2b7 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Created reservations ['93739f54-67e2-47b1-98ee-c2ac090d5dff', '1501cbd6-ded0-4101-af3c-cd5817c4445d', '93357360-efb5-4287-8b08-523039a526a3', 'f1279e22-bed6-4b20-883d-23782aa68057'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:56:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-2ef38c1b-daff-4afb-8919-84894179b2b7 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:56:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-2ef38c1b-daff-4afb-8919-84894179b2b7 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:56:41 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-2ef38c1b-daff-4afb-8919-84894179b2b7 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:56:41 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-2ef38c1b-daff-4afb-8919-84894179b2b7 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:56:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-2ef38c1b-daff-4afb-8919-84894179b2b7 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:56:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2ef38c1b-daff-4afb-8919-84894179b2b7 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:41 devstack sudo[113460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:56:41 devstack sudo[113460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:41 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-e0c31cdc-2c4b-4d4e-a56a-bab504c11b25 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Acquiring lock "cinder-2bb6d024-7afe-4f5e-a253-127679b9b78e-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:56:41 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-e0c31cdc-2c4b-4d4e-a56a-bab504c11b25 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Lock "cinder-2bb6d024-7afe-4f5e-a253-127679b9b78e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:56:41 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-e0c31cdc-2c4b-4d4e-a56a-bab504c11b25 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Acquiring lock "cinder-quobyte-2bb6d024-7afe-4f5e-a253-127679b9b78e" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:56:41 devstack sudo[113460]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:41 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-e0c31cdc-2c4b-4d4e-a56a-bab504c11b25 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Lock "cinder-quobyte-2bb6d024-7afe-4f5e-a253-127679b9b78e" acquired by "delete_volume" :: waited 0.023s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:56:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2ef38c1b-daff-4afb-8919-84894179b2b7 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.309s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:41 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-2ef38c1b-daff-4afb-8919-84894179b2b7 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:56:41 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-2ef38c1b-daff-4afb-8919-84894179b2b7 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Deleted volume successfully. Sep 08 06:56:41 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec06c00e-b278-47a6-a750-9276860121e8]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:56:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e0c31cdc-2c4b-4d4e-a56a-bab504c11b25 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2bb6d024-7afe-4f5e-a253-127679b9b78e {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:41 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-2ef38c1b-daff-4afb-8919-84894179b2b7 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Lock "cinder-3cf43c9e-fd50-4601-bedb-aae1cc52ef41-delete_volume" released by "delete_volume" :: held 1.386s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:56:41 devstack sudo[113473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2bb6d024-7afe-4f5e-a253-127679b9b78e Sep 08 06:56:41 devstack sudo[113473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:42 devstack sudo[113473]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e0c31cdc-2c4b-4d4e-a56a-bab504c11b25 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2bb6d024-7afe-4f5e-a253-127679b9b78e" returned: 0 in 0.424s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e0c31cdc-2c4b-4d4e-a56a-bab504c11b25 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2bb6d024-7afe-4f5e-a253-127679b9b78e {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:42 devstack sudo[113493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2bb6d024-7afe-4f5e-a253-127679b9b78e Sep 08 06:56:42 devstack sudo[113493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:42 devstack sudo[113493]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e0c31cdc-2c4b-4d4e-a56a-bab504c11b25 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2bb6d024-7afe-4f5e-a253-127679b9b78e" returned: 0 in 0.254s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:42 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-e0c31cdc-2c4b-4d4e-a56a-bab504c11b25 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Lock "cinder-quobyte-2bb6d024-7afe-4f5e-a253-127679b9b78e" released by "delete_volume" :: held 0.751s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:56:42 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-e0c31cdc-2c4b-4d4e-a56a-bab504c11b25 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Created reservations ['28a58aeb-3873-4238-a3cd-f9dc80d07247', '036d7ee1-81e2-4253-820b-a70635e60b83', '6d29486e-3614-47ae-949f-d631652c99f9', '26321f52-d31c-46e6-97a0-bb3ac0f3b566'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:56:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-e0c31cdc-2c4b-4d4e-a56a-bab504c11b25 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:56:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-e0c31cdc-2c4b-4d4e-a56a-bab504c11b25 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:56:42 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-e0c31cdc-2c4b-4d4e-a56a-bab504c11b25 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:56:42 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-e0c31cdc-2c4b-4d4e-a56a-bab504c11b25 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:56:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-e0c31cdc-2c4b-4d4e-a56a-bab504c11b25 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:56:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e0c31cdc-2c4b-4d4e-a56a-bab504c11b25 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:42 devstack sudo[113512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:56:42 devstack sudo[113512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:42 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-8a3785a2-f5ce-4316-aed2-7399b14da7d6 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Acquiring lock "cinder-499773f1-a5fe-4fd4-bb4e-2174df1eb011-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:56:42 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-8a3785a2-f5ce-4316-aed2-7399b14da7d6 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Lock "cinder-499773f1-a5fe-4fd4-bb4e-2174df1eb011-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:56:42 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-8a3785a2-f5ce-4316-aed2-7399b14da7d6 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Acquiring lock "cinder-quobyte-499773f1-a5fe-4fd4-bb4e-2174df1eb011" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:56:42 devstack sudo[113512]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e0c31cdc-2c4b-4d4e-a56a-bab504c11b25 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.315s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:42 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-e0c31cdc-2c4b-4d4e-a56a-bab504c11b25 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:56:42 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-8a3785a2-f5ce-4316-aed2-7399b14da7d6 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Lock "cinder-quobyte-499773f1-a5fe-4fd4-bb4e-2174df1eb011" acquired by "delete_volume" :: waited 0.028s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:56:42 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-e0c31cdc-2c4b-4d4e-a56a-bab504c11b25 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Deleted volume successfully. Sep 08 06:56:42 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac552d1-13e9-4b9c-9914-ed64d111c923]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:56:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8a3785a2-f5ce-4316-aed2-7399b14da7d6 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-499773f1-a5fe-4fd4-bb4e-2174df1eb011 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:43 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-e0c31cdc-2c4b-4d4e-a56a-bab504c11b25 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Lock "cinder-2bb6d024-7afe-4f5e-a253-127679b9b78e-delete_volume" released by "delete_volume" :: held 1.363s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:56:43 devstack sudo[113530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-499773f1-a5fe-4fd4-bb4e-2174df1eb011 Sep 08 06:56:43 devstack sudo[113530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:43 devstack sudo[113530]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8a3785a2-f5ce-4316-aed2-7399b14da7d6 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-499773f1-a5fe-4fd4-bb4e-2174df1eb011" returned: 0 in 0.477s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8a3785a2-f5ce-4316-aed2-7399b14da7d6 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-499773f1-a5fe-4fd4-bb4e-2174df1eb011 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:43 devstack sudo[113559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-499773f1-a5fe-4fd4-bb4e-2174df1eb011 Sep 08 06:56:43 devstack sudo[113559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-cb5e152d-5e81-4a13-bd92-9ac2bed26204 req-38191841-67a2-45a8-a358-f7ac6e3c84ed tempest-TestStampPattern-1549278103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:56:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-cb5e152d-5e81-4a13-bd92-9ac2bed26204 req-38191841-67a2-45a8-a358-f7ac6e3c84ed tempest-TestStampPattern-1549278103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:56:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-cb5e152d-5e81-4a13-bd92-9ac2bed26204 req-38191841-67a2-45a8-a358-f7ac6e3c84ed tempest-TestStampPattern-1549278103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:56:43 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-cb5e152d-5e81-4a13-bd92-9ac2bed26204 req-38191841-67a2-45a8-a358-f7ac6e3c84ed tempest-TestStampPattern-1549278103 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d', 'name': 'volume-d59d0b6e-b8f7-4d08-aff1-01260306dacb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6378d1ad-7f21-4ad2-bc66-1821ec5a3a47', 'enforce_multipath': True} {{(pid=87507) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 06:56:43 devstack cinder-volume[87507]: INFO cinder.volume.manager [req-cb5e152d-5e81-4a13-bd92-9ac2bed26204 req-38191841-67a2-45a8-a358-f7ac6e3c84ed tempest-TestStampPattern-1549278103 None] attachment_update completed successfully. Sep 08 06:56:43 devstack sudo[113559]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8a3785a2-f5ce-4316-aed2-7399b14da7d6 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-499773f1-a5fe-4fd4-bb4e-2174df1eb011" returned: 0 in 0.303s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:43 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-8a3785a2-f5ce-4316-aed2-7399b14da7d6 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Lock "cinder-quobyte-499773f1-a5fe-4fd4-bb4e-2174df1eb011" released by "delete_volume" :: held 0.851s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:56:43 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-8a3785a2-f5ce-4316-aed2-7399b14da7d6 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Created reservations ['020f3332-25bd-406f-b5df-2b1216a91005', 'c50bae29-857d-495a-954c-89ee32a748e8', '1dc64947-2ec2-4230-8f48-dcb3d23461d5', '90becc21-691c-4d15-b37d-32387a9563ba'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:56:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8a3785a2-f5ce-4316-aed2-7399b14da7d6 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:56:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8a3785a2-f5ce-4316-aed2-7399b14da7d6 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:56:43 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8a3785a2-f5ce-4316-aed2-7399b14da7d6 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:56:43 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8a3785a2-f5ce-4316-aed2-7399b14da7d6 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:56:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8a3785a2-f5ce-4316-aed2-7399b14da7d6 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:56:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8a3785a2-f5ce-4316-aed2-7399b14da7d6 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:43 devstack sudo[113644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:56:43 devstack sudo[113644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:44 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-66d9f008-ce27-45a6-b327-2afdbfe3cb74 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Acquiring lock "cinder-84ca266b-dca4-4344-adc9-c2c7c7518060-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:56:44 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-66d9f008-ce27-45a6-b327-2afdbfe3cb74 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Lock "cinder-84ca266b-dca4-4344-adc9-c2c7c7518060-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:56:44 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-66d9f008-ce27-45a6-b327-2afdbfe3cb74 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Acquiring lock "cinder-quobyte-84ca266b-dca4-4344-adc9-c2c7c7518060" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:56:44 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-66d9f008-ce27-45a6-b327-2afdbfe3cb74 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Lock "cinder-quobyte-84ca266b-dca4-4344-adc9-c2c7c7518060" acquired by "delete_volume" :: waited 0.031s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:56:44 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc51d22-4c34-4540-88cc-b4f8b4f07756]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:56:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-66d9f008-ce27-45a6-b327-2afdbfe3cb74 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-84ca266b-dca4-4344-adc9-c2c7c7518060 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:44 devstack sudo[113644]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8a3785a2-f5ce-4316-aed2-7399b14da7d6 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.433s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:44 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-8a3785a2-f5ce-4316-aed2-7399b14da7d6 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:56:44 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-8a3785a2-f5ce-4316-aed2-7399b14da7d6 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Deleted volume successfully. Sep 08 06:56:44 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-8a3785a2-f5ce-4316-aed2-7399b14da7d6 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Lock "cinder-499773f1-a5fe-4fd4-bb4e-2174df1eb011-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:56:44 devstack sudo[113967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-84ca266b-dca4-4344-adc9-c2c7c7518060 Sep 08 06:56:44 devstack sudo[113967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:44 devstack sudo[113967]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-66d9f008-ce27-45a6-b327-2afdbfe3cb74 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-84ca266b-dca4-4344-adc9-c2c7c7518060" returned: 0 in 0.535s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-66d9f008-ce27-45a6-b327-2afdbfe3cb74 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-84ca266b-dca4-4344-adc9-c2c7c7518060 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:44 devstack sudo[113991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-84ca266b-dca4-4344-adc9-c2c7c7518060 Sep 08 06:56:44 devstack sudo[113991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:45 devstack sudo[113991]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-66d9f008-ce27-45a6-b327-2afdbfe3cb74 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-84ca266b-dca4-4344-adc9-c2c7c7518060" returned: 0 in 0.267s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:45 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-66d9f008-ce27-45a6-b327-2afdbfe3cb74 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Lock "cinder-quobyte-84ca266b-dca4-4344-adc9-c2c7c7518060" released by "delete_volume" :: held 0.861s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:56:45 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-66d9f008-ce27-45a6-b327-2afdbfe3cb74 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Created reservations ['e3b1ad36-7a33-4688-a992-4ae1734b2008', 'a6e580fc-d4b3-453a-859b-e67a73cbb4aa', '2b280ee9-41d7-4666-abbd-24f978a2e667', 'f1fea560-463a-4944-982d-f6ca358d5176'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:56:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-66d9f008-ce27-45a6-b327-2afdbfe3cb74 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:56:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-66d9f008-ce27-45a6-b327-2afdbfe3cb74 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:56:45 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-66d9f008-ce27-45a6-b327-2afdbfe3cb74 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:56:45 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-66d9f008-ce27-45a6-b327-2afdbfe3cb74 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:56:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-66d9f008-ce27-45a6-b327-2afdbfe3cb74 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:56:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-66d9f008-ce27-45a6-b327-2afdbfe3cb74 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:45 devstack sudo[114006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:56:45 devstack sudo[114006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:45 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-03acd9ef-1aea-48d1-8d35-f4aae6bb931a tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Acquiring lock "cinder-00713280-f459-4258-b389-6f95fd468e02-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:56:45 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-03acd9ef-1aea-48d1-8d35-f4aae6bb931a tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Lock "cinder-00713280-f459-4258-b389-6f95fd468e02-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:56:45 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-03acd9ef-1aea-48d1-8d35-f4aae6bb931a tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Acquiring lock "cinder-quobyte-00713280-f459-4258-b389-6f95fd468e02" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:56:45 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-03acd9ef-1aea-48d1-8d35-f4aae6bb931a tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Lock "cinder-quobyte-00713280-f459-4258-b389-6f95fd468e02" acquired by "delete_volume" :: waited 0.023s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:56:45 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[961bf6fd-7ec7-4ea8-a2d3-ebe0a69e117f]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:56:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-03acd9ef-1aea-48d1-8d35-f4aae6bb931a tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-00713280-f459-4258-b389-6f95fd468e02 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:45 devstack sudo[114006]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-66d9f008-ce27-45a6-b327-2afdbfe3cb74 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.326s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:45 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-66d9f008-ce27-45a6-b327-2afdbfe3cb74 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:56:45 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-66d9f008-ce27-45a6-b327-2afdbfe3cb74 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Deleted volume successfully. Sep 08 06:56:45 devstack sudo[114014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-00713280-f459-4258-b389-6f95fd468e02 Sep 08 06:56:45 devstack sudo[114014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:45 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-66d9f008-ce27-45a6-b327-2afdbfe3cb74 tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Lock "cinder-84ca266b-dca4-4344-adc9-c2c7c7518060-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:56:45 devstack sudo[114014]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-03acd9ef-1aea-48d1-8d35-f4aae6bb931a tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-00713280-f459-4258-b389-6f95fd468e02" returned: 0 in 0.403s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-03acd9ef-1aea-48d1-8d35-f4aae6bb931a tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-00713280-f459-4258-b389-6f95fd468e02 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:45 devstack sudo[114040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-00713280-f459-4258-b389-6f95fd468e02 Sep 08 06:56:45 devstack sudo[114040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:46 devstack sudo[114040]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-03acd9ef-1aea-48d1-8d35-f4aae6bb931a tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-00713280-f459-4258-b389-6f95fd468e02" returned: 0 in 0.285s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:46 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-03acd9ef-1aea-48d1-8d35-f4aae6bb931a tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Lock "cinder-quobyte-00713280-f459-4258-b389-6f95fd468e02" released by "delete_volume" :: held 0.747s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:56:46 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-03acd9ef-1aea-48d1-8d35-f4aae6bb931a tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Created reservations ['4b5453f3-e039-4dac-a7e2-81b8f6b7f13e', '63be0567-328f-4ce7-94a7-43a74f68a160', '8e551c64-56e9-4b13-958a-33b6b46339a2', 'c7a3a165-07c2-4898-a465-1444736a65f7'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:56:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-03acd9ef-1aea-48d1-8d35-f4aae6bb931a tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:56:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-03acd9ef-1aea-48d1-8d35-f4aae6bb931a tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:56:46 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-03acd9ef-1aea-48d1-8d35-f4aae6bb931a tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:56:46 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-03acd9ef-1aea-48d1-8d35-f4aae6bb931a tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:56:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-03acd9ef-1aea-48d1-8d35-f4aae6bb931a tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:56:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-03acd9ef-1aea-48d1-8d35-f4aae6bb931a tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:46 devstack sudo[114060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:56:46 devstack sudo[114060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:46 devstack sudo[114060]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-03acd9ef-1aea-48d1-8d35-f4aae6bb931a tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.309s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:46 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-03acd9ef-1aea-48d1-8d35-f4aae6bb931a tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:56:46 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-03acd9ef-1aea-48d1-8d35-f4aae6bb931a tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Deleted volume successfully. Sep 08 06:56:46 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-03acd9ef-1aea-48d1-8d35-f4aae6bb931a tempest-CreateVolumesFromSourceVolumeTest-1050689098 None] Lock "cinder-00713280-f459-4258-b389-6f95fd468e02-delete_volume" released by "delete_volume" :: held 1.348s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:56:46 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-6031c548-22ec-4963-85cc-7aa333654460 tempest-VolumesSnapshotListTestJSON-416585296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:56:46 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6031c548-22ec-4963-85cc-7aa333654460 tempest-VolumesSnapshotListTestJSON-416585296 None] Flow 'volume_create_manager' (af117c6a-b6ba-4629-8d8b-88fce0197982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:56:46 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6031c548-22ec-4963-85cc-7aa333654460 tempest-VolumesSnapshotListTestJSON-416585296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e8b9809-798d-45d1-bff2-a52427072ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:46 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6031c548-22ec-4963-85cc-7aa333654460 tempest-VolumesSnapshotListTestJSON-416585296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e8b9809-798d-45d1-bff2-a52427072ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:56:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1215184702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12d07197-efbe-4240-b7a7-b5ab4988dab4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dd3b55f9d4249a3831a2d03a51d243c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:56:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:56:47Z,use_quota=True,user_id='c01d63f765674e488461b533370832f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:46 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6031c548-22ec-4963-85cc-7aa333654460 tempest-VolumesSnapshotListTestJSON-416585296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e4651a0-cbff-4641-a413-876e1da7a27e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:46 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6031c548-22ec-4963-85cc-7aa333654460 tempest-VolumesSnapshotListTestJSON-416585296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e4651a0-cbff-4641-a413-876e1da7a27e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:46 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6031c548-22ec-4963-85cc-7aa333654460 tempest-VolumesSnapshotListTestJSON-416585296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a54e5afd-c99c-4347-b015-f5e77e066a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:46 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6031c548-22ec-4963-85cc-7aa333654460 tempest-VolumesSnapshotListTestJSON-416585296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a54e5afd-c99c-4347-b015-f5e77e066a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12d07197-efbe-4240-b7a7-b5ab4988dab4', 'volume_name': 'volume-12d07197-efbe-4240-b7a7-b5ab4988dab4', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:46 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6031c548-22ec-4963-85cc-7aa333654460 tempest-VolumesSnapshotListTestJSON-416585296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c66cc77-3990-4a3a-b2ae-068a74223a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:46 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6031c548-22ec-4963-85cc-7aa333654460 tempest-VolumesSnapshotListTestJSON-416585296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c66cc77-3990-4a3a-b2ae-068a74223a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:46 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6031c548-22ec-4963-85cc-7aa333654460 tempest-VolumesSnapshotListTestJSON-416585296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38644169-7084-45c5-88dd-68be532a7da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:46 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-6031c548-22ec-4963-85cc-7aa333654460 tempest-VolumesSnapshotListTestJSON-416585296 None] Volume 12d07197-efbe-4240-b7a7-b5ab4988dab4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12d07197-efbe-4240-b7a7-b5ab4988dab4', 'volume_size': 1} Sep 08 06:56:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-6031c548-22ec-4963-85cc-7aa333654460 tempest-VolumesSnapshotListTestJSON-416585296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:56:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-6031c548-22ec-4963-85cc-7aa333654460 tempest-VolumesSnapshotListTestJSON-416585296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:56:46 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-6031c548-22ec-4963-85cc-7aa333654460 tempest-VolumesSnapshotListTestJSON-416585296 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:56:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1215184702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12d07197-efbe-4240-b7a7-b5ab4988dab4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dd3b55f9d4249a3831a2d03a51d243c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:56:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:56:47Z,use_quota=True,user_id='c01d63f765674e488461b533370832f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:56:46 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-6031c548-22ec-4963-85cc-7aa333654460 tempest-VolumesSnapshotListTestJSON-416585296 None] Creating volume 12d07197-efbe-4240-b7a7-b5ab4988dab4 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:56:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-6031c548-22ec-4963-85cc-7aa333654460 tempest-VolumesSnapshotListTestJSON-416585296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:56:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-6031c548-22ec-4963-85cc-7aa333654460 tempest-VolumesSnapshotListTestJSON-416585296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:56:46 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-6031c548-22ec-4963-85cc-7aa333654460 tempest-VolumesSnapshotListTestJSON-416585296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:56:46 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-6031c548-22ec-4963-85cc-7aa333654460 tempest-VolumesSnapshotListTestJSON-416585296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:56:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-6031c548-22ec-4963-85cc-7aa333654460 tempest-VolumesSnapshotListTestJSON-416585296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:56:46 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-6031c548-22ec-4963-85cc-7aa333654460 tempest-VolumesSnapshotListTestJSON-416585296 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:56:46 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-6031c548-22ec-4963-85cc-7aa333654460 tempest-VolumesSnapshotListTestJSON-416585296 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:56:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6031c548-22ec-4963-85cc-7aa333654460 tempest-VolumesSnapshotListTestJSON-416585296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:46 devstack sudo[114078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4 1073741824 Sep 08 06:56:46 devstack sudo[114078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:47 devstack sudo[114078]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6031c548-22ec-4963-85cc-7aa333654460 tempest-VolumesSnapshotListTestJSON-416585296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4 1073741824" returned: 0 in 0.523s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6031c548-22ec-4963-85cc-7aa333654460 tempest-VolumesSnapshotListTestJSON-416585296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:47 devstack sudo[114099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4 Sep 08 06:56:47 devstack sudo[114099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:47 devstack sudo[114099]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6031c548-22ec-4963-85cc-7aa333654460 tempest-VolumesSnapshotListTestJSON-416585296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4" returned: 0 in 0.302s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:47 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-6031c548-22ec-4963-85cc-7aa333654460 tempest-VolumesSnapshotListTestJSON-416585296 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:56:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-6031c548-22ec-4963-85cc-7aa333654460 tempest-VolumesSnapshotListTestJSON-416585296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:56:47 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6031c548-22ec-4963-85cc-7aa333654460 tempest-VolumesSnapshotListTestJSON-416585296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38644169-7084-45c5-88dd-68be532a7da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12d07197-efbe-4240-b7a7-b5ab4988dab4', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:47 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6031c548-22ec-4963-85cc-7aa333654460 tempest-VolumesSnapshotListTestJSON-416585296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46876346-98f6-4f63-bcc2-cf29481340cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:47 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-6031c548-22ec-4963-85cc-7aa333654460 tempest-VolumesSnapshotListTestJSON-416585296 None] Volume volume-12d07197-efbe-4240-b7a7-b5ab4988dab4 (12d07197-efbe-4240-b7a7-b5ab4988dab4): created successfully Sep 08 06:56:47 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6031c548-22ec-4963-85cc-7aa333654460 tempest-VolumesSnapshotListTestJSON-416585296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46876346-98f6-4f63-bcc2-cf29481340cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:47 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6031c548-22ec-4963-85cc-7aa333654460 tempest-VolumesSnapshotListTestJSON-416585296 None] Flow 'volume_create_manager' (af117c6a-b6ba-4629-8d8b-88fce0197982) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:56:47 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-6031c548-22ec-4963-85cc-7aa333654460 tempest-VolumesSnapshotListTestJSON-416585296 None] Created volume successfully. Sep 08 06:56:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-e65c6cc9-13f3-4a3d-8428-93fb716f12ae tempest-VolumesSnapshotListTestJSON-416585296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:56:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-e65c6cc9-13f3-4a3d-8428-93fb716f12ae tempest-VolumesSnapshotListTestJSON-416585296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:56:48 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-e65c6cc9-13f3-4a3d-8428-93fb716f12ae tempest-VolumesSnapshotListTestJSON-416585296 None] Creating offline snapshot 0b7f84d3-eb6a-4ca7-8f2d-6af47a0579ad of volume 12d07197-efbe-4240-b7a7-b5ab4988dab4 {{(pid=87507) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 06:56:48 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f91422-e746-4269-aafd-a65fda9e68eb]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:56:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e65c6cc9-13f3-4a3d-8428-93fb716f12ae tempest-VolumesSnapshotListTestJSON-416585296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:49 devstack sudo[114167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4 Sep 08 06:56:49 devstack sudo[114167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:49 devstack sudo[114167]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e65c6cc9-13f3-4a3d-8428-93fb716f12ae tempest-VolumesSnapshotListTestJSON-416585296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4" returned: 0 in 0.418s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e65c6cc9-13f3-4a3d-8428-93fb716f12ae tempest-VolumesSnapshotListTestJSON-416585296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.0b7f84d3-eb6a-4ca7-8f2d-6af47a0579ad 1G {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:49 devstack sudo[114186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.0b7f84d3-eb6a-4ca7-8f2d-6af47a0579ad 1G Sep 08 06:56:49 devstack sudo[114186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:49 devstack cinder-volume[87507]: INFO cinder.volume.manager [req-fc86cb6b-c09c-4cb2-905c-25304cf72da2 req-1264c876-9d60-49c8-8c0a-e056f3ab0b89 tempest-TestStampPattern-1549278103 None] Terminate volume connection completed successfully. Sep 08 06:56:49 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-fc86cb6b-c09c-4cb2-905c-25304cf72da2 req-1264c876-9d60-49c8-8c0a-e056f3ab0b89 tempest-TestStampPattern-1549278103 None] Deleting attachment 6378d1ad-7f21-4ad2-bc66-1821ec5a3a47. {{(pid=87507) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 06:56:49 devstack sudo[114186]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e65c6cc9-13f3-4a3d-8428-93fb716f12ae tempest-VolumesSnapshotListTestJSON-416585296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.0b7f84d3-eb6a-4ca7-8f2d-6af47a0579ad 1G" returned: 0 in 0.500s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e65c6cc9-13f3-4a3d-8428-93fb716f12ae tempest-VolumesSnapshotListTestJSON-416585296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12d07197-efbe-4240-b7a7-b5ab4988dab4 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.0b7f84d3-eb6a-4ca7-8f2d-6af47a0579ad {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:49 devstack sudo[114233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12d07197-efbe-4240-b7a7-b5ab4988dab4 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.0b7f84d3-eb6a-4ca7-8f2d-6af47a0579ad Sep 08 06:56:49 devstack sudo[114233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:50 devstack sudo[114233]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e65c6cc9-13f3-4a3d-8428-93fb716f12ae tempest-VolumesSnapshotListTestJSON-416585296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12d07197-efbe-4240-b7a7-b5ab4988dab4 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.0b7f84d3-eb6a-4ca7-8f2d-6af47a0579ad" returned: 0 in 0.376s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:50 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-e65c6cc9-13f3-4a3d-8428-93fb716f12ae tempest-VolumesSnapshotListTestJSON-416585296 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.0b7f84d3-eb6a-4ca7-8f2d-6af47a0579ad is being set with open permissions: ugo+rw Sep 08 06:56:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e65c6cc9-13f3-4a3d-8428-93fb716f12ae tempest-VolumesSnapshotListTestJSON-416585296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.0b7f84d3-eb6a-4ca7-8f2d-6af47a0579ad {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:50 devstack sudo[114248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.0b7f84d3-eb6a-4ca7-8f2d-6af47a0579ad Sep 08 06:56:50 devstack sudo[114248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b4025370-8173-4374-866d-de38577d7f21 tempest-TestStampPattern-1549278103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:56:50 devstack sudo[114248]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e65c6cc9-13f3-4a3d-8428-93fb716f12ae tempest-VolumesSnapshotListTestJSON-416585296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.0b7f84d3-eb6a-4ca7-8f2d-6af47a0579ad" returned: 0 in 0.272s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e65c6cc9-13f3-4a3d-8428-93fb716f12ae tempest-VolumesSnapshotListTestJSON-416585296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:50 devstack sudo[114261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.info Sep 08 06:56:50 devstack sudo[114261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:50 devstack sudo[114261]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e65c6cc9-13f3-4a3d-8428-93fb716f12ae tempest-VolumesSnapshotListTestJSON-416585296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.info" returned: 0 in 0.266s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:50 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-e65c6cc9-13f3-4a3d-8428-93fb716f12ae tempest-VolumesSnapshotListTestJSON-416585296 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.info is being set with open permissions: ugo+rw Sep 08 06:56:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e65c6cc9-13f3-4a3d-8428-93fb716f12ae tempest-VolumesSnapshotListTestJSON-416585296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:50 devstack sudo[114272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.info Sep 08 06:56:50 devstack sudo[114272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:51 devstack sudo[114272]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e65c6cc9-13f3-4a3d-8428-93fb716f12ae tempest-VolumesSnapshotListTestJSON-416585296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.info" returned: 0 in 0.266s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-e65c6cc9-13f3-4a3d-8428-93fb716f12ae tempest-VolumesSnapshotListTestJSON-416585296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.199s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:56:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b4025370-8173-4374-866d-de38577d7f21 tempest-TestStampPattern-1549278103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.811s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:56:51 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-b4025370-8173-4374-866d-de38577d7f21 tempest-TestStampPattern-1549278103 None] Creating offline snapshot 992b32f6-4a2c-43f4-96d1-2bfdaa469280 of volume d59d0b6e-b8f7-4d08-aff1-01260306dacb {{(pid=87507) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 06:56:51 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-e65c6cc9-13f3-4a3d-8428-93fb716f12ae tempest-VolumesSnapshotListTestJSON-416585296 None] Create snapshot completed successfully Sep 08 06:56:51 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba5df93-90df-4ef3-bfa9-58b55c683251]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:56:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b4025370-8173-4374-866d-de38577d7f21 tempest-TestStampPattern-1549278103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d59d0b6e-b8f7-4d08-aff1-01260306dacb {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:51 devstack sudo[114284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d59d0b6e-b8f7-4d08-aff1-01260306dacb Sep 08 06:56:51 devstack sudo[114284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:51 devstack sudo[114284]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b4025370-8173-4374-866d-de38577d7f21 tempest-TestStampPattern-1549278103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d59d0b6e-b8f7-4d08-aff1-01260306dacb" returned: 0 in 0.380s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b4025370-8173-4374-866d-de38577d7f21 tempest-TestStampPattern-1549278103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d59d0b6e-b8f7-4d08-aff1-01260306dacb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d59d0b6e-b8f7-4d08-aff1-01260306dacb.992b32f6-4a2c-43f4-96d1-2bfdaa469280 1G {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:51 devstack sudo[114301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d59d0b6e-b8f7-4d08-aff1-01260306dacb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d59d0b6e-b8f7-4d08-aff1-01260306dacb.992b32f6-4a2c-43f4-96d1-2bfdaa469280 1G Sep 08 06:56:51 devstack sudo[114301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:52 devstack sudo[114301]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b4025370-8173-4374-866d-de38577d7f21 tempest-TestStampPattern-1549278103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d59d0b6e-b8f7-4d08-aff1-01260306dacb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d59d0b6e-b8f7-4d08-aff1-01260306dacb.992b32f6-4a2c-43f4-96d1-2bfdaa469280 1G" returned: 0 in 0.424s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b4025370-8173-4374-866d-de38577d7f21 tempest-TestStampPattern-1549278103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d59d0b6e-b8f7-4d08-aff1-01260306dacb -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d59d0b6e-b8f7-4d08-aff1-01260306dacb.992b32f6-4a2c-43f4-96d1-2bfdaa469280 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:52 devstack sudo[114319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d59d0b6e-b8f7-4d08-aff1-01260306dacb -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d59d0b6e-b8f7-4d08-aff1-01260306dacb.992b32f6-4a2c-43f4-96d1-2bfdaa469280 Sep 08 06:56:52 devstack sudo[114319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-57672c9f-a397-49ab-b384-3b8ce3a42679 tempest-VolumesSnapshotListTestJSON-416585296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:56:52 devstack sudo[114319]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b4025370-8173-4374-866d-de38577d7f21 tempest-TestStampPattern-1549278103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d59d0b6e-b8f7-4d08-aff1-01260306dacb -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d59d0b6e-b8f7-4d08-aff1-01260306dacb.992b32f6-4a2c-43f4-96d1-2bfdaa469280" returned: 0 in 0.349s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:52 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-b4025370-8173-4374-866d-de38577d7f21 tempest-TestStampPattern-1549278103 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d59d0b6e-b8f7-4d08-aff1-01260306dacb.992b32f6-4a2c-43f4-96d1-2bfdaa469280 is being set with open permissions: ugo+rw Sep 08 06:56:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b4025370-8173-4374-866d-de38577d7f21 tempest-TestStampPattern-1549278103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d59d0b6e-b8f7-4d08-aff1-01260306dacb.992b32f6-4a2c-43f4-96d1-2bfdaa469280 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:52 devstack sudo[114336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d59d0b6e-b8f7-4d08-aff1-01260306dacb.992b32f6-4a2c-43f4-96d1-2bfdaa469280 Sep 08 06:56:52 devstack sudo[114336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:52 devstack sudo[114336]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b4025370-8173-4374-866d-de38577d7f21 tempest-TestStampPattern-1549278103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d59d0b6e-b8f7-4d08-aff1-01260306dacb.992b32f6-4a2c-43f4-96d1-2bfdaa469280" returned: 0 in 0.271s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b4025370-8173-4374-866d-de38577d7f21 tempest-TestStampPattern-1549278103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d59d0b6e-b8f7-4d08-aff1-01260306dacb.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:52 devstack sudo[114348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d59d0b6e-b8f7-4d08-aff1-01260306dacb.info Sep 08 06:56:52 devstack sudo[114348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:52 devstack sudo[114348]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b4025370-8173-4374-866d-de38577d7f21 tempest-TestStampPattern-1549278103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d59d0b6e-b8f7-4d08-aff1-01260306dacb.info" returned: 0 in 0.269s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:52 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-b4025370-8173-4374-866d-de38577d7f21 tempest-TestStampPattern-1549278103 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d59d0b6e-b8f7-4d08-aff1-01260306dacb.info is being set with open permissions: ugo+rw Sep 08 06:56:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b4025370-8173-4374-866d-de38577d7f21 tempest-TestStampPattern-1549278103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d59d0b6e-b8f7-4d08-aff1-01260306dacb.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:52 devstack sudo[114360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d59d0b6e-b8f7-4d08-aff1-01260306dacb.info Sep 08 06:56:52 devstack sudo[114360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:53 devstack sudo[114360]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b4025370-8173-4374-866d-de38577d7f21 tempest-TestStampPattern-1549278103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d59d0b6e-b8f7-4d08-aff1-01260306dacb.info" returned: 0 in 0.280s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b4025370-8173-4374-866d-de38577d7f21 tempest-TestStampPattern-1549278103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.084s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:56:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-57672c9f-a397-49ab-b384-3b8ce3a42679 tempest-VolumesSnapshotListTestJSON-416585296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.932s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:56:53 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-57672c9f-a397-49ab-b384-3b8ce3a42679 tempest-VolumesSnapshotListTestJSON-416585296 None] Creating offline snapshot a1a91cc1-6e4a-4839-8bf5-696dbae62d16 of volume 12d07197-efbe-4240-b7a7-b5ab4988dab4 {{(pid=87507) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 06:56:53 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ad8712-7c66-4256-9d26-f87d366901ef]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:56:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-57672c9f-a397-49ab-b384-3b8ce3a42679 tempest-VolumesSnapshotListTestJSON-416585296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.0b7f84d3-eb6a-4ca7-8f2d-6af47a0579ad {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:53 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-b4025370-8173-4374-866d-de38577d7f21 tempest-TestStampPattern-1549278103 None] Create snapshot completed successfully Sep 08 06:56:53 devstack sudo[114375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.0b7f84d3-eb6a-4ca7-8f2d-6af47a0579ad Sep 08 06:56:53 devstack sudo[114375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:53 devstack sudo[114375]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-57672c9f-a397-49ab-b384-3b8ce3a42679 tempest-VolumesSnapshotListTestJSON-416585296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.0b7f84d3-eb6a-4ca7-8f2d-6af47a0579ad" returned: 0 in 0.415s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:53 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-57672c9f-a397-49ab-b384-3b8ce3a42679 tempest-VolumesSnapshotListTestJSON-416585296 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12d07197-efbe-4240-b7a7-b5ab4988dab4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 06:56:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-57672c9f-a397-49ab-b384-3b8ce3a42679 tempest-VolumesSnapshotListTestJSON-416585296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.0b7f84d3-eb6a-4ca7-8f2d-6af47a0579ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.a1a91cc1-6e4a-4839-8bf5-696dbae62d16 1G {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:53 devstack sudo[114392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.0b7f84d3-eb6a-4ca7-8f2d-6af47a0579ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.a1a91cc1-6e4a-4839-8bf5-696dbae62d16 1G Sep 08 06:56:53 devstack sudo[114392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:54 devstack sudo[114392]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-57672c9f-a397-49ab-b384-3b8ce3a42679 tempest-VolumesSnapshotListTestJSON-416585296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.0b7f84d3-eb6a-4ca7-8f2d-6af47a0579ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.a1a91cc1-6e4a-4839-8bf5-696dbae62d16 1G" returned: 0 in 0.522s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-57672c9f-a397-49ab-b384-3b8ce3a42679 tempest-VolumesSnapshotListTestJSON-416585296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.0b7f84d3-eb6a-4ca7-8f2d-6af47a0579ad -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.a1a91cc1-6e4a-4839-8bf5-696dbae62d16 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:54 devstack sudo[114413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.0b7f84d3-eb6a-4ca7-8f2d-6af47a0579ad -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.a1a91cc1-6e4a-4839-8bf5-696dbae62d16 Sep 08 06:56:54 devstack sudo[114413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:54 devstack sudo[114413]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-57672c9f-a397-49ab-b384-3b8ce3a42679 tempest-VolumesSnapshotListTestJSON-416585296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.0b7f84d3-eb6a-4ca7-8f2d-6af47a0579ad -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.a1a91cc1-6e4a-4839-8bf5-696dbae62d16" returned: 0 in 0.344s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:54 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-57672c9f-a397-49ab-b384-3b8ce3a42679 tempest-VolumesSnapshotListTestJSON-416585296 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.a1a91cc1-6e4a-4839-8bf5-696dbae62d16 is being set with open permissions: ugo+rw Sep 08 06:56:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-57672c9f-a397-49ab-b384-3b8ce3a42679 tempest-VolumesSnapshotListTestJSON-416585296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.a1a91cc1-6e4a-4839-8bf5-696dbae62d16 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:54 devstack sudo[114428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.a1a91cc1-6e4a-4839-8bf5-696dbae62d16 Sep 08 06:56:54 devstack sudo[114428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:54 devstack sudo[114428]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-57672c9f-a397-49ab-b384-3b8ce3a42679 tempest-VolumesSnapshotListTestJSON-416585296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.a1a91cc1-6e4a-4839-8bf5-696dbae62d16" returned: 0 in 0.314s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-57672c9f-a397-49ab-b384-3b8ce3a42679 tempest-VolumesSnapshotListTestJSON-416585296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.724s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:56:55 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-57672c9f-a397-49ab-b384-3b8ce3a42679 tempest-VolumesSnapshotListTestJSON-416585296 None] Create snapshot completed successfully Sep 08 06:56:55 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b1a8290-ee59-4fe7-99f2-3d93c61cd8e6 tempest-ProjectReaderTests-942968040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:56:55 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0b1a8290-ee59-4fe7-99f2-3d93c61cd8e6 tempest-ProjectReaderTests-942968040 None] Flow 'volume_create_manager' (17d0becd-38fc-44dd-a225-422fd4bf31b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:56:55 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0b1a8290-ee59-4fe7-99f2-3d93c61cd8e6 tempest-ProjectReaderTests-942968040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dbc3142-86e5-431f-b659-0487c8769c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:55 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0b1a8290-ee59-4fe7-99f2-3d93c61cd8e6 tempest-ProjectReaderTests-942968040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dbc3142-86e5-431f-b659-0487c8769c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:56:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-344037561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ed4fd63-e75d-4723-a0a2-b55889873758,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21310f44f5ea46b79b0e448d4218b12e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:56:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:56:56Z,use_quota=True,user_id='8eb6fa222b7241a9b79c5f74cc129bfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:55 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0b1a8290-ee59-4fe7-99f2-3d93c61cd8e6 tempest-ProjectReaderTests-942968040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28010a12-5d61-4e27-9e2d-006091a2208c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:55 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0b1a8290-ee59-4fe7-99f2-3d93c61cd8e6 tempest-ProjectReaderTests-942968040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28010a12-5d61-4e27-9e2d-006091a2208c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:55 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0b1a8290-ee59-4fe7-99f2-3d93c61cd8e6 tempest-ProjectReaderTests-942968040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ff05683-2514-4c4d-b4b0-a9186032b366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:55 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0b1a8290-ee59-4fe7-99f2-3d93c61cd8e6 tempest-ProjectReaderTests-942968040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ff05683-2514-4c4d-b4b0-a9186032b366) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ed4fd63-e75d-4723-a0a2-b55889873758', 'volume_name': 'volume-0ed4fd63-e75d-4723-a0a2-b55889873758', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:55 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0b1a8290-ee59-4fe7-99f2-3d93c61cd8e6 tempest-ProjectReaderTests-942968040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d76f0f79-b485-4b96-93c0-d9c891e03350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:55 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0b1a8290-ee59-4fe7-99f2-3d93c61cd8e6 tempest-ProjectReaderTests-942968040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d76f0f79-b485-4b96-93c0-d9c891e03350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:55 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0b1a8290-ee59-4fe7-99f2-3d93c61cd8e6 tempest-ProjectReaderTests-942968040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (096a02b7-d479-4ee2-aff2-1fd2822b6511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:55 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-0b1a8290-ee59-4fe7-99f2-3d93c61cd8e6 tempest-ProjectReaderTests-942968040 None] Volume 0ed4fd63-e75d-4723-a0a2-b55889873758: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ed4fd63-e75d-4723-a0a2-b55889873758', 'volume_size': 1} Sep 08 06:56:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-0b1a8290-ee59-4fe7-99f2-3d93c61cd8e6 tempest-ProjectReaderTests-942968040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:56:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-0b1a8290-ee59-4fe7-99f2-3d93c61cd8e6 tempest-ProjectReaderTests-942968040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:56:55 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-0b1a8290-ee59-4fe7-99f2-3d93c61cd8e6 tempest-ProjectReaderTests-942968040 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:56:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-344037561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ed4fd63-e75d-4723-a0a2-b55889873758,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21310f44f5ea46b79b0e448d4218b12e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:56:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:56:56Z,use_quota=True,user_id='8eb6fa222b7241a9b79c5f74cc129bfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:56:55 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-0b1a8290-ee59-4fe7-99f2-3d93c61cd8e6 tempest-ProjectReaderTests-942968040 None] Creating volume 0ed4fd63-e75d-4723-a0a2-b55889873758 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:56:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-0b1a8290-ee59-4fe7-99f2-3d93c61cd8e6 tempest-ProjectReaderTests-942968040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:56:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-0b1a8290-ee59-4fe7-99f2-3d93c61cd8e6 tempest-ProjectReaderTests-942968040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:56:55 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-0b1a8290-ee59-4fe7-99f2-3d93c61cd8e6 tempest-ProjectReaderTests-942968040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:56:55 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-0b1a8290-ee59-4fe7-99f2-3d93c61cd8e6 tempest-ProjectReaderTests-942968040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:56:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-0b1a8290-ee59-4fe7-99f2-3d93c61cd8e6 tempest-ProjectReaderTests-942968040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:56:55 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-0b1a8290-ee59-4fe7-99f2-3d93c61cd8e6 tempest-ProjectReaderTests-942968040 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:56:55 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-0b1a8290-ee59-4fe7-99f2-3d93c61cd8e6 tempest-ProjectReaderTests-942968040 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:56:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0b1a8290-ee59-4fe7-99f2-3d93c61cd8e6 tempest-ProjectReaderTests-942968040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0ed4fd63-e75d-4723-a0a2-b55889873758 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:55 devstack sudo[114475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0ed4fd63-e75d-4723-a0a2-b55889873758 1073741824 Sep 08 06:56:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a61c40b5-9025-4467-a3e5-6abda3d43e72 tempest-VolumesSnapshotListTestJSON-416585296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:56:55 devstack sudo[114475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:56 devstack sudo[114475]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0b1a8290-ee59-4fe7-99f2-3d93c61cd8e6 tempest-ProjectReaderTests-942968040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0ed4fd63-e75d-4723-a0a2-b55889873758 1073741824" returned: 0 in 0.469s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0b1a8290-ee59-4fe7-99f2-3d93c61cd8e6 tempest-ProjectReaderTests-942968040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0ed4fd63-e75d-4723-a0a2-b55889873758 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:56 devstack sudo[114506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0ed4fd63-e75d-4723-a0a2-b55889873758 Sep 08 06:56:56 devstack sudo[114506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:56 devstack sudo[114506]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0b1a8290-ee59-4fe7-99f2-3d93c61cd8e6 tempest-ProjectReaderTests-942968040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0ed4fd63-e75d-4723-a0a2-b55889873758" returned: 0 in 0.255s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:56 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-0b1a8290-ee59-4fe7-99f2-3d93c61cd8e6 tempest-ProjectReaderTests-942968040 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:56:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-0b1a8290-ee59-4fe7-99f2-3d93c61cd8e6 tempest-ProjectReaderTests-942968040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:56:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a61c40b5-9025-4467-a3e5-6abda3d43e72 tempest-VolumesSnapshotListTestJSON-416585296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.732s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:56:56 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-a61c40b5-9025-4467-a3e5-6abda3d43e72 tempest-VolumesSnapshotListTestJSON-416585296 None] Creating offline snapshot df29ab90-68e2-476f-a489-167c17447d73 of volume 12d07197-efbe-4240-b7a7-b5ab4988dab4 {{(pid=87507) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 06:56:56 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0b1a8290-ee59-4fe7-99f2-3d93c61cd8e6 tempest-ProjectReaderTests-942968040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (096a02b7-d479-4ee2-aff2-1fd2822b6511) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ed4fd63-e75d-4723-a0a2-b55889873758', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:56 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0b1a8290-ee59-4fe7-99f2-3d93c61cd8e6 tempest-ProjectReaderTests-942968040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98087d86-4683-4b53-96ea-2753bdaab2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:56 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[166eb6f8-3952-4a27-bbe4-e946f5c3e64c]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:56:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a61c40b5-9025-4467-a3e5-6abda3d43e72 tempest-VolumesSnapshotListTestJSON-416585296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.a1a91cc1-6e4a-4839-8bf5-696dbae62d16 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:56 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-0b1a8290-ee59-4fe7-99f2-3d93c61cd8e6 tempest-ProjectReaderTests-942968040 None] Volume volume-0ed4fd63-e75d-4723-a0a2-b55889873758 (0ed4fd63-e75d-4723-a0a2-b55889873758): created successfully Sep 08 06:56:56 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0b1a8290-ee59-4fe7-99f2-3d93c61cd8e6 tempest-ProjectReaderTests-942968040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98087d86-4683-4b53-96ea-2753bdaab2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:56 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-0b1a8290-ee59-4fe7-99f2-3d93c61cd8e6 tempest-ProjectReaderTests-942968040 None] Flow 'volume_create_manager' (17d0becd-38fc-44dd-a225-422fd4bf31b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:56:56 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-0b1a8290-ee59-4fe7-99f2-3d93c61cd8e6 tempest-ProjectReaderTests-942968040 None] Created volume successfully. Sep 08 06:56:56 devstack sudo[114525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.a1a91cc1-6e4a-4839-8bf5-696dbae62d16 Sep 08 06:56:56 devstack sudo[114525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:57 devstack sudo[114525]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:57 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a61c40b5-9025-4467-a3e5-6abda3d43e72 tempest-VolumesSnapshotListTestJSON-416585296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.a1a91cc1-6e4a-4839-8bf5-696dbae62d16" returned: 0 in 0.436s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:57 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-a61c40b5-9025-4467-a3e5-6abda3d43e72 tempest-VolumesSnapshotListTestJSON-416585296 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12d07197-efbe-4240-b7a7-b5ab4988dab4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 06:56:57 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a61c40b5-9025-4467-a3e5-6abda3d43e72 tempest-VolumesSnapshotListTestJSON-416585296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.a1a91cc1-6e4a-4839-8bf5-696dbae62d16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.df29ab90-68e2-476f-a489-167c17447d73 1G {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:57 devstack sudo[114545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.a1a91cc1-6e4a-4839-8bf5-696dbae62d16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.df29ab90-68e2-476f-a489-167c17447d73 1G Sep 08 06:56:57 devstack sudo[114545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:57 devstack sudo[114545]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:57 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a61c40b5-9025-4467-a3e5-6abda3d43e72 tempest-VolumesSnapshotListTestJSON-416585296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.a1a91cc1-6e4a-4839-8bf5-696dbae62d16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.df29ab90-68e2-476f-a489-167c17447d73 1G" returned: 0 in 0.510s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:57 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a61c40b5-9025-4467-a3e5-6abda3d43e72 tempest-VolumesSnapshotListTestJSON-416585296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.a1a91cc1-6e4a-4839-8bf5-696dbae62d16 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.df29ab90-68e2-476f-a489-167c17447d73 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:57 devstack sudo[114566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.a1a91cc1-6e4a-4839-8bf5-696dbae62d16 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.df29ab90-68e2-476f-a489-167c17447d73 Sep 08 06:56:57 devstack sudo[114566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:57 devstack sudo[114566]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:57 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a61c40b5-9025-4467-a3e5-6abda3d43e72 tempest-VolumesSnapshotListTestJSON-416585296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.a1a91cc1-6e4a-4839-8bf5-696dbae62d16 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.df29ab90-68e2-476f-a489-167c17447d73" returned: 0 in 0.329s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:57 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-a61c40b5-9025-4467-a3e5-6abda3d43e72 tempest-VolumesSnapshotListTestJSON-416585296 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.df29ab90-68e2-476f-a489-167c17447d73 is being set with open permissions: ugo+rw Sep 08 06:56:57 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a61c40b5-9025-4467-a3e5-6abda3d43e72 tempest-VolumesSnapshotListTestJSON-416585296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.df29ab90-68e2-476f-a489-167c17447d73 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:57 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-4c937a73-ad20-4e34-89cd-bcf3f84d72f8 tempest-ProjectReaderTests-942968040 None] Acquiring lock "cinder-0ed4fd63-e75d-4723-a0a2-b55889873758-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:56:57 devstack sudo[114583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.df29ab90-68e2-476f-a489-167c17447d73 Sep 08 06:56:57 devstack sudo[114583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:57 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-4c937a73-ad20-4e34-89cd-bcf3f84d72f8 tempest-ProjectReaderTests-942968040 None] Lock "cinder-0ed4fd63-e75d-4723-a0a2-b55889873758-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:56:57 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-4c937a73-ad20-4e34-89cd-bcf3f84d72f8 tempest-ProjectReaderTests-942968040 None] Acquiring lock "cinder-quobyte-0ed4fd63-e75d-4723-a0a2-b55889873758" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:56:58 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-4c937a73-ad20-4e34-89cd-bcf3f84d72f8 tempest-ProjectReaderTests-942968040 None] Lock "cinder-quobyte-0ed4fd63-e75d-4723-a0a2-b55889873758" acquired by "delete_volume" :: waited 0.026s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:56:58 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1fd177-a305-486b-b60f-2610109b3947]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:56:58 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4c937a73-ad20-4e34-89cd-bcf3f84d72f8 tempest-ProjectReaderTests-942968040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0ed4fd63-e75d-4723-a0a2-b55889873758 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:58 devstack sudo[114588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0ed4fd63-e75d-4723-a0a2-b55889873758 Sep 08 06:56:58 devstack sudo[114588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:58 devstack sudo[114583]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:58 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a61c40b5-9025-4467-a3e5-6abda3d43e72 tempest-VolumesSnapshotListTestJSON-416585296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.df29ab90-68e2-476f-a489-167c17447d73" returned: 0 in 0.312s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:58 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a61c40b5-9025-4467-a3e5-6abda3d43e72 tempest-VolumesSnapshotListTestJSON-416585296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.709s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:56:58 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-a61c40b5-9025-4467-a3e5-6abda3d43e72 tempest-VolumesSnapshotListTestJSON-416585296 None] Create snapshot completed successfully Sep 08 06:56:58 devstack sudo[114588]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:58 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4c937a73-ad20-4e34-89cd-bcf3f84d72f8 tempest-ProjectReaderTests-942968040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0ed4fd63-e75d-4723-a0a2-b55889873758" returned: 0 in 0.405s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:58 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4c937a73-ad20-4e34-89cd-bcf3f84d72f8 tempest-ProjectReaderTests-942968040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0ed4fd63-e75d-4723-a0a2-b55889873758 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:58 devstack sudo[114608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0ed4fd63-e75d-4723-a0a2-b55889873758 Sep 08 06:56:58 devstack sudo[114608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:58 devstack sudo[114608]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:58 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4c937a73-ad20-4e34-89cd-bcf3f84d72f8 tempest-ProjectReaderTests-942968040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0ed4fd63-e75d-4723-a0a2-b55889873758" returned: 0 in 0.260s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:58 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-4c937a73-ad20-4e34-89cd-bcf3f84d72f8 tempest-ProjectReaderTests-942968040 None] Lock "cinder-quobyte-0ed4fd63-e75d-4723-a0a2-b55889873758" released by "delete_volume" :: held 0.720s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:56:58 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-4c937a73-ad20-4e34-89cd-bcf3f84d72f8 tempest-ProjectReaderTests-942968040 None] Created reservations ['5e398efe-d3e1-4a2d-8b0f-fc3cb1dbead9', 'afc3b22c-665a-4614-821c-9ee89b449b59', '7794b4ea-af07-4116-9af2-ca75f71b009a', '82bef906-0657-4284-9ca9-7e9b2eca4505'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:56:58 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4c937a73-ad20-4e34-89cd-bcf3f84d72f8 tempest-ProjectReaderTests-942968040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:56:58 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4c937a73-ad20-4e34-89cd-bcf3f84d72f8 tempest-ProjectReaderTests-942968040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:56:58 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-4c937a73-ad20-4e34-89cd-bcf3f84d72f8 tempest-ProjectReaderTests-942968040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:56:58 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-4c937a73-ad20-4e34-89cd-bcf3f84d72f8 tempest-ProjectReaderTests-942968040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:56:58 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4c937a73-ad20-4e34-89cd-bcf3f84d72f8 tempest-ProjectReaderTests-942968040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:56:58 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4c937a73-ad20-4e34-89cd-bcf3f84d72f8 tempest-ProjectReaderTests-942968040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:58 devstack sudo[114626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:56:58 devstack sudo[114626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:56:59 devstack sudo[114626]: pam_unix(sudo:session): session closed for user root Sep 08 06:56:59 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4c937a73-ad20-4e34-89cd-bcf3f84d72f8 tempest-ProjectReaderTests-942968040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.351s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:56:59 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-4c937a73-ad20-4e34-89cd-bcf3f84d72f8 tempest-ProjectReaderTests-942968040 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:56:59 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-4c937a73-ad20-4e34-89cd-bcf3f84d72f8 tempest-ProjectReaderTests-942968040 None] Deleted volume successfully. Sep 08 06:56:59 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-4c937a73-ad20-4e34-89cd-bcf3f84d72f8 tempest-ProjectReaderTests-942968040 None] Lock "cinder-0ed4fd63-e75d-4723-a0a2-b55889873758-delete_volume" released by "delete_volume" :: held 1.377s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:56:59 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cbae555-c679-4b4b-ae15-472ec0549e21 tempest-ProjectReaderTests-942968040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:56:59 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1cbae555-c679-4b4b-ae15-472ec0549e21 tempest-ProjectReaderTests-942968040 None] Flow 'volume_create_manager' (25cc26ca-d853-4ccf-a345-5a3f93803f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:56:59 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1cbae555-c679-4b4b-ae15-472ec0549e21 tempest-ProjectReaderTests-942968040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cda7ece-3686-4793-93cf-f91d1110c7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:59 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1cbae555-c679-4b4b-ae15-472ec0549e21 tempest-ProjectReaderTests-942968040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cda7ece-3686-4793-93cf-f91d1110c7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-977999743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1553062d-b4a1-4ce0-85de-862ef9ad0a7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21310f44f5ea46b79b0e448d4218b12e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:57:00Z,use_quota=True,user_id='8eb6fa222b7241a9b79c5f74cc129bfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:59 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1cbae555-c679-4b4b-ae15-472ec0549e21 tempest-ProjectReaderTests-942968040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e4d531d-408f-4cef-a461-9c28c9d0b840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:59 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1cbae555-c679-4b4b-ae15-472ec0549e21 tempest-ProjectReaderTests-942968040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e4d531d-408f-4cef-a461-9c28c9d0b840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:59 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1cbae555-c679-4b4b-ae15-472ec0549e21 tempest-ProjectReaderTests-942968040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d22ab9c-e5f4-41da-9bef-d720fb62dbad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:59 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1cbae555-c679-4b4b-ae15-472ec0549e21 tempest-ProjectReaderTests-942968040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d22ab9c-e5f4-41da-9bef-d720fb62dbad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1553062d-b4a1-4ce0-85de-862ef9ad0a7b', 'volume_name': 'volume-1553062d-b4a1-4ce0-85de-862ef9ad0a7b', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:59 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1cbae555-c679-4b4b-ae15-472ec0549e21 tempest-ProjectReaderTests-942968040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e4f6a12-61bc-4438-b363-a06875570385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:59 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1cbae555-c679-4b4b-ae15-472ec0549e21 tempest-ProjectReaderTests-942968040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e4f6a12-61bc-4438-b363-a06875570385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:56:59 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1cbae555-c679-4b4b-ae15-472ec0549e21 tempest-ProjectReaderTests-942968040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a94aa21c-d354-4815-bf22-e77f6291adfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:56:59 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-1cbae555-c679-4b4b-ae15-472ec0549e21 tempest-ProjectReaderTests-942968040 None] Volume 1553062d-b4a1-4ce0-85de-862ef9ad0a7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1553062d-b4a1-4ce0-85de-862ef9ad0a7b', 'volume_size': 1} Sep 08 06:56:59 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-1cbae555-c679-4b4b-ae15-472ec0549e21 tempest-ProjectReaderTests-942968040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:56:59 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-1cbae555-c679-4b4b-ae15-472ec0549e21 tempest-ProjectReaderTests-942968040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:56:59 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-1cbae555-c679-4b4b-ae15-472ec0549e21 tempest-ProjectReaderTests-942968040 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-977999743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1553062d-b4a1-4ce0-85de-862ef9ad0a7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21310f44f5ea46b79b0e448d4218b12e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:57:00Z,use_quota=True,user_id='8eb6fa222b7241a9b79c5f74cc129bfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:56:59 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-1cbae555-c679-4b4b-ae15-472ec0549e21 tempest-ProjectReaderTests-942968040 None] Creating volume 1553062d-b4a1-4ce0-85de-862ef9ad0a7b {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:56:59 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-1cbae555-c679-4b4b-ae15-472ec0549e21 tempest-ProjectReaderTests-942968040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:56:59 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-1cbae555-c679-4b4b-ae15-472ec0549e21 tempest-ProjectReaderTests-942968040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:56:59 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-1cbae555-c679-4b4b-ae15-472ec0549e21 tempest-ProjectReaderTests-942968040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:56:59 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-1cbae555-c679-4b4b-ae15-472ec0549e21 tempest-ProjectReaderTests-942968040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:56:59 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-1cbae555-c679-4b4b-ae15-472ec0549e21 tempest-ProjectReaderTests-942968040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:56:59 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-1cbae555-c679-4b4b-ae15-472ec0549e21 tempest-ProjectReaderTests-942968040 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:56:59 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-1cbae555-c679-4b4b-ae15-472ec0549e21 tempest-ProjectReaderTests-942968040 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:56:59 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1cbae555-c679-4b4b-ae15-472ec0549e21 tempest-ProjectReaderTests-942968040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1553062d-b4a1-4ce0-85de-862ef9ad0a7b 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:56:59 devstack sudo[114657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1553062d-b4a1-4ce0-85de-862ef9ad0a7b 1073741824 Sep 08 06:56:59 devstack sudo[114657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:57:00 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-24b3cdea-17a8-465d-81ae-3a493361868a tempest-VolumesSnapshotListTestJSON-416585296 None] Acquiring lock "cinder-df29ab90-68e2-476f-a489-167c17447d73-delete_snapshot" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:57:00 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-24b3cdea-17a8-465d-81ae-3a493361868a tempest-VolumesSnapshotListTestJSON-416585296 None] Lock "cinder-df29ab90-68e2-476f-a489-167c17447d73-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:57:00 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-24b3cdea-17a8-465d-81ae-3a493361868a tempest-VolumesSnapshotListTestJSON-416585296 None] Acquiring lock "cinder-quobyte-12d07197-efbe-4240-b7a7-b5ab4988dab4" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:57:00 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-24b3cdea-17a8-465d-81ae-3a493361868a tempest-VolumesSnapshotListTestJSON-416585296 None] Lock "cinder-quobyte-12d07197-efbe-4240-b7a7-b5ab4988dab4" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:57:00 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-24b3cdea-17a8-465d-81ae-3a493361868a tempest-VolumesSnapshotListTestJSON-416585296 None] Acquiring lock "cinder-quobyte-df29ab90-68e2-476f-a489-167c17447d73" by "_delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:57:00 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-24b3cdea-17a8-465d-81ae-3a493361868a tempest-VolumesSnapshotListTestJSON-416585296 None] Lock "cinder-quobyte-df29ab90-68e2-476f-a489-167c17447d73" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:57:00 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-24b3cdea-17a8-465d-81ae-3a493361868a tempest-VolumesSnapshotListTestJSON-416585296 None] Deleting offline snapshot df29ab90-68e2-476f-a489-167c17447d73 of volume 12d07197-efbe-4240-b7a7-b5ab4988dab4 {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 06:57:00 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-24b3cdea-17a8-465d-81ae-3a493361868a tempest-VolumesSnapshotListTestJSON-416585296 None] snapshot_file for this snap is: volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.df29ab90-68e2-476f-a489-167c17447d73 {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 06:57:00 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8bcd315-449e-49f5-b6d6-bcdac992b2fd]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:57:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-24b3cdea-17a8-465d-81ae-3a493361868a tempest-VolumesSnapshotListTestJSON-416585296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.df29ab90-68e2-476f-a489-167c17447d73 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:57:00 devstack sudo[114677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.df29ab90-68e2-476f-a489-167c17447d73 Sep 08 06:57:00 devstack sudo[114677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:57:00 devstack sudo[114657]: pam_unix(sudo:session): session closed for user root Sep 08 06:57:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1cbae555-c679-4b4b-ae15-472ec0549e21 tempest-ProjectReaderTests-942968040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1553062d-b4a1-4ce0-85de-862ef9ad0a7b 1073741824" returned: 0 in 0.587s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:57:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1cbae555-c679-4b4b-ae15-472ec0549e21 tempest-ProjectReaderTests-942968040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1553062d-b4a1-4ce0-85de-862ef9ad0a7b {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:57:00 devstack sudo[114683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1553062d-b4a1-4ce0-85de-862ef9ad0a7b Sep 08 06:57:00 devstack sudo[114683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:57:00 devstack sudo[114683]: pam_unix(sudo:session): session closed for user root Sep 08 06:57:00 devstack sudo[114677]: pam_unix(sudo:session): session closed for user root Sep 08 06:57:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-24b3cdea-17a8-465d-81ae-3a493361868a tempest-VolumesSnapshotListTestJSON-416585296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.df29ab90-68e2-476f-a489-167c17447d73" returned: 0 in 0.438s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:57:00 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-24b3cdea-17a8-465d-81ae-3a493361868a tempest-VolumesSnapshotListTestJSON-416585296 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12d07197-efbe-4240-b7a7-b5ab4988dab4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 06:57:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1cbae555-c679-4b4b-ae15-472ec0549e21 tempest-ProjectReaderTests-942968040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1553062d-b4a1-4ce0-85de-862ef9ad0a7b" returned: 0 in 0.292s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:57:00 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-1cbae555-c679-4b4b-ae15-472ec0549e21 tempest-ProjectReaderTests-942968040 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:57:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-1cbae555-c679-4b4b-ae15-472ec0549e21 tempest-ProjectReaderTests-942968040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:57:00 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[10bb898c-4aa0-4d4f-97b3-a1c1f441ce1d]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:57:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-24b3cdea-17a8-465d-81ae-3a493361868a tempest-VolumesSnapshotListTestJSON-416585296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.a1a91cc1-6e4a-4839-8bf5-696dbae62d16 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:57:00 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1cbae555-c679-4b4b-ae15-472ec0549e21 tempest-ProjectReaderTests-942968040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a94aa21c-d354-4815-bf22-e77f6291adfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1553062d-b4a1-4ce0-85de-862ef9ad0a7b', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:57:00 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1cbae555-c679-4b4b-ae15-472ec0549e21 tempest-ProjectReaderTests-942968040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8884bcb0-4d5e-4f5c-b53a-27ee59c81dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:57:00 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-1cbae555-c679-4b4b-ae15-472ec0549e21 tempest-ProjectReaderTests-942968040 None] Volume volume-1553062d-b4a1-4ce0-85de-862ef9ad0a7b (1553062d-b4a1-4ce0-85de-862ef9ad0a7b): created successfully Sep 08 06:57:00 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1cbae555-c679-4b4b-ae15-472ec0549e21 tempest-ProjectReaderTests-942968040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8884bcb0-4d5e-4f5c-b53a-27ee59c81dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:57:00 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1cbae555-c679-4b4b-ae15-472ec0549e21 tempest-ProjectReaderTests-942968040 None] Flow 'volume_create_manager' (25cc26ca-d853-4ccf-a345-5a3f93803f62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:57:00 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-1cbae555-c679-4b4b-ae15-472ec0549e21 tempest-ProjectReaderTests-942968040 None] Created volume successfully. Sep 08 06:57:00 devstack sudo[114698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.a1a91cc1-6e4a-4839-8bf5-696dbae62d16 Sep 08 06:57:00 devstack sudo[114698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:57:00 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ced175f-548c-43a0-a799-cda7c70f6b6d tempest-TestStampPattern-1549278103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:57:01 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4ced175f-548c-43a0-a799-cda7c70f6b6d tempest-TestStampPattern-1549278103 None] Flow 'volume_create_manager' (fc17ec6b-448c-4620-937a-09eec0f12c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:57:01 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4ced175f-548c-43a0-a799-cda7c70f6b6d tempest-TestStampPattern-1549278103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b22f76a-1265-4e85-9fe3-4598eb11d14b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:57:01 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4ced175f-548c-43a0-a799-cda7c70f6b6d tempest-TestStampPattern-1549278103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b22f76a-1265-4e85-9fe3-4598eb11d14b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-11254627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f684664-1b04-419e-a213-2d5d565b04f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94827773acae4284bedaaef0f1c0d07d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=992b32f6-4a2c-43f4-96d1-2bfdaa469280,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:57:01Z,use_quota=True,user_id='17201e1f09684cd29b5e0a5fdc65a3f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:57:01 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4ced175f-548c-43a0-a799-cda7c70f6b6d tempest-TestStampPattern-1549278103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98bb27c1-32d5-462b-bf2a-714368fd14ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:57:01 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4ced175f-548c-43a0-a799-cda7c70f6b6d tempest-TestStampPattern-1549278103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98bb27c1-32d5-462b-bf2a-714368fd14ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:57:01 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4ced175f-548c-43a0-a799-cda7c70f6b6d tempest-TestStampPattern-1549278103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d39e6a3b-8ce2-4ab7-bcaf-78b3daac5d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:57:01 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4ced175f-548c-43a0-a799-cda7c70f6b6d tempest-TestStampPattern-1549278103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d39e6a3b-8ce2-4ab7-bcaf-78b3daac5d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7f684664-1b04-419e-a213-2d5d565b04f2', 'volume_name': 'volume-7f684664-1b04-419e-a213-2d5d565b04f2', 'volume_size': 1, 'snapshot_id': '992b32f6-4a2c-43f4-96d1-2bfdaa469280'}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:57:01 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4ced175f-548c-43a0-a799-cda7c70f6b6d tempest-TestStampPattern-1549278103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d1338a1-f9cd-4577-a5fc-b1f9f24f90ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:57:01 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4ced175f-548c-43a0-a799-cda7c70f6b6d tempest-TestStampPattern-1549278103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d1338a1-f9cd-4577-a5fc-b1f9f24f90ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:57:01 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4ced175f-548c-43a0-a799-cda7c70f6b6d tempest-TestStampPattern-1549278103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09fe1bdf-aeb2-4d86-82df-0bd3deff8457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:57:01 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-4ced175f-548c-43a0-a799-cda7c70f6b6d tempest-TestStampPattern-1549278103 None] Volume 7f684664-1b04-419e-a213-2d5d565b04f2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7f684664-1b04-419e-a213-2d5d565b04f2', 'volume_size': 1, 'snapshot_id': '992b32f6-4a2c-43f4-96d1-2bfdaa469280'} Sep 08 06:57:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4ced175f-548c-43a0-a799-cda7c70f6b6d tempest-TestStampPattern-1549278103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:57:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4ced175f-548c-43a0-a799-cda7c70f6b6d tempest-TestStampPattern-1549278103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:57:01 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-4ced175f-548c-43a0-a799-cda7c70f6b6d tempest-TestStampPattern-1549278103 None] Acquiring lock "cinder-quobyte-992b32f6-4a2c-43f4-96d1-2bfdaa469280-7f684664-1b04-419e-a213-2d5d565b04f2" by "_create_volume_from_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:57:01 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-4ced175f-548c-43a0-a799-cda7c70f6b6d tempest-TestStampPattern-1549278103 None] Lock "cinder-quobyte-992b32f6-4a2c-43f4-96d1-2bfdaa469280-7f684664-1b04-419e-a213-2d5d565b04f2" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:57:01 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-4ced175f-548c-43a0-a799-cda7c70f6b6d tempest-TestStampPattern-1549278103 None] Creating volume 7f684664-1b04-419e-a213-2d5d565b04f2 from snapshot 992b32f6-4a2c-43f4-96d1-2bfdaa469280 {{(pid=87507) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 08 06:57:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4ced175f-548c-43a0-a799-cda7c70f6b6d tempest-TestStampPattern-1549278103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:57:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4ced175f-548c-43a0-a799-cda7c70f6b6d tempest-TestStampPattern-1549278103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:57:01 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-4ced175f-548c-43a0-a799-cda7c70f6b6d tempest-TestStampPattern-1549278103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:57:01 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-4ced175f-548c-43a0-a799-cda7c70f6b6d tempest-TestStampPattern-1549278103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:57:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4ced175f-548c-43a0-a799-cda7c70f6b6d tempest-TestStampPattern-1549278103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:57:01 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-4ced175f-548c-43a0-a799-cda7c70f6b6d tempest-TestStampPattern-1549278103 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:57:01 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-4ced175f-548c-43a0-a799-cda7c70f6b6d tempest-TestStampPattern-1549278103 None] Acquiring lock "cinder-quobyte-7f684664-1b04-419e-a213-2d5d565b04f2" by "_copy_volume_from_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:57:01 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-4ced175f-548c-43a0-a799-cda7c70f6b6d tempest-TestStampPattern-1549278103 None] Lock "cinder-quobyte-7f684664-1b04-419e-a213-2d5d565b04f2" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:57:01 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-4ced175f-548c-43a0-a799-cda7c70f6b6d tempest-TestStampPattern-1549278103 None] snapshot: 992b32f6-4a2c-43f4-96d1-2bfdaa469280, volume: 7f684664-1b04-419e-a213-2d5d565b04f2, {{(pid=87507) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 08 06:57:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4ced175f-548c-43a0-a799-cda7c70f6b6d tempest-TestStampPattern-1549278103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:57:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4ced175f-548c-43a0-a799-cda7c70f6b6d tempest-TestStampPattern-1549278103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:57:01 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-4ced175f-548c-43a0-a799-cda7c70f6b6d tempest-TestStampPattern-1549278103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:57:01 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-4ced175f-548c-43a0-a799-cda7c70f6b6d tempest-TestStampPattern-1549278103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:57:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4ced175f-548c-43a0-a799-cda7c70f6b6d tempest-TestStampPattern-1549278103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:57:01 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32ba439-031e-4e04-b19d-0809ac48d7a1]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:57:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4ced175f-548c-43a0-a799-cda7c70f6b6d tempest-TestStampPattern-1549278103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d59d0b6e-b8f7-4d08-aff1-01260306dacb.992b32f6-4a2c-43f4-96d1-2bfdaa469280 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:57:01 devstack sudo[114698]: pam_unix(sudo:session): session closed for user root Sep 08 06:57:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-24b3cdea-17a8-465d-81ae-3a493361868a tempest-VolumesSnapshotListTestJSON-416585296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.a1a91cc1-6e4a-4839-8bf5-696dbae62d16" returned: 0 in 0.433s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:57:01 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-24b3cdea-17a8-465d-81ae-3a493361868a tempest-VolumesSnapshotListTestJSON-416585296 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12d07197-efbe-4240-b7a7-b5ab4988dab4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 06:57:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-24b3cdea-17a8-465d-81ae-3a493361868a tempest-VolumesSnapshotListTestJSON-416585296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.df29ab90-68e2-476f-a489-167c17447d73 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:57:01 devstack sudo[114720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.df29ab90-68e2-476f-a489-167c17447d73 Sep 08 06:57:01 devstack sudo[114720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:57:01 devstack sudo[114716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d59d0b6e-b8f7-4d08-aff1-01260306dacb.992b32f6-4a2c-43f4-96d1-2bfdaa469280 Sep 08 06:57:01 devstack sudo[114716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:57:01 devstack sudo[114716]: pam_unix(sudo:session): session closed for user root Sep 08 06:57:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4ced175f-548c-43a0-a799-cda7c70f6b6d tempest-TestStampPattern-1549278103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d59d0b6e-b8f7-4d08-aff1-01260306dacb.992b32f6-4a2c-43f4-96d1-2bfdaa469280" returned: 0 in 0.409s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:57:01 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-4ced175f-548c-43a0-a799-cda7c70f6b6d tempest-TestStampPattern-1549278103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d59d0b6e-b8f7-4d08-aff1-01260306dacb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 06:57:01 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6800214-637a-4a90-814d-325e89bcb286]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:57:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4ced175f-548c-43a0-a799-cda7c70f6b6d tempest-TestStampPattern-1549278103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d59d0b6e-b8f7-4d08-aff1-01260306dacb {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:57:01 devstack sudo[114720]: pam_unix(sudo:session): session closed for user root Sep 08 06:57:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-24b3cdea-17a8-465d-81ae-3a493361868a tempest-VolumesSnapshotListTestJSON-416585296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.df29ab90-68e2-476f-a489-167c17447d73" returned: 0 in 0.491s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:57:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-24b3cdea-17a8-465d-81ae-3a493361868a tempest-VolumesSnapshotListTestJSON-416585296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.df29ab90-68e2-476f-a489-167c17447d73 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:57:01 devstack sudo[114742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d59d0b6e-b8f7-4d08-aff1-01260306dacb Sep 08 06:57:01 devstack sudo[114742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:57:01 devstack sudo[114746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.df29ab90-68e2-476f-a489-167c17447d73 Sep 08 06:57:01 devstack sudo[114746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:57:01 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-09764f6c-0782-45f6-a16c-36c6344b1ff8 tempest-ProjectReaderTests-942968040 None] Acquiring lock "cinder-1553062d-b4a1-4ce0-85de-862ef9ad0a7b-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:57:01 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-09764f6c-0782-45f6-a16c-36c6344b1ff8 tempest-ProjectReaderTests-942968040 None] Lock "cinder-1553062d-b4a1-4ce0-85de-862ef9ad0a7b-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:57:02 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-09764f6c-0782-45f6-a16c-36c6344b1ff8 tempest-ProjectReaderTests-942968040 None] Acquiring lock "cinder-quobyte-1553062d-b4a1-4ce0-85de-862ef9ad0a7b" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:57:02 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-09764f6c-0782-45f6-a16c-36c6344b1ff8 tempest-ProjectReaderTests-942968040 None] Lock "cinder-quobyte-1553062d-b4a1-4ce0-85de-862ef9ad0a7b" acquired by "delete_volume" :: waited 0.038s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:57:02 devstack sudo[114746]: pam_unix(sudo:session): session closed for user root Sep 08 06:57:02 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[72eab7cb-9740-4e7c-a7fb-af3c359b2559]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:57:02 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-09764f6c-0782-45f6-a16c-36c6344b1ff8 tempest-ProjectReaderTests-942968040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1553062d-b4a1-4ce0-85de-862ef9ad0a7b {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:57:02 devstack sudo[114742]: pam_unix(sudo:session): session closed for user root Sep 08 06:57:02 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-24b3cdea-17a8-465d-81ae-3a493361868a tempest-VolumesSnapshotListTestJSON-416585296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.df29ab90-68e2-476f-a489-167c17447d73" returned: 0 in 0.452s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:57:02 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4ced175f-548c-43a0-a799-cda7c70f6b6d tempest-TestStampPattern-1549278103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d59d0b6e-b8f7-4d08-aff1-01260306dacb" returned: 0 in 0.587s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:57:02 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-4ced175f-548c-43a0-a799-cda7c70f6b6d tempest-TestStampPattern-1549278103 None] will copy from snapshot at /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d59d0b6e-b8f7-4d08-aff1-01260306dacb {{(pid=87507) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 08 06:57:02 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-4ced175f-548c-43a0-a799-cda7c70f6b6d tempest-TestStampPattern-1549278103 None] Creating direct copy from snapshot {{(pid=87507) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 08 06:57:02 devstack cinder-volume[87507]: DEBUG cinder.utils [None req-4ced175f-548c-43a0-a799-cda7c70f6b6d tempest-TestStampPattern-1549278103 None] Path /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7f684664-1b04-419e-a213-2d5d565b04f2 not found in is_blk_device check {{(pid=87507) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 08 06:57:02 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4ced175f-548c-43a0-a799-cda7c70f6b6d tempest-TestStampPattern-1549278103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d59d0b6e-b8f7-4d08-aff1-01260306dacb /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7f684664-1b04-419e-a213-2d5d565b04f2 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:57:02 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-24b3cdea-17a8-465d-81ae-3a493361868a tempest-VolumesSnapshotListTestJSON-416585296 None] Lock "cinder-quobyte-df29ab90-68e2-476f-a489-167c17447d73" released by "_delete_snapshot" :: held 1.974s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:57:02 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-24b3cdea-17a8-465d-81ae-3a493361868a tempest-VolumesSnapshotListTestJSON-416585296 None] Lock "cinder-quobyte-12d07197-efbe-4240-b7a7-b5ab4988dab4" released by "delete_snapshot" :: held 2.008s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:57:02 devstack sudo[114772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d59d0b6e-b8f7-4d08-aff1-01260306dacb /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7f684664-1b04-419e-a213-2d5d565b04f2 Sep 08 06:57:02 devstack sudo[114772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:57:02 devstack sudo[114768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1553062d-b4a1-4ce0-85de-862ef9ad0a7b Sep 08 06:57:02 devstack sudo[114768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:57:02 devstack cinder-volume[87507]: DEBUG dbcounter [-] [87507] Writing DB stats cinder:UPDATE=187,cinder:SELECT=154,cinder:DELETE=18,cinder:INSERT=48 {{(pid=87507) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 06:57:02 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-24b3cdea-17a8-465d-81ae-3a493361868a tempest-VolumesSnapshotListTestJSON-416585296 None] Created reservations ['d466b0a0-e55d-471d-a035-b4c2a25fffe5', '3e46f655-35e9-4cea-8ffa-68e204476207', '8b5a7549-6319-4b73-afb7-77598b3aabb7', 'd2d150fe-ca6f-4713-a3e7-7a0f1e07b0e9'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:57:02 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-24b3cdea-17a8-465d-81ae-3a493361868a tempest-VolumesSnapshotListTestJSON-416585296 None] Delete snapshot completed successfully. Sep 08 06:57:02 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-24b3cdea-17a8-465d-81ae-3a493361868a tempest-VolumesSnapshotListTestJSON-416585296 None] Lock "cinder-df29ab90-68e2-476f-a489-167c17447d73-delete_snapshot" released by "delete_snapshot" :: held 2.244s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:57:02 devstack sudo[114768]: pam_unix(sudo:session): session closed for user root Sep 08 06:57:02 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-09764f6c-0782-45f6-a16c-36c6344b1ff8 tempest-ProjectReaderTests-942968040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1553062d-b4a1-4ce0-85de-862ef9ad0a7b" returned: 0 in 0.442s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:57:02 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-09764f6c-0782-45f6-a16c-36c6344b1ff8 tempest-ProjectReaderTests-942968040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1553062d-b4a1-4ce0-85de-862ef9ad0a7b {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:57:02 devstack sudo[114791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1553062d-b4a1-4ce0-85de-862ef9ad0a7b Sep 08 06:57:02 devstack sudo[114791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:57:02 devstack sudo[114791]: pam_unix(sudo:session): session closed for user root Sep 08 06:57:02 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-09764f6c-0782-45f6-a16c-36c6344b1ff8 tempest-ProjectReaderTests-942968040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1553062d-b4a1-4ce0-85de-862ef9ad0a7b" returned: 0 in 0.346s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:57:02 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-09764f6c-0782-45f6-a16c-36c6344b1ff8 tempest-ProjectReaderTests-942968040 None] Lock "cinder-quobyte-1553062d-b4a1-4ce0-85de-862ef9ad0a7b" released by "delete_volume" :: held 0.882s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:57:03 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-09764f6c-0782-45f6-a16c-36c6344b1ff8 tempest-ProjectReaderTests-942968040 None] Created reservations ['fcd5c022-5c0b-4440-98a7-e1eeed465370', '439990da-5f91-4a3f-99ea-2c9b8111e9d6', '26bfd38e-2fd1-4724-a0bc-26d7e12f74c6', '8a4b17ad-83e2-4276-ad1b-a039f3ac338b'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:57:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-09764f6c-0782-45f6-a16c-36c6344b1ff8 tempest-ProjectReaderTests-942968040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:57:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-09764f6c-0782-45f6-a16c-36c6344b1ff8 tempest-ProjectReaderTests-942968040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:57:03 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-09764f6c-0782-45f6-a16c-36c6344b1ff8 tempest-ProjectReaderTests-942968040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:57:03 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-09764f6c-0782-45f6-a16c-36c6344b1ff8 tempest-ProjectReaderTests-942968040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:57:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-09764f6c-0782-45f6-a16c-36c6344b1ff8 tempest-ProjectReaderTests-942968040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:57:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-09764f6c-0782-45f6-a16c-36c6344b1ff8 tempest-ProjectReaderTests-942968040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:57:03 devstack sudo[114827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:57:03 devstack sudo[114827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:57:03 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-a539d4a9-f1ef-42be-a53b-fdf57568a55a tempest-VolumesSnapshotListTestJSON-416585296 None] Acquiring lock "cinder-a1a91cc1-6e4a-4839-8bf5-696dbae62d16-delete_snapshot" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:57:03 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-a539d4a9-f1ef-42be-a53b-fdf57568a55a tempest-VolumesSnapshotListTestJSON-416585296 None] Lock "cinder-a1a91cc1-6e4a-4839-8bf5-696dbae62d16-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:57:03 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-a539d4a9-f1ef-42be-a53b-fdf57568a55a tempest-VolumesSnapshotListTestJSON-416585296 None] Acquiring lock "cinder-quobyte-12d07197-efbe-4240-b7a7-b5ab4988dab4" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:57:03 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-a539d4a9-f1ef-42be-a53b-fdf57568a55a tempest-VolumesSnapshotListTestJSON-416585296 None] Lock "cinder-quobyte-12d07197-efbe-4240-b7a7-b5ab4988dab4" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:57:03 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-a539d4a9-f1ef-42be-a53b-fdf57568a55a tempest-VolumesSnapshotListTestJSON-416585296 None] Acquiring lock "cinder-quobyte-a1a91cc1-6e4a-4839-8bf5-696dbae62d16" by "_delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:57:03 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-a539d4a9-f1ef-42be-a53b-fdf57568a55a tempest-VolumesSnapshotListTestJSON-416585296 None] Lock "cinder-quobyte-a1a91cc1-6e4a-4839-8bf5-696dbae62d16" acquired by "_delete_snapshot" :: waited 0.052s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:57:03 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-a539d4a9-f1ef-42be-a53b-fdf57568a55a tempest-VolumesSnapshotListTestJSON-416585296 None] Deleting offline snapshot a1a91cc1-6e4a-4839-8bf5-696dbae62d16 of volume 12d07197-efbe-4240-b7a7-b5ab4988dab4 {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 06:57:03 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-a539d4a9-f1ef-42be-a53b-fdf57568a55a tempest-VolumesSnapshotListTestJSON-416585296 None] snapshot_file for this snap is: volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.a1a91cc1-6e4a-4839-8bf5-696dbae62d16 {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 06:57:03 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b2099c-eab5-4cb0-b166-05450c29cad9]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:57:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a539d4a9-f1ef-42be-a53b-fdf57568a55a tempest-VolumesSnapshotListTestJSON-416585296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.a1a91cc1-6e4a-4839-8bf5-696dbae62d16 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:57:03 devstack sudo[114827]: pam_unix(sudo:session): session closed for user root Sep 08 06:57:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-09764f6c-0782-45f6-a16c-36c6344b1ff8 tempest-ProjectReaderTests-942968040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.554s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:57:03 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-09764f6c-0782-45f6-a16c-36c6344b1ff8 tempest-ProjectReaderTests-942968040 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:57:04 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-09764f6c-0782-45f6-a16c-36c6344b1ff8 tempest-ProjectReaderTests-942968040 None] Deleted volume successfully. Sep 08 06:57:04 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-09764f6c-0782-45f6-a16c-36c6344b1ff8 tempest-ProjectReaderTests-942968040 None] Lock "cinder-1553062d-b4a1-4ce0-85de-862ef9ad0a7b-delete_volume" released by "delete_volume" :: held 2.151s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:57:04 devstack sudo[114842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.a1a91cc1-6e4a-4839-8bf5-696dbae62d16 Sep 08 06:57:04 devstack sudo[114842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:57:04 devstack sudo[114842]: pam_unix(sudo:session): session closed for user root Sep 08 06:57:04 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a539d4a9-f1ef-42be-a53b-fdf57568a55a tempest-VolumesSnapshotListTestJSON-416585296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.a1a91cc1-6e4a-4839-8bf5-696dbae62d16" returned: 0 in 0.873s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:57:04 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-a539d4a9-f1ef-42be-a53b-fdf57568a55a tempest-VolumesSnapshotListTestJSON-416585296 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12d07197-efbe-4240-b7a7-b5ab4988dab4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 06:57:04 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4101f2bb-2c55-4e17-8448-df0b15ba07cb]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:57:04 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a539d4a9-f1ef-42be-a53b-fdf57568a55a tempest-VolumesSnapshotListTestJSON-416585296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.0b7f84d3-eb6a-4ca7-8f2d-6af47a0579ad {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:57:05 devstack sudo[114877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.0b7f84d3-eb6a-4ca7-8f2d-6af47a0579ad Sep 08 06:57:05 devstack sudo[114877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:57:05 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fbc0d18-1d9a-42c1-8617-2b92f0af6cbf tempest-ProjectReaderTests-942968040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:57:05 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1fbc0d18-1d9a-42c1-8617-2b92f0af6cbf tempest-ProjectReaderTests-942968040 None] Flow 'volume_create_manager' (f72f49e1-a0c2-4267-813d-8fd62b22a590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:57:05 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1fbc0d18-1d9a-42c1-8617-2b92f0af6cbf tempest-ProjectReaderTests-942968040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af6dd980-a550-4758-b5d9-1c6167560277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:57:05 devstack sudo[114877]: pam_unix(sudo:session): session closed for user root Sep 08 06:57:05 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1fbc0d18-1d9a-42c1-8617-2b92f0af6cbf tempest-ProjectReaderTests-942968040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af6dd980-a550-4758-b5d9-1c6167560277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-419423500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4235b96e-2dc5-4d5e-9d90-c1cfc0787003,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21310f44f5ea46b79b0e448d4218b12e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:57:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:57:06Z,use_quota=True,user_id='8eb6fa222b7241a9b79c5f74cc129bfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:57:05 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1fbc0d18-1d9a-42c1-8617-2b92f0af6cbf tempest-ProjectReaderTests-942968040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fbc4eca-e356-4494-83e7-baa7b48bbd18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:57:05 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1fbc0d18-1d9a-42c1-8617-2b92f0af6cbf tempest-ProjectReaderTests-942968040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fbc4eca-e356-4494-83e7-baa7b48bbd18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:57:05 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1fbc0d18-1d9a-42c1-8617-2b92f0af6cbf tempest-ProjectReaderTests-942968040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51ca4067-f814-4ccf-9c23-1a6161c3fc6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:57:05 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1fbc0d18-1d9a-42c1-8617-2b92f0af6cbf tempest-ProjectReaderTests-942968040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51ca4067-f814-4ccf-9c23-1a6161c3fc6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4235b96e-2dc5-4d5e-9d90-c1cfc0787003', 'volume_name': 'volume-4235b96e-2dc5-4d5e-9d90-c1cfc0787003', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:57:05 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1fbc0d18-1d9a-42c1-8617-2b92f0af6cbf tempest-ProjectReaderTests-942968040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1588254e-42c6-4c3a-a97f-71be0ccc188c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:57:05 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1fbc0d18-1d9a-42c1-8617-2b92f0af6cbf tempest-ProjectReaderTests-942968040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1588254e-42c6-4c3a-a97f-71be0ccc188c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:57:05 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1fbc0d18-1d9a-42c1-8617-2b92f0af6cbf tempest-ProjectReaderTests-942968040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9abeeb4-ae7c-4101-b9d2-07c2d8614125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:57:05 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-1fbc0d18-1d9a-42c1-8617-2b92f0af6cbf tempest-ProjectReaderTests-942968040 None] Volume 4235b96e-2dc5-4d5e-9d90-c1cfc0787003: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4235b96e-2dc5-4d5e-9d90-c1cfc0787003', 'volume_size': 1} Sep 08 06:57:05 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-1fbc0d18-1d9a-42c1-8617-2b92f0af6cbf tempest-ProjectReaderTests-942968040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:57:06 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a539d4a9-f1ef-42be-a53b-fdf57568a55a tempest-VolumesSnapshotListTestJSON-416585296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.0b7f84d3-eb6a-4ca7-8f2d-6af47a0579ad" returned: 0 in 1.162s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:57:06 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-a539d4a9-f1ef-42be-a53b-fdf57568a55a tempest-VolumesSnapshotListTestJSON-416585296 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12d07197-efbe-4240-b7a7-b5ab4988dab4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 06:57:06 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a539d4a9-f1ef-42be-a53b-fdf57568a55a tempest-VolumesSnapshotListTestJSON-416585296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.a1a91cc1-6e4a-4839-8bf5-696dbae62d16 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:57:06 devstack sudo[114916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.a1a91cc1-6e4a-4839-8bf5-696dbae62d16 Sep 08 06:57:06 devstack sudo[114916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:57:07 devstack sudo[114916]: pam_unix(sudo:session): session closed for user root Sep 08 06:57:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a539d4a9-f1ef-42be-a53b-fdf57568a55a tempest-VolumesSnapshotListTestJSON-416585296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.a1a91cc1-6e4a-4839-8bf5-696dbae62d16" returned: 0 in 1.163s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:57:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a539d4a9-f1ef-42be-a53b-fdf57568a55a tempest-VolumesSnapshotListTestJSON-416585296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.a1a91cc1-6e4a-4839-8bf5-696dbae62d16 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:57:07 devstack sudo[114957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.a1a91cc1-6e4a-4839-8bf5-696dbae62d16 Sep 08 06:57:07 devstack sudo[114957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:57:07 devstack sudo[114957]: pam_unix(sudo:session): session closed for user root Sep 08 06:57:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a539d4a9-f1ef-42be-a53b-fdf57568a55a tempest-VolumesSnapshotListTestJSON-416585296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.a1a91cc1-6e4a-4839-8bf5-696dbae62d16" returned: 0 in 0.830s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:57:08 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-a539d4a9-f1ef-42be-a53b-fdf57568a55a tempest-VolumesSnapshotListTestJSON-416585296 None] Lock "cinder-quobyte-a1a91cc1-6e4a-4839-8bf5-696dbae62d16" released by "_delete_snapshot" :: held 4.380s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:57:08 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-a539d4a9-f1ef-42be-a53b-fdf57568a55a tempest-VolumesSnapshotListTestJSON-416585296 None] Lock "cinder-quobyte-12d07197-efbe-4240-b7a7-b5ab4988dab4" released by "delete_snapshot" :: held 4.447s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:57:08 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-a539d4a9-f1ef-42be-a53b-fdf57568a55a tempest-VolumesSnapshotListTestJSON-416585296 None] Created reservations ['e103c311-e035-44f2-ade0-60a3fd2cc569', 'c48f1560-0969-498a-9561-6ef42f816ea5', '1beacaae-2e26-4705-a990-d1673617895e', '423f8ea6-4af5-4081-8621-491d039fcf11'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:57:08 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-a539d4a9-f1ef-42be-a53b-fdf57568a55a tempest-VolumesSnapshotListTestJSON-416585296 None] Delete snapshot completed successfully. Sep 08 06:57:08 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-a539d4a9-f1ef-42be-a53b-fdf57568a55a tempest-VolumesSnapshotListTestJSON-416585296 None] Lock "cinder-a1a91cc1-6e4a-4839-8bf5-696dbae62d16-delete_snapshot" released by "delete_snapshot" :: held 4.963s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:57:09 devstack sudo[114772]: pam_unix(sudo:session): session closed for user root Sep 08 06:57:09 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-0d3e38db-818a-468f-901c-05345d7c133c tempest-VolumesSnapshotListTestJSON-416585296 None] Acquiring lock "cinder-0b7f84d3-eb6a-4ca7-8f2d-6af47a0579ad-delete_snapshot" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:57:09 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4ced175f-548c-43a0-a799-cda7c70f6b6d tempest-TestStampPattern-1549278103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d59d0b6e-b8f7-4d08-aff1-01260306dacb /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7f684664-1b04-419e-a213-2d5d565b04f2" returned: 0 in 6.999s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:57:09 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-4ced175f-548c-43a0-a799-cda7c70f6b6d tempest-TestStampPattern-1549278103 None] Image conversion details: src /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d59d0b6e-b8f7-4d08-aff1-01260306dacb, size 1024.00 MB, duration 7.00 sec, destination /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7f684664-1b04-419e-a213-2d5d565b04f2 {{(pid=87507) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 06:57:09 devstack cinder-volume[87507]: INFO cinder.image.image_utils [None req-4ced175f-548c-43a0-a799-cda7c70f6b6d tempest-TestStampPattern-1549278103 None] Converted 1024.00 MB image at 146.25 MB/s Sep 08 06:57:09 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-4ced175f-548c-43a0-a799-cda7c70f6b6d tempest-TestStampPattern-1549278103 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7f684664-1b04-419e-a213-2d5d565b04f2 is being set with open permissions: ugo+rw Sep 08 06:57:09 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4ced175f-548c-43a0-a799-cda7c70f6b6d tempest-TestStampPattern-1549278103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7f684664-1b04-419e-a213-2d5d565b04f2 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:57:09 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-0d3e38db-818a-468f-901c-05345d7c133c tempest-VolumesSnapshotListTestJSON-416585296 None] Lock "cinder-0b7f84d3-eb6a-4ca7-8f2d-6af47a0579ad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:57:09 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-0d3e38db-818a-468f-901c-05345d7c133c tempest-VolumesSnapshotListTestJSON-416585296 None] Acquiring lock "cinder-quobyte-12d07197-efbe-4240-b7a7-b5ab4988dab4" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:57:09 devstack sudo[115021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7f684664-1b04-419e-a213-2d5d565b04f2 Sep 08 06:57:09 devstack sudo[115021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:57:09 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-0d3e38db-818a-468f-901c-05345d7c133c tempest-VolumesSnapshotListTestJSON-416585296 None] Lock "cinder-quobyte-12d07197-efbe-4240-b7a7-b5ab4988dab4" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:57:09 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-0d3e38db-818a-468f-901c-05345d7c133c tempest-VolumesSnapshotListTestJSON-416585296 None] Acquiring lock "cinder-quobyte-0b7f84d3-eb6a-4ca7-8f2d-6af47a0579ad" by "_delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:57:09 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-0d3e38db-818a-468f-901c-05345d7c133c tempest-VolumesSnapshotListTestJSON-416585296 None] Lock "cinder-quobyte-0b7f84d3-eb6a-4ca7-8f2d-6af47a0579ad" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:57:09 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-0d3e38db-818a-468f-901c-05345d7c133c tempest-VolumesSnapshotListTestJSON-416585296 None] Deleting offline snapshot 0b7f84d3-eb6a-4ca7-8f2d-6af47a0579ad of volume 12d07197-efbe-4240-b7a7-b5ab4988dab4 {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 06:57:09 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-0d3e38db-818a-468f-901c-05345d7c133c tempest-VolumesSnapshotListTestJSON-416585296 None] snapshot_file for this snap is: volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.0b7f84d3-eb6a-4ca7-8f2d-6af47a0579ad {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 06:57:09 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c18edb2-7f32-4eba-9594-005371cd0675]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:57:09 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0d3e38db-818a-468f-901c-05345d7c133c tempest-VolumesSnapshotListTestJSON-416585296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.0b7f84d3-eb6a-4ca7-8f2d-6af47a0579ad {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:57:09 devstack sudo[115027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.0b7f84d3-eb6a-4ca7-8f2d-6af47a0579ad Sep 08 06:57:09 devstack sudo[115027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:57:09 devstack sudo[115021]: pam_unix(sudo:session): session closed for user root Sep 08 06:57:09 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4ced175f-548c-43a0-a799-cda7c70f6b6d tempest-TestStampPattern-1549278103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7f684664-1b04-419e-a213-2d5d565b04f2" returned: 0 in 0.401s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:57:09 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-4ced175f-548c-43a0-a799-cda7c70f6b6d tempest-TestStampPattern-1549278103 None] Lock "cinder-quobyte-7f684664-1b04-419e-a213-2d5d565b04f2" released by "_copy_volume_from_snapshot" :: held 8.491s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:57:09 devstack cinder-volume[87507]: DEBUG dbcounter [-] [87507] Writing DB stats cinder:SELECT=153,cinder:UPDATE=201,cinder:INSERT=51,cinder:DELETE=18 {{(pid=87507) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 06:57:09 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-4ced175f-548c-43a0-a799-cda7c70f6b6d tempest-TestStampPattern-1549278103 None] Lock "cinder-quobyte-992b32f6-4a2c-43f4-96d1-2bfdaa469280-7f684664-1b04-419e-a213-2d5d565b04f2" released by "_create_volume_from_snapshot" :: held 8.584s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:57:09 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4ced175f-548c-43a0-a799-cda7c70f6b6d tempest-TestStampPattern-1549278103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.609s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:57:09 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-1fbc0d18-1d9a-42c1-8617-2b92f0af6cbf tempest-ProjectReaderTests-942968040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.710s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:57:09 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-1fbc0d18-1d9a-42c1-8617-2b92f0af6cbf tempest-ProjectReaderTests-942968040 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-419423500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4235b96e-2dc5-4d5e-9d90-c1cfc0787003,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21310f44f5ea46b79b0e448d4218b12e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:57:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:57:06Z,use_quota=True,user_id='8eb6fa222b7241a9b79c5f74cc129bfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:57:09 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-1fbc0d18-1d9a-42c1-8617-2b92f0af6cbf tempest-ProjectReaderTests-942968040 None] Creating volume 4235b96e-2dc5-4d5e-9d90-c1cfc0787003 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:57:09 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-1fbc0d18-1d9a-42c1-8617-2b92f0af6cbf tempest-ProjectReaderTests-942968040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:57:09 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-1fbc0d18-1d9a-42c1-8617-2b92f0af6cbf tempest-ProjectReaderTests-942968040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:57:09 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-1fbc0d18-1d9a-42c1-8617-2b92f0af6cbf tempest-ProjectReaderTests-942968040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:57:09 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-1fbc0d18-1d9a-42c1-8617-2b92f0af6cbf tempest-ProjectReaderTests-942968040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:57:09 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-1fbc0d18-1d9a-42c1-8617-2b92f0af6cbf tempest-ProjectReaderTests-942968040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:57:09 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-1fbc0d18-1d9a-42c1-8617-2b92f0af6cbf tempest-ProjectReaderTests-942968040 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:57:09 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-1fbc0d18-1d9a-42c1-8617-2b92f0af6cbf tempest-ProjectReaderTests-942968040 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:57:09 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1fbc0d18-1d9a-42c1-8617-2b92f0af6cbf tempest-ProjectReaderTests-942968040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4235b96e-2dc5-4d5e-9d90-c1cfc0787003 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:57:09 devstack sudo[115041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4235b96e-2dc5-4d5e-9d90-c1cfc0787003 1073741824 Sep 08 06:57:09 devstack sudo[115041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:57:09 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4ced175f-548c-43a0-a799-cda7c70f6b6d tempest-TestStampPattern-1549278103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09fe1bdf-aeb2-4d86-82df-0bd3deff8457) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f684664-1b04-419e-a213-2d5d565b04f2', 'volume_size': 1, 'snapshot_id': '992b32f6-4a2c-43f4-96d1-2bfdaa469280'}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:57:09 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4ced175f-548c-43a0-a799-cda7c70f6b6d tempest-TestStampPattern-1549278103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (978fbdfc-f51f-4546-81c3-31b3c8fef276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:57:09 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-4ced175f-548c-43a0-a799-cda7c70f6b6d tempest-TestStampPattern-1549278103 None] Volume volume-7f684664-1b04-419e-a213-2d5d565b04f2 (7f684664-1b04-419e-a213-2d5d565b04f2): created successfully Sep 08 06:57:09 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4ced175f-548c-43a0-a799-cda7c70f6b6d tempest-TestStampPattern-1549278103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (978fbdfc-f51f-4546-81c3-31b3c8fef276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:57:09 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4ced175f-548c-43a0-a799-cda7c70f6b6d tempest-TestStampPattern-1549278103 None] Flow 'volume_create_manager' (fc17ec6b-448c-4620-937a-09eec0f12c9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:57:09 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-4ced175f-548c-43a0-a799-cda7c70f6b6d tempest-TestStampPattern-1549278103 None] Created volume successfully. Sep 08 06:57:09 devstack sudo[115027]: pam_unix(sudo:session): session closed for user root Sep 08 06:57:09 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0d3e38db-818a-468f-901c-05345d7c133c tempest-VolumesSnapshotListTestJSON-416585296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.0b7f84d3-eb6a-4ca7-8f2d-6af47a0579ad" returned: 0 in 0.493s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:57:09 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-0d3e38db-818a-468f-901c-05345d7c133c tempest-VolumesSnapshotListTestJSON-416585296 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12d07197-efbe-4240-b7a7-b5ab4988dab4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 06:57:09 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[413f4cf9-9155-4146-9113-09bba635b453]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:57:09 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0d3e38db-818a-468f-901c-05345d7c133c tempest-VolumesSnapshotListTestJSON-416585296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:57:10 devstack sudo[115054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4 Sep 08 06:57:10 devstack sudo[115054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:57:10 devstack sudo[115041]: pam_unix(sudo:session): session closed for user root Sep 08 06:57:10 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1fbc0d18-1d9a-42c1-8617-2b92f0af6cbf tempest-ProjectReaderTests-942968040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4235b96e-2dc5-4d5e-9d90-c1cfc0787003 1073741824" returned: 0 in 0.663s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:57:10 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1fbc0d18-1d9a-42c1-8617-2b92f0af6cbf tempest-ProjectReaderTests-942968040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4235b96e-2dc5-4d5e-9d90-c1cfc0787003 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:57:10 devstack sudo[115054]: pam_unix(sudo:session): session closed for user root Sep 08 06:57:10 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0d3e38db-818a-468f-901c-05345d7c133c tempest-VolumesSnapshotListTestJSON-416585296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4" returned: 0 in 0.511s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:57:10 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0d3e38db-818a-468f-901c-05345d7c133c tempest-VolumesSnapshotListTestJSON-416585296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.0b7f84d3-eb6a-4ca7-8f2d-6af47a0579ad {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:57:10 devstack sudo[115090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4235b96e-2dc5-4d5e-9d90-c1cfc0787003 Sep 08 06:57:10 devstack sudo[115090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:57:10 devstack sudo[115093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.0b7f84d3-eb6a-4ca7-8f2d-6af47a0579ad Sep 08 06:57:10 devstack sudo[115093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:57:10 devstack sudo[115090]: pam_unix(sudo:session): session closed for user root Sep 08 06:57:10 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1fbc0d18-1d9a-42c1-8617-2b92f0af6cbf tempest-ProjectReaderTests-942968040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4235b96e-2dc5-4d5e-9d90-c1cfc0787003" returned: 0 in 0.419s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:57:10 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-1fbc0d18-1d9a-42c1-8617-2b92f0af6cbf tempest-ProjectReaderTests-942968040 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:57:10 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-1fbc0d18-1d9a-42c1-8617-2b92f0af6cbf tempest-ProjectReaderTests-942968040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:57:10 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1fbc0d18-1d9a-42c1-8617-2b92f0af6cbf tempest-ProjectReaderTests-942968040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9abeeb4-ae7c-4101-b9d2-07c2d8614125) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4235b96e-2dc5-4d5e-9d90-c1cfc0787003', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:57:10 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1fbc0d18-1d9a-42c1-8617-2b92f0af6cbf tempest-ProjectReaderTests-942968040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c00c829a-71db-4ce8-b647-8f8498d5f6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:57:10 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-1fbc0d18-1d9a-42c1-8617-2b92f0af6cbf tempest-ProjectReaderTests-942968040 None] Volume volume-4235b96e-2dc5-4d5e-9d90-c1cfc0787003 (4235b96e-2dc5-4d5e-9d90-c1cfc0787003): created successfully Sep 08 06:57:10 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1fbc0d18-1d9a-42c1-8617-2b92f0af6cbf tempest-ProjectReaderTests-942968040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c00c829a-71db-4ce8-b647-8f8498d5f6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:57:10 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1fbc0d18-1d9a-42c1-8617-2b92f0af6cbf tempest-ProjectReaderTests-942968040 None] Flow 'volume_create_manager' (f72f49e1-a0c2-4267-813d-8fd62b22a590) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:57:10 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-1fbc0d18-1d9a-42c1-8617-2b92f0af6cbf tempest-ProjectReaderTests-942968040 None] Created volume successfully. Sep 08 06:57:10 devstack sudo[115093]: pam_unix(sudo:session): session closed for user root Sep 08 06:57:10 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0d3e38db-818a-468f-901c-05345d7c133c tempest-VolumesSnapshotListTestJSON-416585296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.0b7f84d3-eb6a-4ca7-8f2d-6af47a0579ad" returned: 0 in 0.550s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:57:10 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0d3e38db-818a-468f-901c-05345d7c133c tempest-VolumesSnapshotListTestJSON-416585296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.0b7f84d3-eb6a-4ca7-8f2d-6af47a0579ad {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:57:11 devstack sudo[115126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.0b7f84d3-eb6a-4ca7-8f2d-6af47a0579ad Sep 08 06:57:11 devstack sudo[115126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:57:11 devstack sudo[115126]: pam_unix(sudo:session): session closed for user root Sep 08 06:57:11 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-81d44eba-4f40-49b8-b7e6-8139721cfb17 tempest-ProjectReaderTests-942968040 None] Acquiring lock "cinder-4235b96e-2dc5-4d5e-9d90-c1cfc0787003-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:57:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0d3e38db-818a-468f-901c-05345d7c133c tempest-VolumesSnapshotListTestJSON-416585296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4.0b7f84d3-eb6a-4ca7-8f2d-6af47a0579ad" returned: 0 in 0.323s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:57:11 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-81d44eba-4f40-49b8-b7e6-8139721cfb17 tempest-ProjectReaderTests-942968040 None] Lock "cinder-4235b96e-2dc5-4d5e-9d90-c1cfc0787003-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:57:11 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-0d3e38db-818a-468f-901c-05345d7c133c tempest-VolumesSnapshotListTestJSON-416585296 None] Lock "cinder-quobyte-0b7f84d3-eb6a-4ca7-8f2d-6af47a0579ad" released by "_delete_snapshot" :: held 2.093s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:57:11 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-0d3e38db-818a-468f-901c-05345d7c133c tempest-VolumesSnapshotListTestJSON-416585296 None] Lock "cinder-quobyte-12d07197-efbe-4240-b7a7-b5ab4988dab4" released by "delete_snapshot" :: held 2.140s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:57:11 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-81d44eba-4f40-49b8-b7e6-8139721cfb17 tempest-ProjectReaderTests-942968040 None] Acquiring lock "cinder-quobyte-4235b96e-2dc5-4d5e-9d90-c1cfc0787003" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:57:11 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-81d44eba-4f40-49b8-b7e6-8139721cfb17 tempest-ProjectReaderTests-942968040 None] Lock "cinder-quobyte-4235b96e-2dc5-4d5e-9d90-c1cfc0787003" acquired by "delete_volume" :: waited 0.049s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:57:11 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a943bd1-a9bc-4d0e-83be-f92f4b9c799a]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:57:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-81d44eba-4f40-49b8-b7e6-8139721cfb17 tempest-ProjectReaderTests-942968040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4235b96e-2dc5-4d5e-9d90-c1cfc0787003 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:57:11 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-0d3e38db-818a-468f-901c-05345d7c133c tempest-VolumesSnapshotListTestJSON-416585296 None] Created reservations ['77bb50e5-3c5d-4b4f-9909-d2ed0e9c29c5', 'c0873be9-1943-47b8-bd1a-ceaadcf952f1', 'dd728780-24d7-4215-92b1-c5f8bb8ab995', '4991f7aa-ea28-4021-a2d1-d1fe008d5ed2'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:57:11 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-0d3e38db-818a-468f-901c-05345d7c133c tempest-VolumesSnapshotListTestJSON-416585296 None] Delete snapshot completed successfully. Sep 08 06:57:11 devstack sudo[115164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4235b96e-2dc5-4d5e-9d90-c1cfc0787003 Sep 08 06:57:11 devstack sudo[115164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:57:11 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-0d3e38db-818a-468f-901c-05345d7c133c tempest-VolumesSnapshotListTestJSON-416585296 None] Lock "cinder-0b7f84d3-eb6a-4ca7-8f2d-6af47a0579ad-delete_snapshot" released by "delete_snapshot" :: held 2.602s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:57:12 devstack sudo[115164]: pam_unix(sudo:session): session closed for user root Sep 08 06:57:12 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-81d44eba-4f40-49b8-b7e6-8139721cfb17 tempest-ProjectReaderTests-942968040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4235b96e-2dc5-4d5e-9d90-c1cfc0787003" returned: 0 in 0.691s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:57:12 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-81d44eba-4f40-49b8-b7e6-8139721cfb17 tempest-ProjectReaderTests-942968040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4235b96e-2dc5-4d5e-9d90-c1cfc0787003 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:57:12 devstack sudo[115214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4235b96e-2dc5-4d5e-9d90-c1cfc0787003 Sep 08 06:57:12 devstack sudo[115214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:57:12 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-77830435-4e38-4368-87bb-888581e3793c tempest-VolumesSnapshotListTestJSON-416585296 None] Acquiring lock "cinder-12d07197-efbe-4240-b7a7-b5ab4988dab4-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:57:12 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-77830435-4e38-4368-87bb-888581e3793c tempest-VolumesSnapshotListTestJSON-416585296 None] Lock "cinder-12d07197-efbe-4240-b7a7-b5ab4988dab4-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:57:12 devstack sudo[115214]: pam_unix(sudo:session): session closed for user root Sep 08 06:57:12 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-81d44eba-4f40-49b8-b7e6-8139721cfb17 tempest-ProjectReaderTests-942968040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4235b96e-2dc5-4d5e-9d90-c1cfc0787003" returned: 0 in 0.353s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:57:12 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-81d44eba-4f40-49b8-b7e6-8139721cfb17 tempest-ProjectReaderTests-942968040 None] Lock "cinder-quobyte-4235b96e-2dc5-4d5e-9d90-c1cfc0787003" released by "delete_volume" :: held 1.123s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:57:12 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-77830435-4e38-4368-87bb-888581e3793c tempest-VolumesSnapshotListTestJSON-416585296 None] Acquiring lock "cinder-quobyte-12d07197-efbe-4240-b7a7-b5ab4988dab4" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:57:12 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-77830435-4e38-4368-87bb-888581e3793c tempest-VolumesSnapshotListTestJSON-416585296 None] Lock "cinder-quobyte-12d07197-efbe-4240-b7a7-b5ab4988dab4" acquired by "delete_volume" :: waited 0.021s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:57:12 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b396cf-3398-49fb-928d-52474dce6f47]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:57:12 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-77830435-4e38-4368-87bb-888581e3793c tempest-VolumesSnapshotListTestJSON-416585296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:57:12 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-81d44eba-4f40-49b8-b7e6-8139721cfb17 tempest-ProjectReaderTests-942968040 None] Created reservations ['dd087e8f-d833-4867-a9f8-304cf8ec6fb6', '3c034e90-01f6-499c-81e6-8b1a3764b0ba', '8b50eb4d-b371-48ea-96f2-2534f63fa375', '34a0bc1b-f8d2-4b45-81a6-8159916e6710'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:57:12 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-81d44eba-4f40-49b8-b7e6-8139721cfb17 tempest-ProjectReaderTests-942968040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:57:12 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-81d44eba-4f40-49b8-b7e6-8139721cfb17 tempest-ProjectReaderTests-942968040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:57:12 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-81d44eba-4f40-49b8-b7e6-8139721cfb17 tempest-ProjectReaderTests-942968040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:57:12 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-81d44eba-4f40-49b8-b7e6-8139721cfb17 tempest-ProjectReaderTests-942968040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:57:12 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-81d44eba-4f40-49b8-b7e6-8139721cfb17 tempest-ProjectReaderTests-942968040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:57:12 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-81d44eba-4f40-49b8-b7e6-8139721cfb17 tempest-ProjectReaderTests-942968040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:57:12 devstack sudo[115233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4 Sep 08 06:57:12 devstack sudo[115233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:57:12 devstack sudo[115238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:57:12 devstack sudo[115238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:57:13 devstack sudo[115238]: pam_unix(sudo:session): session closed for user root Sep 08 06:57:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-81d44eba-4f40-49b8-b7e6-8139721cfb17 tempest-ProjectReaderTests-942968040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.294s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:57:13 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-81d44eba-4f40-49b8-b7e6-8139721cfb17 tempest-ProjectReaderTests-942968040 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:57:13 devstack sudo[115233]: pam_unix(sudo:session): session closed for user root Sep 08 06:57:13 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-81d44eba-4f40-49b8-b7e6-8139721cfb17 tempest-ProjectReaderTests-942968040 None] Deleted volume successfully. Sep 08 06:57:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-77830435-4e38-4368-87bb-888581e3793c tempest-VolumesSnapshotListTestJSON-416585296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4" returned: 0 in 0.450s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:57:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-77830435-4e38-4368-87bb-888581e3793c tempest-VolumesSnapshotListTestJSON-416585296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:57:13 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-81d44eba-4f40-49b8-b7e6-8139721cfb17 tempest-ProjectReaderTests-942968040 None] Lock "cinder-4235b96e-2dc5-4d5e-9d90-c1cfc0787003-delete_volume" released by "delete_volume" :: held 1.931s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:57:13 devstack sudo[115255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4 Sep 08 06:57:13 devstack sudo[115255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:57:13 devstack sudo[115255]: pam_unix(sudo:session): session closed for user root Sep 08 06:57:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-77830435-4e38-4368-87bb-888581e3793c tempest-VolumesSnapshotListTestJSON-416585296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-12d07197-efbe-4240-b7a7-b5ab4988dab4" returned: 0 in 0.422s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:57:13 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-77830435-4e38-4368-87bb-888581e3793c tempest-VolumesSnapshotListTestJSON-416585296 None] Lock "cinder-quobyte-12d07197-efbe-4240-b7a7-b5ab4988dab4" released by "delete_volume" :: held 0.955s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:57:13 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-77830435-4e38-4368-87bb-888581e3793c tempest-VolumesSnapshotListTestJSON-416585296 None] Created reservations ['b32e299f-a45b-475a-898b-36590d8d3769', 'd8236112-ee98-4647-b700-354a8a1b2aed', 'df3f7c25-0616-4724-afd9-507844e6b1fb', '98ca1c7e-4d6e-499e-b409-ae2c60fc422a'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:57:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-77830435-4e38-4368-87bb-888581e3793c tempest-VolumesSnapshotListTestJSON-416585296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:57:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-77830435-4e38-4368-87bb-888581e3793c tempest-VolumesSnapshotListTestJSON-416585296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:57:13 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-77830435-4e38-4368-87bb-888581e3793c tempest-VolumesSnapshotListTestJSON-416585296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:57:13 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-77830435-4e38-4368-87bb-888581e3793c tempest-VolumesSnapshotListTestJSON-416585296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:57:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-77830435-4e38-4368-87bb-888581e3793c tempest-VolumesSnapshotListTestJSON-416585296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:57:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-77830435-4e38-4368-87bb-888581e3793c tempest-VolumesSnapshotListTestJSON-416585296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:57:13 devstack sudo[115278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:57:13 devstack sudo[115278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:57:14 devstack sudo[115278]: pam_unix(sudo:session): session closed for user root Sep 08 06:57:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-77830435-4e38-4368-87bb-888581e3793c tempest-VolumesSnapshotListTestJSON-416585296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.311s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:57:14 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-77830435-4e38-4368-87bb-888581e3793c tempest-VolumesSnapshotListTestJSON-416585296 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:57:14 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-77830435-4e38-4368-87bb-888581e3793c tempest-VolumesSnapshotListTestJSON-416585296 None] Deleted volume successfully. Sep 08 06:57:14 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-77830435-4e38-4368-87bb-888581e3793c tempest-VolumesSnapshotListTestJSON-416585296 None] Lock "cinder-12d07197-efbe-4240-b7a7-b5ab4988dab4-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:57:14 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cd00a28-7440-422b-9a58-910e75b78a39 tempest-ProjectReaderTests-942968040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:57:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2cd00a28-7440-422b-9a58-910e75b78a39 tempest-ProjectReaderTests-942968040 None] Flow 'volume_create_manager' (3ded90a1-fb9b-4c60-86c2-0fa9062d2b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:57:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2cd00a28-7440-422b-9a58-910e75b78a39 tempest-ProjectReaderTests-942968040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed96714f-e03c-434e-970b-dcc974c6b8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:57:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2cd00a28-7440-422b-9a58-910e75b78a39 tempest-ProjectReaderTests-942968040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed96714f-e03c-434e-970b-dcc974c6b8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:57:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1454015338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28d814cb-42f0-4a8b-aa39-daf2d5950d30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21310f44f5ea46b79b0e448d4218b12e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:57:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:57:14Z,use_quota=True,user_id='8eb6fa222b7241a9b79c5f74cc129bfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:57:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2cd00a28-7440-422b-9a58-910e75b78a39 tempest-ProjectReaderTests-942968040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc8d5e7a-5277-4568-9da1-8a0e01322d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:57:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2cd00a28-7440-422b-9a58-910e75b78a39 tempest-ProjectReaderTests-942968040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc8d5e7a-5277-4568-9da1-8a0e01322d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:57:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2cd00a28-7440-422b-9a58-910e75b78a39 tempest-ProjectReaderTests-942968040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef4193a6-4c80-44df-b100-61af9d478e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:57:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2cd00a28-7440-422b-9a58-910e75b78a39 tempest-ProjectReaderTests-942968040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef4193a6-4c80-44df-b100-61af9d478e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28d814cb-42f0-4a8b-aa39-daf2d5950d30', 'volume_name': 'volume-28d814cb-42f0-4a8b-aa39-daf2d5950d30', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:57:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2cd00a28-7440-422b-9a58-910e75b78a39 tempest-ProjectReaderTests-942968040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3c97292-cfb3-4b87-9f49-bb6613ca193f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:57:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2cd00a28-7440-422b-9a58-910e75b78a39 tempest-ProjectReaderTests-942968040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3c97292-cfb3-4b87-9f49-bb6613ca193f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:57:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2cd00a28-7440-422b-9a58-910e75b78a39 tempest-ProjectReaderTests-942968040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48fd6a89-881a-4f9a-82ac-9d167e509ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:57:14 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-2cd00a28-7440-422b-9a58-910e75b78a39 tempest-ProjectReaderTests-942968040 None] Volume 28d814cb-42f0-4a8b-aa39-daf2d5950d30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28d814cb-42f0-4a8b-aa39-daf2d5950d30', 'volume_size': 1} Sep 08 06:57:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-2cd00a28-7440-422b-9a58-910e75b78a39 tempest-ProjectReaderTests-942968040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:57:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-2cd00a28-7440-422b-9a58-910e75b78a39 tempest-ProjectReaderTests-942968040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:57:14 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-2cd00a28-7440-422b-9a58-910e75b78a39 tempest-ProjectReaderTests-942968040 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:57:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1454015338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28d814cb-42f0-4a8b-aa39-daf2d5950d30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21310f44f5ea46b79b0e448d4218b12e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:57:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:57:14Z,use_quota=True,user_id='8eb6fa222b7241a9b79c5f74cc129bfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:57:14 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-2cd00a28-7440-422b-9a58-910e75b78a39 tempest-ProjectReaderTests-942968040 None] Creating volume 28d814cb-42f0-4a8b-aa39-daf2d5950d30 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:57:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-2cd00a28-7440-422b-9a58-910e75b78a39 tempest-ProjectReaderTests-942968040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:57:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-2cd00a28-7440-422b-9a58-910e75b78a39 tempest-ProjectReaderTests-942968040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:57:14 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-2cd00a28-7440-422b-9a58-910e75b78a39 tempest-ProjectReaderTests-942968040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:57:14 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-2cd00a28-7440-422b-9a58-910e75b78a39 tempest-ProjectReaderTests-942968040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:57:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-2cd00a28-7440-422b-9a58-910e75b78a39 tempest-ProjectReaderTests-942968040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:57:14 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-2cd00a28-7440-422b-9a58-910e75b78a39 tempest-ProjectReaderTests-942968040 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:57:14 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-2cd00a28-7440-422b-9a58-910e75b78a39 tempest-ProjectReaderTests-942968040 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:57:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2cd00a28-7440-422b-9a58-910e75b78a39 tempest-ProjectReaderTests-942968040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-28d814cb-42f0-4a8b-aa39-daf2d5950d30 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:57:14 devstack sudo[115297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-28d814cb-42f0-4a8b-aa39-daf2d5950d30 1073741824 Sep 08 06:57:14 devstack sudo[115297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:57:14 devstack sudo[115297]: pam_unix(sudo:session): session closed for user root Sep 08 06:57:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2cd00a28-7440-422b-9a58-910e75b78a39 tempest-ProjectReaderTests-942968040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-28d814cb-42f0-4a8b-aa39-daf2d5950d30 1073741824" returned: 0 in 0.501s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:57:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2cd00a28-7440-422b-9a58-910e75b78a39 tempest-ProjectReaderTests-942968040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-28d814cb-42f0-4a8b-aa39-daf2d5950d30 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:57:15 devstack sudo[115322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-28d814cb-42f0-4a8b-aa39-daf2d5950d30 Sep 08 06:57:15 devstack sudo[115322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:57:15 devstack sudo[115322]: pam_unix(sudo:session): session closed for user root Sep 08 06:57:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2cd00a28-7440-422b-9a58-910e75b78a39 tempest-ProjectReaderTests-942968040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-28d814cb-42f0-4a8b-aa39-daf2d5950d30" returned: 0 in 0.416s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:57:15 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-2cd00a28-7440-422b-9a58-910e75b78a39 tempest-ProjectReaderTests-942968040 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:57:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-2cd00a28-7440-422b-9a58-910e75b78a39 tempest-ProjectReaderTests-942968040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:57:15 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2cd00a28-7440-422b-9a58-910e75b78a39 tempest-ProjectReaderTests-942968040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48fd6a89-881a-4f9a-82ac-9d167e509ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28d814cb-42f0-4a8b-aa39-daf2d5950d30', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:57:15 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2cd00a28-7440-422b-9a58-910e75b78a39 tempest-ProjectReaderTests-942968040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b175b38a-cb4f-463a-ab2c-61e72a0021fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:57:15 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-2cd00a28-7440-422b-9a58-910e75b78a39 tempest-ProjectReaderTests-942968040 None] Volume volume-28d814cb-42f0-4a8b-aa39-daf2d5950d30 (28d814cb-42f0-4a8b-aa39-daf2d5950d30): created successfully Sep 08 06:57:15 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2cd00a28-7440-422b-9a58-910e75b78a39 tempest-ProjectReaderTests-942968040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b175b38a-cb4f-463a-ab2c-61e72a0021fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:57:15 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2cd00a28-7440-422b-9a58-910e75b78a39 tempest-ProjectReaderTests-942968040 None] Flow 'volume_create_manager' (3ded90a1-fb9b-4c60-86c2-0fa9062d2b91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:57:15 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-2cd00a28-7440-422b-9a58-910e75b78a39 tempest-ProjectReaderTests-942968040 None] Created volume successfully. Sep 08 06:57:16 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-f4727363-4b69-4858-bfe6-35b9a2a2cc21 tempest-ProjectReaderTests-942968040 None] Acquiring lock "cinder-28d814cb-42f0-4a8b-aa39-daf2d5950d30-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:57:16 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-f4727363-4b69-4858-bfe6-35b9a2a2cc21 tempest-ProjectReaderTests-942968040 None] Lock "cinder-28d814cb-42f0-4a8b-aa39-daf2d5950d30-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:57:16 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-f4727363-4b69-4858-bfe6-35b9a2a2cc21 tempest-ProjectReaderTests-942968040 None] Acquiring lock "cinder-quobyte-28d814cb-42f0-4a8b-aa39-daf2d5950d30" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:57:16 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-f4727363-4b69-4858-bfe6-35b9a2a2cc21 tempest-ProjectReaderTests-942968040 None] Lock "cinder-quobyte-28d814cb-42f0-4a8b-aa39-daf2d5950d30" acquired by "delete_volume" :: waited 0.016s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:57:16 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e37288-0530-4b7d-bc7f-3d8262d38e49]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:57:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f4727363-4b69-4858-bfe6-35b9a2a2cc21 tempest-ProjectReaderTests-942968040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-28d814cb-42f0-4a8b-aa39-daf2d5950d30 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:57:16 devstack sudo[115377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-28d814cb-42f0-4a8b-aa39-daf2d5950d30 Sep 08 06:57:16 devstack sudo[115377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:57:17 devstack sudo[115377]: pam_unix(sudo:session): session closed for user root Sep 08 06:57:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f4727363-4b69-4858-bfe6-35b9a2a2cc21 tempest-ProjectReaderTests-942968040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-28d814cb-42f0-4a8b-aa39-daf2d5950d30" returned: 0 in 0.651s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:57:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f4727363-4b69-4858-bfe6-35b9a2a2cc21 tempest-ProjectReaderTests-942968040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-28d814cb-42f0-4a8b-aa39-daf2d5950d30 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:57:17 devstack sudo[115413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-28d814cb-42f0-4a8b-aa39-daf2d5950d30 Sep 08 06:57:17 devstack sudo[115413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:57:17 devstack sudo[115413]: pam_unix(sudo:session): session closed for user root Sep 08 06:57:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f4727363-4b69-4858-bfe6-35b9a2a2cc21 tempest-ProjectReaderTests-942968040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-28d814cb-42f0-4a8b-aa39-daf2d5950d30" returned: 0 in 0.403s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:57:17 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-f4727363-4b69-4858-bfe6-35b9a2a2cc21 tempest-ProjectReaderTests-942968040 None] Lock "cinder-quobyte-28d814cb-42f0-4a8b-aa39-daf2d5950d30" released by "delete_volume" :: held 1.131s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:57:17 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-f4727363-4b69-4858-bfe6-35b9a2a2cc21 tempest-ProjectReaderTests-942968040 None] Created reservations ['bf8db51e-2835-4bb3-9893-2e61b1da2e6e', 'c16f598e-92d3-491b-ac9d-cd6c5d470d46', '7ae011dd-a790-43a9-8fd5-e8354b9f61e1', '63670d97-c990-4bdc-84fa-7628c4eb74a3'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:57:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-f4727363-4b69-4858-bfe6-35b9a2a2cc21 tempest-ProjectReaderTests-942968040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:57:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-f4727363-4b69-4858-bfe6-35b9a2a2cc21 tempest-ProjectReaderTests-942968040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:57:17 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-f4727363-4b69-4858-bfe6-35b9a2a2cc21 tempest-ProjectReaderTests-942968040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:57:18 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-f4727363-4b69-4858-bfe6-35b9a2a2cc21 tempest-ProjectReaderTests-942968040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:57:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-f4727363-4b69-4858-bfe6-35b9a2a2cc21 tempest-ProjectReaderTests-942968040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:57:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f4727363-4b69-4858-bfe6-35b9a2a2cc21 tempest-ProjectReaderTests-942968040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:57:18 devstack sudo[115437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:57:18 devstack sudo[115437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:57:18 devstack sudo[115437]: pam_unix(sudo:session): session closed for user root Sep 08 06:57:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f4727363-4b69-4858-bfe6-35b9a2a2cc21 tempest-ProjectReaderTests-942968040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.506s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:57:18 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-f4727363-4b69-4858-bfe6-35b9a2a2cc21 tempest-ProjectReaderTests-942968040 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:57:18 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-f4727363-4b69-4858-bfe6-35b9a2a2cc21 tempest-ProjectReaderTests-942968040 None] Deleted volume successfully. Sep 08 06:57:18 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-f4727363-4b69-4858-bfe6-35b9a2a2cc21 tempest-ProjectReaderTests-942968040 None] Lock "cinder-28d814cb-42f0-4a8b-aa39-daf2d5950d30-delete_volume" released by "delete_volume" :: held 2.003s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:57:20 devstack cinder-volume[87507]: DEBUG oslo_service.periodic_task [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Running periodic task VolumeManager._thread_info {{(pid=87507) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 06:57:20 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] thread count: 29 {{(pid=87507) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 06:57:20 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] thread info: [<_MainThread(MainThread, started 127913129345152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87507) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 06:57:21 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4830777-d897-4505-901b-2face3ef9779 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:57:21 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-c4830777-d897-4505-901b-2face3ef9779 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Flow 'volume_create_manager' (f95aa0ec-4720-464f-8df5-9517e56f7c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:57:21 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-c4830777-d897-4505-901b-2face3ef9779 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fb87914-a5a1-4f77-a473-64bae3c74639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:57:21 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-c4830777-d897-4505-901b-2face3ef9779 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fb87914-a5a1-4f77-a473-64bae3c74639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:57:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-566281789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf3a996a-e266-4248-be3f-b3c20bbd8058,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='061cbd8a34ba465c9148150fbff7ff11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:57:21Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:57:21Z,use_quota=True,user_id='3f036d5fbe0e46579bd532ac293b3c2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:57:21 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-c4830777-d897-4505-901b-2face3ef9779 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dcee495-151b-4280-9303-d45a301cc05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:57:21 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-c4830777-d897-4505-901b-2face3ef9779 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dcee495-151b-4280-9303-d45a301cc05f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:57:21 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-c4830777-d897-4505-901b-2face3ef9779 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9ce7526-b07c-4513-8001-4307792b5d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:57:21 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-c4830777-d897-4505-901b-2face3ef9779 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9ce7526-b07c-4513-8001-4307792b5d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf3a996a-e266-4248-be3f-b3c20bbd8058', 'volume_name': 'volume-cf3a996a-e266-4248-be3f-b3c20bbd8058', 'volume_size': 2}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:57:21 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-c4830777-d897-4505-901b-2face3ef9779 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f5bbb7d-0d3a-4d87-8b67-0d35de72f155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:57:21 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-c4830777-d897-4505-901b-2face3ef9779 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f5bbb7d-0d3a-4d87-8b67-0d35de72f155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:57:21 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-c4830777-d897-4505-901b-2face3ef9779 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7323d124-93ca-4604-8b7b-39e3fd4370fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:57:21 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-c4830777-d897-4505-901b-2face3ef9779 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Volume cf3a996a-e266-4248-be3f-b3c20bbd8058: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf3a996a-e266-4248-be3f-b3c20bbd8058', 'volume_size': 2} Sep 08 06:57:21 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-c4830777-d897-4505-901b-2face3ef9779 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:57:21 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-c4830777-d897-4505-901b-2face3ef9779 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:57:21 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-c4830777-d897-4505-901b-2face3ef9779 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:57:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-566281789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf3a996a-e266-4248-be3f-b3c20bbd8058,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='061cbd8a34ba465c9148150fbff7ff11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:57:21Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:57:21Z,use_quota=True,user_id='3f036d5fbe0e46579bd532ac293b3c2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:57:21 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-c4830777-d897-4505-901b-2face3ef9779 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Creating volume cf3a996a-e266-4248-be3f-b3c20bbd8058 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:57:21 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-c4830777-d897-4505-901b-2face3ef9779 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:57:21 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-c4830777-d897-4505-901b-2face3ef9779 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:57:21 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-c4830777-d897-4505-901b-2face3ef9779 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:57:21 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-c4830777-d897-4505-901b-2face3ef9779 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:57:21 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-c4830777-d897-4505-901b-2face3ef9779 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:57:21 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-c4830777-d897-4505-901b-2face3ef9779 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:57:21 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-c4830777-d897-4505-901b-2face3ef9779 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:57:21 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-c4830777-d897-4505-901b-2face3ef9779 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cf3a996a-e266-4248-be3f-b3c20bbd8058 2147483648 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:57:21 devstack sudo[115539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cf3a996a-e266-4248-be3f-b3c20bbd8058 2147483648 Sep 08 06:57:21 devstack sudo[115539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:57:21 devstack sudo[115539]: pam_unix(sudo:session): session closed for user root Sep 08 06:57:21 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-c4830777-d897-4505-901b-2face3ef9779 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cf3a996a-e266-4248-be3f-b3c20bbd8058 2147483648" returned: 0 in 0.461s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:57:21 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-c4830777-d897-4505-901b-2face3ef9779 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cf3a996a-e266-4248-be3f-b3c20bbd8058 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:57:21 devstack sudo[115560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cf3a996a-e266-4248-be3f-b3c20bbd8058 Sep 08 06:57:21 devstack sudo[115560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:57:21 devstack sudo[115560]: pam_unix(sudo:session): session closed for user root Sep 08 06:57:21 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-c4830777-d897-4505-901b-2face3ef9779 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cf3a996a-e266-4248-be3f-b3c20bbd8058" returned: 0 in 0.261s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:57:21 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-c4830777-d897-4505-901b-2face3ef9779 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:57:21 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-c4830777-d897-4505-901b-2face3ef9779 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:57:21 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-c4830777-d897-4505-901b-2face3ef9779 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7323d124-93ca-4604-8b7b-39e3fd4370fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf3a996a-e266-4248-be3f-b3c20bbd8058', 'volume_size': 2}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:57:21 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-c4830777-d897-4505-901b-2face3ef9779 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbcc0731-ca08-4028-ba9d-a834d1667f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:57:22 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-c4830777-d897-4505-901b-2face3ef9779 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Volume volume-cf3a996a-e266-4248-be3f-b3c20bbd8058 (cf3a996a-e266-4248-be3f-b3c20bbd8058): created successfully Sep 08 06:57:22 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-c4830777-d897-4505-901b-2face3ef9779 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbcc0731-ca08-4028-ba9d-a834d1667f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:57:22 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-c4830777-d897-4505-901b-2face3ef9779 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Flow 'volume_create_manager' (f95aa0ec-4720-464f-8df5-9517e56f7c99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:57:22 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-c4830777-d897-4505-901b-2face3ef9779 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Created volume successfully. Sep 08 06:57:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-37b24bcb-7f95-4a7f-950e-0119f987e9ba tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:57:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-37b24bcb-7f95-4a7f-950e-0119f987e9ba tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:57:23 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-37b24bcb-7f95-4a7f-950e-0119f987e9ba tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Creating offline snapshot 05db9e15-753d-4869-bbfc-146e8b046a04 of volume cf3a996a-e266-4248-be3f-b3c20bbd8058 {{(pid=87507) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 06:57:23 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bdfae42-0166-4ed6-9ff9-8705c4280453]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:57:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-37b24bcb-7f95-4a7f-950e-0119f987e9ba tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cf3a996a-e266-4248-be3f-b3c20bbd8058 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:57:23 devstack sudo[115612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cf3a996a-e266-4248-be3f-b3c20bbd8058 Sep 08 06:57:23 devstack sudo[115612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:57:23 devstack sudo[115612]: pam_unix(sudo:session): session closed for user root Sep 08 06:57:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-37b24bcb-7f95-4a7f-950e-0119f987e9ba tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cf3a996a-e266-4248-be3f-b3c20bbd8058" returned: 0 in 0.402s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:57:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-37b24bcb-7f95-4a7f-950e-0119f987e9ba tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cf3a996a-e266-4248-be3f-b3c20bbd8058,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cf3a996a-e266-4248-be3f-b3c20bbd8058.05db9e15-753d-4869-bbfc-146e8b046a04 2G {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:57:23 devstack sudo[115629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cf3a996a-e266-4248-be3f-b3c20bbd8058,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cf3a996a-e266-4248-be3f-b3c20bbd8058.05db9e15-753d-4869-bbfc-146e8b046a04 2G Sep 08 06:57:23 devstack sudo[115629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:57:24 devstack sudo[115629]: pam_unix(sudo:session): session closed for user root Sep 08 06:57:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-37b24bcb-7f95-4a7f-950e-0119f987e9ba tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cf3a996a-e266-4248-be3f-b3c20bbd8058,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cf3a996a-e266-4248-be3f-b3c20bbd8058.05db9e15-753d-4869-bbfc-146e8b046a04 2G" returned: 0 in 0.427s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:57:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-37b24bcb-7f95-4a7f-950e-0119f987e9ba tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf3a996a-e266-4248-be3f-b3c20bbd8058 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cf3a996a-e266-4248-be3f-b3c20bbd8058.05db9e15-753d-4869-bbfc-146e8b046a04 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:57:24 devstack sudo[115649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf3a996a-e266-4248-be3f-b3c20bbd8058 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cf3a996a-e266-4248-be3f-b3c20bbd8058.05db9e15-753d-4869-bbfc-146e8b046a04 Sep 08 06:57:24 devstack sudo[115649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:57:24 devstack sudo[115649]: pam_unix(sudo:session): session closed for user root Sep 08 06:57:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-37b24bcb-7f95-4a7f-950e-0119f987e9ba tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf3a996a-e266-4248-be3f-b3c20bbd8058 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cf3a996a-e266-4248-be3f-b3c20bbd8058.05db9e15-753d-4869-bbfc-146e8b046a04" returned: 0 in 0.289s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:57:24 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-37b24bcb-7f95-4a7f-950e-0119f987e9ba tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cf3a996a-e266-4248-be3f-b3c20bbd8058.05db9e15-753d-4869-bbfc-146e8b046a04 is being set with open permissions: ugo+rw Sep 08 06:57:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-37b24bcb-7f95-4a7f-950e-0119f987e9ba tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cf3a996a-e266-4248-be3f-b3c20bbd8058.05db9e15-753d-4869-bbfc-146e8b046a04 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:57:24 devstack sudo[115663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cf3a996a-e266-4248-be3f-b3c20bbd8058.05db9e15-753d-4869-bbfc-146e8b046a04 Sep 08 06:57:24 devstack sudo[115663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:57:24 devstack sudo[115663]: pam_unix(sudo:session): session closed for user root Sep 08 06:57:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-37b24bcb-7f95-4a7f-950e-0119f987e9ba tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cf3a996a-e266-4248-be3f-b3c20bbd8058.05db9e15-753d-4869-bbfc-146e8b046a04" returned: 0 in 0.257s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:57:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-37b24bcb-7f95-4a7f-950e-0119f987e9ba tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cf3a996a-e266-4248-be3f-b3c20bbd8058.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:57:24 devstack sudo[115707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cf3a996a-e266-4248-be3f-b3c20bbd8058.info Sep 08 06:57:24 devstack sudo[115707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:57:25 devstack sudo[115707]: pam_unix(sudo:session): session closed for user root Sep 08 06:57:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-37b24bcb-7f95-4a7f-950e-0119f987e9ba tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cf3a996a-e266-4248-be3f-b3c20bbd8058.info" returned: 0 in 0.268s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:57:25 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-37b24bcb-7f95-4a7f-950e-0119f987e9ba tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cf3a996a-e266-4248-be3f-b3c20bbd8058.info is being set with open permissions: ugo+rw Sep 08 06:57:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-37b24bcb-7f95-4a7f-950e-0119f987e9ba tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cf3a996a-e266-4248-be3f-b3c20bbd8058.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:57:25 devstack sudo[115720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cf3a996a-e266-4248-be3f-b3c20bbd8058.info Sep 08 06:57:25 devstack sudo[115720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:57:25 devstack sudo[115720]: pam_unix(sudo:session): session closed for user root Sep 08 06:57:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-37b24bcb-7f95-4a7f-950e-0119f987e9ba tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cf3a996a-e266-4248-be3f-b3c20bbd8058.info" returned: 0 in 0.272s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:57:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-37b24bcb-7f95-4a7f-950e-0119f987e9ba tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:57:25 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-37b24bcb-7f95-4a7f-950e-0119f987e9ba tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Create snapshot completed successfully Sep 08 06:57:26 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-2e43bfa2-e516-4f78-be15-b986ae998f63 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Acquiring lock "cinder-05db9e15-753d-4869-bbfc-146e8b046a04-delete_snapshot" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:57:26 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-2e43bfa2-e516-4f78-be15-b986ae998f63 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Lock "cinder-05db9e15-753d-4869-bbfc-146e8b046a04-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:57:26 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-2e43bfa2-e516-4f78-be15-b986ae998f63 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Acquiring lock "cinder-quobyte-cf3a996a-e266-4248-be3f-b3c20bbd8058" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:57:26 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-2e43bfa2-e516-4f78-be15-b986ae998f63 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Lock "cinder-quobyte-cf3a996a-e266-4248-be3f-b3c20bbd8058" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:57:26 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-2e43bfa2-e516-4f78-be15-b986ae998f63 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Acquiring lock "cinder-quobyte-05db9e15-753d-4869-bbfc-146e8b046a04" by "_delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:57:26 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-2e43bfa2-e516-4f78-be15-b986ae998f63 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Lock "cinder-quobyte-05db9e15-753d-4869-bbfc-146e8b046a04" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:57:26 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-2e43bfa2-e516-4f78-be15-b986ae998f63 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Deleting offline snapshot 05db9e15-753d-4869-bbfc-146e8b046a04 of volume cf3a996a-e266-4248-be3f-b3c20bbd8058 {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 06:57:26 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-2e43bfa2-e516-4f78-be15-b986ae998f63 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] snapshot_file for this snap is: volume-cf3a996a-e266-4248-be3f-b3c20bbd8058.05db9e15-753d-4869-bbfc-146e8b046a04 {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 06:57:26 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81734db-30f9-4df9-b294-6ed9b7b1bd64]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:57:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2e43bfa2-e516-4f78-be15-b986ae998f63 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cf3a996a-e266-4248-be3f-b3c20bbd8058.05db9e15-753d-4869-bbfc-146e8b046a04 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:57:26 devstack sudo[115793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cf3a996a-e266-4248-be3f-b3c20bbd8058.05db9e15-753d-4869-bbfc-146e8b046a04 Sep 08 06:57:26 devstack sudo[115793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:57:26 devstack sudo[115793]: pam_unix(sudo:session): session closed for user root Sep 08 06:57:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2e43bfa2-e516-4f78-be15-b986ae998f63 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cf3a996a-e266-4248-be3f-b3c20bbd8058.05db9e15-753d-4869-bbfc-146e8b046a04" returned: 0 in 0.357s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:57:26 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-2e43bfa2-e516-4f78-be15-b986ae998f63 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf3a996a-e266-4248-be3f-b3c20bbd8058(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 06:57:27 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd467196-a347-4453-83cc-7beed28f6b58]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:57:27 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2e43bfa2-e516-4f78-be15-b986ae998f63 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cf3a996a-e266-4248-be3f-b3c20bbd8058 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:57:27 devstack sudo[115810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cf3a996a-e266-4248-be3f-b3c20bbd8058 Sep 08 06:57:27 devstack sudo[115810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:57:27 devstack sudo[115810]: pam_unix(sudo:session): session closed for user root Sep 08 06:57:27 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2e43bfa2-e516-4f78-be15-b986ae998f63 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cf3a996a-e266-4248-be3f-b3c20bbd8058" returned: 0 in 0.358s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:57:27 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2e43bfa2-e516-4f78-be15-b986ae998f63 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cf3a996a-e266-4248-be3f-b3c20bbd8058.05db9e15-753d-4869-bbfc-146e8b046a04 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:57:27 devstack sudo[115824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cf3a996a-e266-4248-be3f-b3c20bbd8058.05db9e15-753d-4869-bbfc-146e8b046a04 Sep 08 06:57:27 devstack sudo[115824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:57:27 devstack sudo[115824]: pam_unix(sudo:session): session closed for user root Sep 08 06:57:27 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2e43bfa2-e516-4f78-be15-b986ae998f63 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cf3a996a-e266-4248-be3f-b3c20bbd8058.05db9e15-753d-4869-bbfc-146e8b046a04" returned: 0 in 0.332s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:57:27 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2e43bfa2-e516-4f78-be15-b986ae998f63 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cf3a996a-e266-4248-be3f-b3c20bbd8058.05db9e15-753d-4869-bbfc-146e8b046a04 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:57:27 devstack sudo[115841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cf3a996a-e266-4248-be3f-b3c20bbd8058.05db9e15-753d-4869-bbfc-146e8b046a04 Sep 08 06:57:27 devstack sudo[115841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:57:27 devstack sudo[115841]: pam_unix(sudo:session): session closed for user root Sep 08 06:57:27 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2e43bfa2-e516-4f78-be15-b986ae998f63 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cf3a996a-e266-4248-be3f-b3c20bbd8058.05db9e15-753d-4869-bbfc-146e8b046a04" returned: 0 in 0.250s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:57:27 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-2e43bfa2-e516-4f78-be15-b986ae998f63 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Lock "cinder-quobyte-05db9e15-753d-4869-bbfc-146e8b046a04" released by "_delete_snapshot" :: held 1.400s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:57:27 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-2e43bfa2-e516-4f78-be15-b986ae998f63 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Lock "cinder-quobyte-cf3a996a-e266-4248-be3f-b3c20bbd8058" released by "delete_snapshot" :: held 1.422s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:57:28 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-2e43bfa2-e516-4f78-be15-b986ae998f63 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Created reservations ['d9552f0e-86ec-47b9-a2f5-3b728818dcd4', 'eae5b1c7-64e3-4f67-977d-becb6f4d9dee', 'ffdcefa1-ca99-47a7-9ae6-3a3a6b46d30c', '07a0b1da-2413-4f15-97f4-cc1b05d0958a'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:57:28 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-2e43bfa2-e516-4f78-be15-b986ae998f63 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Delete snapshot completed successfully. Sep 08 06:57:28 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-2e43bfa2-e516-4f78-be15-b986ae998f63 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Lock "cinder-05db9e15-753d-4869-bbfc-146e8b046a04-delete_snapshot" released by "delete_snapshot" :: held 1.564s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:57:28 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-4c7cb584-112d-44e8-ba06-475e5c152076 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Acquiring lock "cinder-cf3a996a-e266-4248-be3f-b3c20bbd8058-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:57:28 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-4c7cb584-112d-44e8-ba06-475e5c152076 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Lock "cinder-cf3a996a-e266-4248-be3f-b3c20bbd8058-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:57:28 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-4c7cb584-112d-44e8-ba06-475e5c152076 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Acquiring lock "cinder-quobyte-cf3a996a-e266-4248-be3f-b3c20bbd8058" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:57:28 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-4c7cb584-112d-44e8-ba06-475e5c152076 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Lock "cinder-quobyte-cf3a996a-e266-4248-be3f-b3c20bbd8058" acquired by "delete_volume" :: waited 0.019s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:57:28 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c0a6fb-97fe-4e4c-8261-4db1695a5408]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:57:28 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4c7cb584-112d-44e8-ba06-475e5c152076 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cf3a996a-e266-4248-be3f-b3c20bbd8058 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:57:28 devstack sudo[115877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cf3a996a-e266-4248-be3f-b3c20bbd8058 Sep 08 06:57:28 devstack sudo[115877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:57:29 devstack sudo[115877]: pam_unix(sudo:session): session closed for user root Sep 08 06:57:29 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4c7cb584-112d-44e8-ba06-475e5c152076 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cf3a996a-e266-4248-be3f-b3c20bbd8058" returned: 0 in 0.369s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:57:29 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4c7cb584-112d-44e8-ba06-475e5c152076 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cf3a996a-e266-4248-be3f-b3c20bbd8058 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:57:29 devstack sudo[115895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cf3a996a-e266-4248-be3f-b3c20bbd8058 Sep 08 06:57:29 devstack sudo[115895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:57:29 devstack sudo[115895]: pam_unix(sudo:session): session closed for user root Sep 08 06:57:29 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4c7cb584-112d-44e8-ba06-475e5c152076 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cf3a996a-e266-4248-be3f-b3c20bbd8058" returned: 0 in 0.256s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:57:29 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-4c7cb584-112d-44e8-ba06-475e5c152076 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Lock "cinder-quobyte-cf3a996a-e266-4248-be3f-b3c20bbd8058" released by "delete_volume" :: held 0.694s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:57:29 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-4c7cb584-112d-44e8-ba06-475e5c152076 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Created reservations ['acfadd3d-7248-4a43-b4d5-254f9075ced5', '9f14f1fb-934b-4c98-8d4e-bd1ea7b8a353', 'b6a0c498-ecdf-4eb7-9a59-88dcf0507c0e', '5aeab53c-2f71-4d9b-812d-1a8cd8280090'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:57:29 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4c7cb584-112d-44e8-ba06-475e5c152076 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:57:29 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4c7cb584-112d-44e8-ba06-475e5c152076 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:57:29 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-4c7cb584-112d-44e8-ba06-475e5c152076 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:57:29 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-4c7cb584-112d-44e8-ba06-475e5c152076 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:57:29 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4c7cb584-112d-44e8-ba06-475e5c152076 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:57:29 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4c7cb584-112d-44e8-ba06-475e5c152076 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:57:29 devstack sudo[115910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:57:29 devstack sudo[115910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:57:29 devstack sudo[115910]: pam_unix(sudo:session): session closed for user root Sep 08 06:57:29 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4c7cb584-112d-44e8-ba06-475e5c152076 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.250s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:57:29 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-4c7cb584-112d-44e8-ba06-475e5c152076 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:57:29 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-4c7cb584-112d-44e8-ba06-475e5c152076 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Deleted volume successfully. Sep 08 06:57:29 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-4c7cb584-112d-44e8-ba06-475e5c152076 tempest-VolumesSnapshotNegativeTestJSON-1856991886 None] Lock "cinder-cf3a996a-e266-4248-be3f-b3c20bbd8058-delete_volume" released by "delete_volume" :: held 1.144s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:57:39 devstack cinder-volume[87507]: DEBUG dbcounter [-] [87507] Writing DB stats cinder:UPDATE=73,cinder:SELECT=55,cinder:INSERT=21,cinder:DELETE=3 {{(pid=87507) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 06:57:39 devstack cinder-volume[87507]: DEBUG dbcounter [-] [87507] Writing DB stats cinder:UPDATE=57,cinder:DELETE=7,cinder:INSERT=14,cinder:SELECT=40 {{(pid=87507) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 06:57:52 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-81156695-e265-4215-a83c-d526d0218681 tempest-TestInstancesWithCinderVolumes-616773652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:57:52 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-81156695-e265-4215-a83c-d526d0218681 tempest-TestInstancesWithCinderVolumes-616773652 None] Flow 'volume_create_manager' (9fe15e38-f8ef-4b59-9430-80347acbe9ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:57:52 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-81156695-e265-4215-a83c-d526d0218681 tempest-TestInstancesWithCinderVolumes-616773652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a8866dd-798e-4380-9d8b-164cc3708778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:57:52 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-81156695-e265-4215-a83c-d526d0218681 tempest-TestInstancesWithCinderVolumes-616773652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a8866dd-798e-4380-9d8b-164cc3708778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-559233712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f98ddce5-8367-4033-a051-36a5c2c8f1ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e23b473e8bb14331b67a21877e5f5312',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:57:53Z,use_quota=True,user_id='3c12c6b786294ed18f34471b232e41d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31fa2271-c17a-42dc-9a68-bed4409d1bb2),volume_type_id=31fa2271-c17a-42dc-9a68-bed4409d1bb2)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:57:52 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-81156695-e265-4215-a83c-d526d0218681 tempest-TestInstancesWithCinderVolumes-616773652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8417c94f-318b-4795-b955-5c5049d76155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:57:52 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-81156695-e265-4215-a83c-d526d0218681 tempest-TestInstancesWithCinderVolumes-616773652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8417c94f-318b-4795-b955-5c5049d76155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:57:52 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-81156695-e265-4215-a83c-d526d0218681 tempest-TestInstancesWithCinderVolumes-616773652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06a52a38-a28d-4b7a-afd3-f6d294a3bf3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:57:52 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-81156695-e265-4215-a83c-d526d0218681 tempest-TestInstancesWithCinderVolumes-616773652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06a52a38-a28d-4b7a-afd3-f6d294a3bf3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f98ddce5-8367-4033-a051-36a5c2c8f1ce', 'volume_name': 'volume-f98ddce5-8367-4033-a051-36a5c2c8f1ce', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:57:52 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-81156695-e265-4215-a83c-d526d0218681 tempest-TestInstancesWithCinderVolumes-616773652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cfea3ed-a709-4616-a9f9-130a5400a9a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:57:52 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-81156695-e265-4215-a83c-d526d0218681 tempest-TestInstancesWithCinderVolumes-616773652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cfea3ed-a709-4616-a9f9-130a5400a9a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:57:52 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-81156695-e265-4215-a83c-d526d0218681 tempest-TestInstancesWithCinderVolumes-616773652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2928aef1-9878-4095-b132-2a32dd8374a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:57:52 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-81156695-e265-4215-a83c-d526d0218681 tempest-TestInstancesWithCinderVolumes-616773652 None] Volume f98ddce5-8367-4033-a051-36a5c2c8f1ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f98ddce5-8367-4033-a051-36a5c2c8f1ce', 'volume_size': 1} Sep 08 06:57:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-81156695-e265-4215-a83c-d526d0218681 tempest-TestInstancesWithCinderVolumes-616773652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:57:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-81156695-e265-4215-a83c-d526d0218681 tempest-TestInstancesWithCinderVolumes-616773652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:57:52 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-81156695-e265-4215-a83c-d526d0218681 tempest-TestInstancesWithCinderVolumes-616773652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-559233712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f98ddce5-8367-4033-a051-36a5c2c8f1ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e23b473e8bb14331b67a21877e5f5312',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:57:53Z,use_quota=True,user_id='3c12c6b786294ed18f34471b232e41d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31fa2271-c17a-42dc-9a68-bed4409d1bb2),volume_type_id=31fa2271-c17a-42dc-9a68-bed4409d1bb2)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:57:52 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-81156695-e265-4215-a83c-d526d0218681 tempest-TestInstancesWithCinderVolumes-616773652 None] Creating volume f98ddce5-8367-4033-a051-36a5c2c8f1ce {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:57:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-81156695-e265-4215-a83c-d526d0218681 tempest-TestInstancesWithCinderVolumes-616773652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:57:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-81156695-e265-4215-a83c-d526d0218681 tempest-TestInstancesWithCinderVolumes-616773652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:57:52 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-81156695-e265-4215-a83c-d526d0218681 tempest-TestInstancesWithCinderVolumes-616773652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:57:52 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-81156695-e265-4215-a83c-d526d0218681 tempest-TestInstancesWithCinderVolumes-616773652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:57:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-81156695-e265-4215-a83c-d526d0218681 tempest-TestInstancesWithCinderVolumes-616773652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:57:52 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-81156695-e265-4215-a83c-d526d0218681 tempest-TestInstancesWithCinderVolumes-616773652 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:57:52 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-81156695-e265-4215-a83c-d526d0218681 tempest-TestInstancesWithCinderVolumes-616773652 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:57:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-81156695-e265-4215-a83c-d526d0218681 tempest-TestInstancesWithCinderVolumes-616773652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f98ddce5-8367-4033-a051-36a5c2c8f1ce 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:57:52 devstack sudo[116608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f98ddce5-8367-4033-a051-36a5c2c8f1ce 1073741824 Sep 08 06:57:52 devstack sudo[116608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:57:53 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-088e5fe1-a60f-4c22-af0f-a483c48f8a60 tempest-TestInstancesWithCinderVolumes-616773652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:57:53 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-088e5fe1-a60f-4c22-af0f-a483c48f8a60 tempest-TestInstancesWithCinderVolumes-616773652 None] Flow 'volume_create_manager' (99e5dbd8-3e2e-4aac-afb8-eb5a2cb99e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:57:53 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-088e5fe1-a60f-4c22-af0f-a483c48f8a60 tempest-TestInstancesWithCinderVolumes-616773652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be60323c-bba4-4067-9ee2-9385495f26d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:57:53 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-088e5fe1-a60f-4c22-af0f-a483c48f8a60 tempest-TestInstancesWithCinderVolumes-616773652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be60323c-bba4-4067-9ee2-9385495f26d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:57:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1167281379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81ce9bdd-df69-4c27-a209-68c22f33ba83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e23b473e8bb14331b67a21877e5f5312',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:57:53Z,use_quota=True,user_id='3c12c6b786294ed18f34471b232e41d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1742dfde-051d-4040-ae93-c06ce7fd888b),volume_type_id=1742dfde-051d-4040-ae93-c06ce7fd888b)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:57:53 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-088e5fe1-a60f-4c22-af0f-a483c48f8a60 tempest-TestInstancesWithCinderVolumes-616773652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82e9ac2d-16a4-46ca-836a-d0de783ebf23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:57:53 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-088e5fe1-a60f-4c22-af0f-a483c48f8a60 tempest-TestInstancesWithCinderVolumes-616773652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82e9ac2d-16a4-46ca-836a-d0de783ebf23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:57:53 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-088e5fe1-a60f-4c22-af0f-a483c48f8a60 tempest-TestInstancesWithCinderVolumes-616773652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2e9e4c2-f3d8-492a-8ff5-909d5b686fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:57:53 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-088e5fe1-a60f-4c22-af0f-a483c48f8a60 tempest-TestInstancesWithCinderVolumes-616773652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2e9e4c2-f3d8-492a-8ff5-909d5b686fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81ce9bdd-df69-4c27-a209-68c22f33ba83', 'volume_name': 'volume-81ce9bdd-df69-4c27-a209-68c22f33ba83', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:57:53 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-088e5fe1-a60f-4c22-af0f-a483c48f8a60 tempest-TestInstancesWithCinderVolumes-616773652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22bf2d93-f657-44a8-8cfb-f01c3efba16c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:57:53 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-088e5fe1-a60f-4c22-af0f-a483c48f8a60 tempest-TestInstancesWithCinderVolumes-616773652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22bf2d93-f657-44a8-8cfb-f01c3efba16c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:57:53 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-088e5fe1-a60f-4c22-af0f-a483c48f8a60 tempest-TestInstancesWithCinderVolumes-616773652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb5be889-7ad9-4c47-acfe-b5625dac8780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:57:53 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-088e5fe1-a60f-4c22-af0f-a483c48f8a60 tempest-TestInstancesWithCinderVolumes-616773652 None] Volume 81ce9bdd-df69-4c27-a209-68c22f33ba83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81ce9bdd-df69-4c27-a209-68c22f33ba83', 'volume_size': 1} Sep 08 06:57:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-088e5fe1-a60f-4c22-af0f-a483c48f8a60 tempest-TestInstancesWithCinderVolumes-616773652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:57:53 devstack sudo[116608]: pam_unix(sudo:session): session closed for user root Sep 08 06:57:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-81156695-e265-4215-a83c-d526d0218681 tempest-TestInstancesWithCinderVolumes-616773652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f98ddce5-8367-4033-a051-36a5c2c8f1ce 1073741824" returned: 0 in 0.488s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:57:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-81156695-e265-4215-a83c-d526d0218681 tempest-TestInstancesWithCinderVolumes-616773652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f98ddce5-8367-4033-a051-36a5c2c8f1ce {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:57:53 devstack sudo[116629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f98ddce5-8367-4033-a051-36a5c2c8f1ce Sep 08 06:57:53 devstack sudo[116629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:57:53 devstack sudo[116629]: pam_unix(sudo:session): session closed for user root Sep 08 06:57:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-81156695-e265-4215-a83c-d526d0218681 tempest-TestInstancesWithCinderVolumes-616773652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f98ddce5-8367-4033-a051-36a5c2c8f1ce" returned: 0 in 0.260s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:57:53 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-81156695-e265-4215-a83c-d526d0218681 tempest-TestInstancesWithCinderVolumes-616773652 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:57:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-81156695-e265-4215-a83c-d526d0218681 tempest-TestInstancesWithCinderVolumes-616773652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:57:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-088e5fe1-a60f-4c22-af0f-a483c48f8a60 tempest-TestInstancesWithCinderVolumes-616773652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.391s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:57:53 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-088e5fe1-a60f-4c22-af0f-a483c48f8a60 tempest-TestInstancesWithCinderVolumes-616773652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:57:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1167281379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81ce9bdd-df69-4c27-a209-68c22f33ba83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e23b473e8bb14331b67a21877e5f5312',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:57:53Z,use_quota=True,user_id='3c12c6b786294ed18f34471b232e41d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1742dfde-051d-4040-ae93-c06ce7fd888b),volume_type_id=1742dfde-051d-4040-ae93-c06ce7fd888b)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:57:53 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-088e5fe1-a60f-4c22-af0f-a483c48f8a60 tempest-TestInstancesWithCinderVolumes-616773652 None] Creating volume 81ce9bdd-df69-4c27-a209-68c22f33ba83 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:57:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-088e5fe1-a60f-4c22-af0f-a483c48f8a60 tempest-TestInstancesWithCinderVolumes-616773652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:57:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-088e5fe1-a60f-4c22-af0f-a483c48f8a60 tempest-TestInstancesWithCinderVolumes-616773652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:57:53 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-088e5fe1-a60f-4c22-af0f-a483c48f8a60 tempest-TestInstancesWithCinderVolumes-616773652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:57:53 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-088e5fe1-a60f-4c22-af0f-a483c48f8a60 tempest-TestInstancesWithCinderVolumes-616773652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:57:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-088e5fe1-a60f-4c22-af0f-a483c48f8a60 tempest-TestInstancesWithCinderVolumes-616773652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:57:53 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-088e5fe1-a60f-4c22-af0f-a483c48f8a60 tempest-TestInstancesWithCinderVolumes-616773652 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:57:53 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-088e5fe1-a60f-4c22-af0f-a483c48f8a60 tempest-TestInstancesWithCinderVolumes-616773652 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:57:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-088e5fe1-a60f-4c22-af0f-a483c48f8a60 tempest-TestInstancesWithCinderVolumes-616773652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-81ce9bdd-df69-4c27-a209-68c22f33ba83 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:57:53 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-81156695-e265-4215-a83c-d526d0218681 tempest-TestInstancesWithCinderVolumes-616773652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2928aef1-9878-4095-b132-2a32dd8374a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f98ddce5-8367-4033-a051-36a5c2c8f1ce', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:57:53 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-81156695-e265-4215-a83c-d526d0218681 tempest-TestInstancesWithCinderVolumes-616773652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5295564a-54e8-404f-b949-72c1d08b8594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:57:53 devstack sudo[116641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-81ce9bdd-df69-4c27-a209-68c22f33ba83 1073741824 Sep 08 06:57:53 devstack sudo[116641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:57:53 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-81156695-e265-4215-a83c-d526d0218681 tempest-TestInstancesWithCinderVolumes-616773652 None] Volume volume-f98ddce5-8367-4033-a051-36a5c2c8f1ce (f98ddce5-8367-4033-a051-36a5c2c8f1ce): created successfully Sep 08 06:57:53 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-81156695-e265-4215-a83c-d526d0218681 tempest-TestInstancesWithCinderVolumes-616773652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5295564a-54e8-404f-b949-72c1d08b8594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:57:53 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-81156695-e265-4215-a83c-d526d0218681 tempest-TestInstancesWithCinderVolumes-616773652 None] Flow 'volume_create_manager' (9fe15e38-f8ef-4b59-9430-80347acbe9ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:57:53 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-81156695-e265-4215-a83c-d526d0218681 tempest-TestInstancesWithCinderVolumes-616773652 None] Created volume successfully. Sep 08 06:57:53 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c9a587d-9c8b-4e9b-8c0d-d179ef840968 tempest-TestInstancesWithCinderVolumes-616773652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:57:53 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2c9a587d-9c8b-4e9b-8c0d-d179ef840968 tempest-TestInstancesWithCinderVolumes-616773652 None] Flow 'volume_create_manager' (f963cb07-5d19-4266-b8ff-49fc31b63c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:57:53 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2c9a587d-9c8b-4e9b-8c0d-d179ef840968 tempest-TestInstancesWithCinderVolumes-616773652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26719ebc-43b5-4c68-a09b-b0eea65b2e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:57:53 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2c9a587d-9c8b-4e9b-8c0d-d179ef840968 tempest-TestInstancesWithCinderVolumes-616773652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26719ebc-43b5-4c68-a09b-b0eea65b2e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:57:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-151448345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d872c8b-3b02-4237-9702-a69ee7daf093,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e23b473e8bb14331b67a21877e5f5312',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:57:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:57:54Z,use_quota=True,user_id='3c12c6b786294ed18f34471b232e41d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fbf523d6-224b-4692-8d36-0963c05775a1),volume_type_id=fbf523d6-224b-4692-8d36-0963c05775a1)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:57:53 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2c9a587d-9c8b-4e9b-8c0d-d179ef840968 tempest-TestInstancesWithCinderVolumes-616773652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fae4bbcd-5267-4ba7-8d98-a844ba0e8db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:57:53 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2c9a587d-9c8b-4e9b-8c0d-d179ef840968 tempest-TestInstancesWithCinderVolumes-616773652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fae4bbcd-5267-4ba7-8d98-a844ba0e8db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:57:53 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2c9a587d-9c8b-4e9b-8c0d-d179ef840968 tempest-TestInstancesWithCinderVolumes-616773652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bcdca49-d1f6-4698-ac45-dbfb83a37262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:57:53 devstack cinder-volume[87507]: DEBUG cinder.image.glance [None req-2c9a587d-9c8b-4e9b-8c0d-d179ef840968 tempest-TestInstancesWithCinderVolumes-616773652 None] Creating Keystone auth plugin from conf {{(pid=87507) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 08 06:57:53 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2c9a587d-9c8b-4e9b-8c0d-d179ef840968 tempest-TestInstancesWithCinderVolumes-616773652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bcdca49-d1f6-4698-ac45-dbfb83a37262) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2d872c8b-3b02-4237-9702-a69ee7daf093', 'volume_name': 'volume-2d872c8b-3b02-4237-9702-a69ee7daf093', 'volume_size': 1, 'image_id': 'cd6fea82-ef6a-4897-9239-84e3fbc18b74', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd6fea82-ef6a-4897-9239-84e3fbc18b74', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--734964021', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e23b473e8bb14331b67a21877e5f5312', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cd6fea82-ef6a-4897-9239-84e3fbc18b74', 'created_at': datetime.datetime(2026, 9, 8, 4, 57, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 4, 57, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd6fea82-ef6a-4897-9239-84e3fbc18b74/file', 'properties': {}}, 'image_service': }' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:57:53 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2c9a587d-9c8b-4e9b-8c0d-d179ef840968 tempest-TestInstancesWithCinderVolumes-616773652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82918bd2-6f5f-413d-be4e-e8e6d900507e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:57:53 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2c9a587d-9c8b-4e9b-8c0d-d179ef840968 tempest-TestInstancesWithCinderVolumes-616773652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82918bd2-6f5f-413d-be4e-e8e6d900507e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:57:53 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2c9a587d-9c8b-4e9b-8c0d-d179ef840968 tempest-TestInstancesWithCinderVolumes-616773652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20f3d767-7374-41a4-bae5-a4033ec8a522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:57:53 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-2c9a587d-9c8b-4e9b-8c0d-d179ef840968 tempest-TestInstancesWithCinderVolumes-616773652 None] Volume 2d872c8b-3b02-4237-9702-a69ee7daf093: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2d872c8b-3b02-4237-9702-a69ee7daf093', 'volume_size': 1, 'image_id': 'cd6fea82-ef6a-4897-9239-84e3fbc18b74', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd6fea82-ef6a-4897-9239-84e3fbc18b74', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--734964021', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e23b473e8bb14331b67a21877e5f5312', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cd6fea82-ef6a-4897-9239-84e3fbc18b74', 'created_at': datetime.datetime(2026, 9, 8, 4, 57, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 4, 57, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd6fea82-ef6a-4897-9239-84e3fbc18b74/file', 'properties': {}}, 'image_service': } Sep 08 06:57:53 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c9a587d-9c8b-4e9b-8c0d-d179ef840968 tempest-TestInstancesWithCinderVolumes-616773652 None] Trying to clone 2d872c8b-3b02-4237-9702-a69ee7daf093 from image cd6fea82-ef6a-4897-9239-84e3fbc18b74 at location (None, [{'url': 'file:///opt/stack/data/glance/images/cd6fea82-ef6a-4897-9239-84e3fbc18b74', 'metadata': {}}]). {{(pid=87507) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 08 06:57:53 devstack sudo[116641]: pam_unix(sudo:session): session closed for user root Sep 08 06:57:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-088e5fe1-a60f-4c22-af0f-a483c48f8a60 tempest-TestInstancesWithCinderVolumes-616773652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-81ce9bdd-df69-4c27-a209-68c22f33ba83 1073741824" returned: 0 in 0.431s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:57:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-088e5fe1-a60f-4c22-af0f-a483c48f8a60 tempest-TestInstancesWithCinderVolumes-616773652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-81ce9bdd-df69-4c27-a209-68c22f33ba83 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:57:53 devstack sudo[116659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-81ce9bdd-df69-4c27-a209-68c22f33ba83 Sep 08 06:57:53 devstack sudo[116659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:57:54 devstack sudo[116659]: pam_unix(sudo:session): session closed for user root Sep 08 06:57:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-088e5fe1-a60f-4c22-af0f-a483c48f8a60 tempest-TestInstancesWithCinderVolumes-616773652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-81ce9bdd-df69-4c27-a209-68c22f33ba83" returned: 0 in 0.256s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:57:54 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-088e5fe1-a60f-4c22-af0f-a483c48f8a60 tempest-TestInstancesWithCinderVolumes-616773652 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:57:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-088e5fe1-a60f-4c22-af0f-a483c48f8a60 tempest-TestInstancesWithCinderVolumes-616773652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:57:54 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-088e5fe1-a60f-4c22-af0f-a483c48f8a60 tempest-TestInstancesWithCinderVolumes-616773652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb5be889-7ad9-4c47-acfe-b5625dac8780) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81ce9bdd-df69-4c27-a209-68c22f33ba83', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:57:54 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-088e5fe1-a60f-4c22-af0f-a483c48f8a60 tempest-TestInstancesWithCinderVolumes-616773652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dda4400-6290-4ed0-b18b-87bd6c6d22e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:57:54 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-088e5fe1-a60f-4c22-af0f-a483c48f8a60 tempest-TestInstancesWithCinderVolumes-616773652 None] Volume volume-81ce9bdd-df69-4c27-a209-68c22f33ba83 (81ce9bdd-df69-4c27-a209-68c22f33ba83): created successfully Sep 08 06:57:54 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-088e5fe1-a60f-4c22-af0f-a483c48f8a60 tempest-TestInstancesWithCinderVolumes-616773652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dda4400-6290-4ed0-b18b-87bd6c6d22e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:57:54 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-088e5fe1-a60f-4c22-af0f-a483c48f8a60 tempest-TestInstancesWithCinderVolumes-616773652 None] Flow 'volume_create_manager' (99e5dbd8-3e2e-4aac-afb8-eb5a2cb99e86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:57:54 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-088e5fe1-a60f-4c22-af0f-a483c48f8a60 tempest-TestInstancesWithCinderVolumes-616773652 None] Created volume successfully. Sep 08 06:57:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-c2c74e30-8621-4e2e-89a0-7c8397bb33df req-18abb74e-b5b3-4da4-9536-87c2729d8df4 tempest-TestStampPattern-1549278103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:57:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-c2c74e30-8621-4e2e-89a0-7c8397bb33df req-18abb74e-b5b3-4da4-9536-87c2729d8df4 tempest-TestStampPattern-1549278103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:57:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-c2c74e30-8621-4e2e-89a0-7c8397bb33df req-18abb74e-b5b3-4da4-9536-87c2729d8df4 tempest-TestStampPattern-1549278103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:57:55 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-c2c74e30-8621-4e2e-89a0-7c8397bb33df req-18abb74e-b5b3-4da4-9536-87c2729d8df4 tempest-TestStampPattern-1549278103 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d', 'name': 'volume-7f684664-1b04-419e-a213-2d5d565b04f2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e0ccb6a8-d9a7-448f-b041-afa33d2ea506', 'enforce_multipath': True} {{(pid=87507) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 06:57:55 devstack cinder-volume[87507]: INFO cinder.volume.manager [req-c2c74e30-8621-4e2e-89a0-7c8397bb33df req-18abb74e-b5b3-4da4-9536-87c2729d8df4 tempest-TestStampPattern-1549278103 None] attachment_update completed successfully. Sep 08 06:57:57 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-2c9a587d-9c8b-4e9b-8c0d-d179ef840968 tempest-TestInstancesWithCinderVolumes-616773652 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cd6fea82-ef6a-4897-9239-84e3fbc18b74_9obp74trdevstack@QuobyteHD, size 20.69 MB, duration 3.40 sec {{(pid=87507) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 08 06:57:57 devstack cinder-volume[87507]: INFO cinder.image.image_utils [None req-2c9a587d-9c8b-4e9b-8c0d-d179ef840968 tempest-TestInstancesWithCinderVolumes-616773652 None] Image download 20.69 MB at 6.08 MB/s Sep 08 06:57:57 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[da927374-06a3-4874-90a0-ce528e1348f8]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:57:57 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2c9a587d-9c8b-4e9b-8c0d-d179ef840968 tempest-TestInstancesWithCinderVolumes-616773652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd6fea82-ef6a-4897-9239-84e3fbc18b74_9obp74trdevstack@QuobyteHD {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:57:57 devstack sudo[117163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd6fea82-ef6a-4897-9239-84e3fbc18b74_9obp74trdevstack@QuobyteHD Sep 08 06:57:57 devstack sudo[117163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:57:57 devstack sudo[117163]: pam_unix(sudo:session): session closed for user root Sep 08 06:57:57 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2c9a587d-9c8b-4e9b-8c0d-d179ef840968 tempest-TestInstancesWithCinderVolumes-616773652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd6fea82-ef6a-4897-9239-84e3fbc18b74_9obp74trdevstack@QuobyteHD" returned: 0 in 0.332s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:57:57 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-2c9a587d-9c8b-4e9b-8c0d-d179ef840968 tempest-TestInstancesWithCinderVolumes-616773652 None] Temporary image cd6fea82-ef6a-4897-9239-84e3fbc18b74 is fetched for user 3c12c6b786294ed18f34471b232e41d5. {{(pid=87507) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 08 06:57:57 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae0daa3-c231-443e-824c-7241d9dd6b91]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:57:57 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2c9a587d-9c8b-4e9b-8c0d-d179ef840968 tempest-TestInstancesWithCinderVolumes-616773652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd6fea82-ef6a-4897-9239-84e3fbc18b74_9obp74trdevstack@QuobyteHD {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:57:57 devstack sudo[117188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd6fea82-ef6a-4897-9239-84e3fbc18b74_9obp74trdevstack@QuobyteHD Sep 08 06:57:57 devstack sudo[117188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:57:58 devstack sudo[117188]: pam_unix(sudo:session): session closed for user root Sep 08 06:57:58 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2c9a587d-9c8b-4e9b-8c0d-d179ef840968 tempest-TestInstancesWithCinderVolumes-616773652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd6fea82-ef6a-4897-9239-84e3fbc18b74_9obp74trdevstack@QuobyteHD" returned: 0 in 0.333s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:57:58 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-2c9a587d-9c8b-4e9b-8c0d-d179ef840968 tempest-TestInstancesWithCinderVolumes-616773652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:57:58 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-2c9a587d-9c8b-4e9b-8c0d-d179ef840968 tempest-TestInstancesWithCinderVolumes-616773652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:57:58 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-2c9a587d-9c8b-4e9b-8c0d-d179ef840968 tempest-TestInstancesWithCinderVolumes-616773652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:57:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-151448345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d872c8b-3b02-4237-9702-a69ee7daf093,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e23b473e8bb14331b67a21877e5f5312',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:57:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:57:54Z,use_quota=True,user_id='3c12c6b786294ed18f34471b232e41d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fbf523d6-224b-4692-8d36-0963c05775a1),volume_type_id=fbf523d6-224b-4692-8d36-0963c05775a1)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:57:58 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-2c9a587d-9c8b-4e9b-8c0d-d179ef840968 tempest-TestInstancesWithCinderVolumes-616773652 None] Creating volume 2d872c8b-3b02-4237-9702-a69ee7daf093 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:57:58 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-2c9a587d-9c8b-4e9b-8c0d-d179ef840968 tempest-TestInstancesWithCinderVolumes-616773652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:57:58 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-2c9a587d-9c8b-4e9b-8c0d-d179ef840968 tempest-TestInstancesWithCinderVolumes-616773652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:57:58 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-2c9a587d-9c8b-4e9b-8c0d-d179ef840968 tempest-TestInstancesWithCinderVolumes-616773652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:57:58 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-2c9a587d-9c8b-4e9b-8c0d-d179ef840968 tempest-TestInstancesWithCinderVolumes-616773652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:57:58 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-2c9a587d-9c8b-4e9b-8c0d-d179ef840968 tempest-TestInstancesWithCinderVolumes-616773652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:57:58 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-2c9a587d-9c8b-4e9b-8c0d-d179ef840968 tempest-TestInstancesWithCinderVolumes-616773652 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:57:58 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-2c9a587d-9c8b-4e9b-8c0d-d179ef840968 tempest-TestInstancesWithCinderVolumes-616773652 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:57:58 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2c9a587d-9c8b-4e9b-8c0d-d179ef840968 tempest-TestInstancesWithCinderVolumes-616773652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2d872c8b-3b02-4237-9702-a69ee7daf093 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:57:58 devstack sudo[117208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2d872c8b-3b02-4237-9702-a69ee7daf093 1073741824 Sep 08 06:57:58 devstack sudo[117208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:57:58 devstack sudo[117208]: pam_unix(sudo:session): session closed for user root Sep 08 06:57:58 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2c9a587d-9c8b-4e9b-8c0d-d179ef840968 tempest-TestInstancesWithCinderVolumes-616773652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2d872c8b-3b02-4237-9702-a69ee7daf093 1073741824" returned: 0 in 0.466s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:57:58 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2c9a587d-9c8b-4e9b-8c0d-d179ef840968 tempest-TestInstancesWithCinderVolumes-616773652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2d872c8b-3b02-4237-9702-a69ee7daf093 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:57:58 devstack sudo[117233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2d872c8b-3b02-4237-9702-a69ee7daf093 Sep 08 06:57:58 devstack sudo[117233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:57:58 devstack sudo[117233]: pam_unix(sudo:session): session closed for user root Sep 08 06:57:58 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2c9a587d-9c8b-4e9b-8c0d-d179ef840968 tempest-TestInstancesWithCinderVolumes-616773652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2d872c8b-3b02-4237-9702-a69ee7daf093" returned: 0 in 0.265s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:57:58 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-2c9a587d-9c8b-4e9b-8c0d-d179ef840968 tempest-TestInstancesWithCinderVolumes-616773652 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:57:58 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-2c9a587d-9c8b-4e9b-8c0d-d179ef840968 tempest-TestInstancesWithCinderVolumes-616773652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:57:58 devstack cinder-volume[87507]: DEBUG cinder.volume.volume_utils [None req-2c9a587d-9c8b-4e9b-8c0d-d179ef840968 tempest-TestInstancesWithCinderVolumes-616773652 None] Attempting download of cd6fea82-ef6a-4897-9239-84e3fbc18b74 ((None, [{'url': 'file:///opt/stack/data/glance/images/cd6fea82-ef6a-4897-9239-84e3fbc18b74', 'metadata': {}}])) to volume 2d872c8b-3b02-4237-9702-a69ee7daf093. {{(pid=87507) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 08 06:57:58 devstack cinder-volume[87507]: INFO cinder.volume.manager [req-00585a42-615a-4ddb-8a77-f57f2eb8c59d req-5536b699-1191-4acf-9ce8-ef621c1e1ac4 tempest-TestStampPattern-1549278103 None] Terminate volume connection completed successfully. Sep 08 06:57:58 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-00585a42-615a-4ddb-8a77-f57f2eb8c59d req-5536b699-1191-4acf-9ce8-ef621c1e1ac4 tempest-TestStampPattern-1549278103 None] Deleting attachment e0ccb6a8-d9a7-448f-b041-afa33d2ea506. {{(pid=87507) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 06:57:58 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc31a9b6-9135-4f8b-90c8-e5899193c356]: (4, 'raw') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:57:58 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2c9a587d-9c8b-4e9b-8c0d-d179ef840968 tempest-TestInstancesWithCinderVolumes-616773652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd6fea82-ef6a-4897-9239-84e3fbc18b74_7ihn_g86 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:57:59 devstack sudo[117277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd6fea82-ef6a-4897-9239-84e3fbc18b74_7ihn_g86 Sep 08 06:57:59 devstack sudo[117277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:57:59 devstack sudo[117277]: pam_unix(sudo:session): session closed for user root Sep 08 06:57:59 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2c9a587d-9c8b-4e9b-8c0d-d179ef840968 tempest-TestInstancesWithCinderVolumes-616773652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd6fea82-ef6a-4897-9239-84e3fbc18b74_7ihn_g86" returned: 0 in 0.341s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:57:59 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2c9a587d-9c8b-4e9b-8c0d-d179ef840968 tempest-TestInstancesWithCinderVolumes-616773652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd6fea82-ef6a-4897-9239-84e3fbc18b74_7ihn_g86 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:57:59 devstack sudo[117291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd6fea82-ef6a-4897-9239-84e3fbc18b74_7ihn_g86 Sep 08 06:57:59 devstack sudo[117291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:57:59 devstack sudo[117291]: pam_unix(sudo:session): session closed for user root Sep 08 06:57:59 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2c9a587d-9c8b-4e9b-8c0d-d179ef840968 tempest-TestInstancesWithCinderVolumes-616773652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd6fea82-ef6a-4897-9239-84e3fbc18b74_7ihn_g86" returned: 1 in 0.332s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:57:59 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2c9a587d-9c8b-4e9b-8c0d-d179ef840968 tempest-TestInstancesWithCinderVolumes-616773652 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd6fea82-ef6a-4897-9239-84e3fbc18b74_7ihn_g86' failed. Not Retrying. {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 06:57:59 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4c937e-0860-4595-b131-41c4c5503124]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:57:59 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2c9a587d-9c8b-4e9b-8c0d-d179ef840968 tempest-TestInstancesWithCinderVolumes-616773652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd6fea82-ef6a-4897-9239-84e3fbc18b74_9obp74trdevstack@QuobyteHD {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:57:59 devstack sudo[117307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd6fea82-ef6a-4897-9239-84e3fbc18b74_9obp74trdevstack@QuobyteHD Sep 08 06:57:59 devstack sudo[117307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:57:59 devstack sudo[117307]: pam_unix(sudo:session): session closed for user root Sep 08 06:57:59 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2c9a587d-9c8b-4e9b-8c0d-d179ef840968 tempest-TestInstancesWithCinderVolumes-616773652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd6fea82-ef6a-4897-9239-84e3fbc18b74_9obp74trdevstack@QuobyteHD" returned: 0 in 0.335s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:57:59 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-2c9a587d-9c8b-4e9b-8c0d-d179ef840968 tempest-TestInstancesWithCinderVolumes-616773652 None] cd6fea82-ef6a-4897-9239-84e3fbc18b74 was qcow2, converting to qcow2 {{(pid=87507) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 08 06:57:59 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2c9a587d-9c8b-4e9b-8c0d-d179ef840968 tempest-TestInstancesWithCinderVolumes-616773652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cd6fea82-ef6a-4897-9239-84e3fbc18b74_9obp74trdevstack@QuobyteHD /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2d872c8b-3b02-4237-9702-a69ee7daf093 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:58:00 devstack sudo[117321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cd6fea82-ef6a-4897-9239-84e3fbc18b74_9obp74trdevstack@QuobyteHD /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2d872c8b-3b02-4237-9702-a69ee7daf093 Sep 08 06:58:00 devstack sudo[117321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:58:02 devstack sudo[117321]: pam_unix(sudo:session): session closed for user root Sep 08 06:58:02 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2c9a587d-9c8b-4e9b-8c0d-d179ef840968 tempest-TestInstancesWithCinderVolumes-616773652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cd6fea82-ef6a-4897-9239-84e3fbc18b74_9obp74trdevstack@QuobyteHD /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2d872c8b-3b02-4237-9702-a69ee7daf093" returned: 0 in 2.120s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:58:02 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-2c9a587d-9c8b-4e9b-8c0d-d179ef840968 tempest-TestInstancesWithCinderVolumes-616773652 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cd6fea82-ef6a-4897-9239-84e3fbc18b74_9obp74trdevstack@QuobyteHD, size 112.00 MB, duration 2.12 sec, destination /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2d872c8b-3b02-4237-9702-a69ee7daf093 {{(pid=87507) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 06:58:02 devstack cinder-volume[87507]: INFO cinder.image.image_utils [None req-2c9a587d-9c8b-4e9b-8c0d-d179ef840968 tempest-TestInstancesWithCinderVolumes-616773652 None] Converted 112.00 MB image at 52.81 MB/s Sep 08 06:58:02 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2c9a587d-9c8b-4e9b-8c0d-d179ef840968 tempest-TestInstancesWithCinderVolumes-616773652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2d872c8b-3b02-4237-9702-a69ee7daf093 1G {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:58:02 devstack sudo[117419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2d872c8b-3b02-4237-9702-a69ee7daf093 1G Sep 08 06:58:02 devstack sudo[117419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:58:02 devstack sudo[117419]: pam_unix(sudo:session): session closed for user root Sep 08 06:58:02 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2c9a587d-9c8b-4e9b-8c0d-d179ef840968 tempest-TestInstancesWithCinderVolumes-616773652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2d872c8b-3b02-4237-9702-a69ee7daf093 1G" returned: 0 in 0.368s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:58:02 devstack cinder-volume[87507]: DEBUG cinder.volume.volume_utils [None req-2c9a587d-9c8b-4e9b-8c0d-d179ef840968 tempest-TestInstancesWithCinderVolumes-616773652 None] Downloaded image cd6fea82-ef6a-4897-9239-84e3fbc18b74 ((None, [{'url': 'file:///opt/stack/data/glance/images/cd6fea82-ef6a-4897-9239-84e3fbc18b74', 'metadata': {}}])) to volume 2d872c8b-3b02-4237-9702-a69ee7daf093 successfully. {{(pid=87507) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 08 06:58:02 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-2c9a587d-9c8b-4e9b-8c0d-d179ef840968 tempest-TestInstancesWithCinderVolumes-616773652 None] Temporary image cd6fea82-ef6a-4897-9239-84e3fbc18b74 for user 3c12c6b786294ed18f34471b232e41d5 is deleted. {{(pid=87507) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 08 06:58:02 devstack cinder-volume[87507]: DEBUG cinder.volume.volume_utils [None req-2c9a587d-9c8b-4e9b-8c0d-d179ef840968 tempest-TestInstancesWithCinderVolumes-616773652 None] Marking volume 2d872c8b-3b02-4237-9702-a69ee7daf093 as bootable. {{(pid=87507) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 08 06:58:02 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c9a587d-9c8b-4e9b-8c0d-d179ef840968 tempest-TestInstancesWithCinderVolumes-616773652 None] Copying metadata from image cd6fea82-ef6a-4897-9239-84e3fbc18b74 to 2d872c8b-3b02-4237-9702-a69ee7daf093. {{(pid=87507) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 08 06:58:02 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c9a587d-9c8b-4e9b-8c0d-d179ef840968 tempest-TestInstancesWithCinderVolumes-616773652 None] Creating volume glance metadata for volume 2d872c8b-3b02-4237-9702-a69ee7daf093 backed by image cd6fea82-ef6a-4897-9239-84e3fbc18b74 with: {'image_id': 'cd6fea82-ef6a-4897-9239-84e3fbc18b74', 'image_name': 'tempest-scenario-img--734964021', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87507) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 08 06:58:02 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2c9a587d-9c8b-4e9b-8c0d-d179ef840968 tempest-TestInstancesWithCinderVolumes-616773652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20f3d767-7374-41a4-bae5-a4033ec8a522) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d872c8b-3b02-4237-9702-a69ee7daf093', 'volume_size': 1, 'image_id': 'cd6fea82-ef6a-4897-9239-84e3fbc18b74', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd6fea82-ef6a-4897-9239-84e3fbc18b74', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--734964021', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e23b473e8bb14331b67a21877e5f5312', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cd6fea82-ef6a-4897-9239-84e3fbc18b74', 'created_at': datetime.datetime(2026, 9, 8, 4, 57, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 4, 57, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd6fea82-ef6a-4897-9239-84e3fbc18b74/file', 'properties': {}}, 'image_service': }' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:58:02 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2c9a587d-9c8b-4e9b-8c0d-d179ef840968 tempest-TestInstancesWithCinderVolumes-616773652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51fa1607-6c40-4dfa-bfc8-3e7b90a6e9dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:58:02 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-2c9a587d-9c8b-4e9b-8c0d-d179ef840968 tempest-TestInstancesWithCinderVolumes-616773652 None] Volume volume-2d872c8b-3b02-4237-9702-a69ee7daf093 (2d872c8b-3b02-4237-9702-a69ee7daf093): created successfully Sep 08 06:58:02 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2c9a587d-9c8b-4e9b-8c0d-d179ef840968 tempest-TestInstancesWithCinderVolumes-616773652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51fa1607-6c40-4dfa-bfc8-3e7b90a6e9dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:58:02 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2c9a587d-9c8b-4e9b-8c0d-d179ef840968 tempest-TestInstancesWithCinderVolumes-616773652 None] Flow 'volume_create_manager' (f963cb07-5d19-4266-b8ff-49fc31b63c2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:58:02 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-2c9a587d-9c8b-4e9b-8c0d-d179ef840968 tempest-TestInstancesWithCinderVolumes-616773652 None] Created volume successfully. Sep 08 06:58:03 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-d450af6b-b7d7-4826-9f6c-0ff622b6406c tempest-TestStampPattern-1549278103 None] Acquiring lock "cinder-7f684664-1b04-419e-a213-2d5d565b04f2-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:58:03 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-d450af6b-b7d7-4826-9f6c-0ff622b6406c tempest-TestStampPattern-1549278103 None] Lock "cinder-7f684664-1b04-419e-a213-2d5d565b04f2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:58:03 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-d450af6b-b7d7-4826-9f6c-0ff622b6406c tempest-TestStampPattern-1549278103 None] Acquiring lock "cinder-quobyte-7f684664-1b04-419e-a213-2d5d565b04f2" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:58:03 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-d450af6b-b7d7-4826-9f6c-0ff622b6406c tempest-TestStampPattern-1549278103 None] Lock "cinder-quobyte-7f684664-1b04-419e-a213-2d5d565b04f2" acquired by "delete_volume" :: waited 0.020s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:58:03 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e9e4dd-d2f0-4981-90a1-ce98b402c62e]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:58:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-d450af6b-b7d7-4826-9f6c-0ff622b6406c tempest-TestStampPattern-1549278103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7f684664-1b04-419e-a213-2d5d565b04f2 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:58:03 devstack sudo[117460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7f684664-1b04-419e-a213-2d5d565b04f2 Sep 08 06:58:03 devstack sudo[117460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:58:03 devstack sudo[117460]: pam_unix(sudo:session): session closed for user root Sep 08 06:58:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-d450af6b-b7d7-4826-9f6c-0ff622b6406c tempest-TestStampPattern-1549278103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7f684664-1b04-419e-a213-2d5d565b04f2" returned: 0 in 0.371s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:58:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-d450af6b-b7d7-4826-9f6c-0ff622b6406c tempest-TestStampPattern-1549278103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7f684664-1b04-419e-a213-2d5d565b04f2 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:58:03 devstack sudo[117474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7f684664-1b04-419e-a213-2d5d565b04f2 Sep 08 06:58:03 devstack sudo[117474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:58:03 devstack sudo[117474]: pam_unix(sudo:session): session closed for user root Sep 08 06:58:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-d450af6b-b7d7-4826-9f6c-0ff622b6406c tempest-TestStampPattern-1549278103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7f684664-1b04-419e-a213-2d5d565b04f2" returned: 0 in 0.248s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:58:03 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-d450af6b-b7d7-4826-9f6c-0ff622b6406c tempest-TestStampPattern-1549278103 None] Lock "cinder-quobyte-7f684664-1b04-419e-a213-2d5d565b04f2" released by "delete_volume" :: held 0.662s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:58:03 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-d450af6b-b7d7-4826-9f6c-0ff622b6406c tempest-TestStampPattern-1549278103 None] Created reservations ['66802295-c34a-4cc8-9460-f29311447bfe', '193d1849-e56a-4500-a555-29696cdc259f', 'd12b3064-589f-4346-86d0-5b7cf32cd4dd', 'fe1aca63-447b-4ab5-89ff-f76e599d06af'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:58:04 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-d450af6b-b7d7-4826-9f6c-0ff622b6406c tempest-TestStampPattern-1549278103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:58:04 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-d450af6b-b7d7-4826-9f6c-0ff622b6406c tempest-TestStampPattern-1549278103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:58:04 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-d450af6b-b7d7-4826-9f6c-0ff622b6406c tempest-TestStampPattern-1549278103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:58:04 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-d450af6b-b7d7-4826-9f6c-0ff622b6406c tempest-TestStampPattern-1549278103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:58:04 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-d450af6b-b7d7-4826-9f6c-0ff622b6406c tempest-TestStampPattern-1549278103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:58:04 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-d450af6b-b7d7-4826-9f6c-0ff622b6406c tempest-TestStampPattern-1549278103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:58:04 devstack sudo[117489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:58:04 devstack sudo[117489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:58:04 devstack sudo[117489]: pam_unix(sudo:session): session closed for user root Sep 08 06:58:04 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-d450af6b-b7d7-4826-9f6c-0ff622b6406c tempest-TestStampPattern-1549278103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.325s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:58:04 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-d450af6b-b7d7-4826-9f6c-0ff622b6406c tempest-TestStampPattern-1549278103 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:58:04 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-d450af6b-b7d7-4826-9f6c-0ff622b6406c tempest-TestStampPattern-1549278103 None] Deleted volume successfully. Sep 08 06:58:04 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-d450af6b-b7d7-4826-9f6c-0ff622b6406c tempest-TestStampPattern-1549278103 None] Lock "cinder-7f684664-1b04-419e-a213-2d5d565b04f2-delete_volume" released by "delete_volume" :: held 1.214s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:58:04 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-beeb8aaa-d863-4509-8ea5-44815c661184 tempest-TestStampPattern-1549278103 None] Acquiring lock "cinder-992b32f6-4a2c-43f4-96d1-2bfdaa469280-delete_snapshot" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:58:04 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-beeb8aaa-d863-4509-8ea5-44815c661184 tempest-TestStampPattern-1549278103 None] Lock "cinder-992b32f6-4a2c-43f4-96d1-2bfdaa469280-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:58:04 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-beeb8aaa-d863-4509-8ea5-44815c661184 tempest-TestStampPattern-1549278103 None] Acquiring lock "cinder-quobyte-d59d0b6e-b8f7-4d08-aff1-01260306dacb" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:58:04 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-beeb8aaa-d863-4509-8ea5-44815c661184 tempest-TestStampPattern-1549278103 None] Lock "cinder-quobyte-d59d0b6e-b8f7-4d08-aff1-01260306dacb" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:58:04 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-beeb8aaa-d863-4509-8ea5-44815c661184 tempest-TestStampPattern-1549278103 None] Acquiring lock "cinder-quobyte-992b32f6-4a2c-43f4-96d1-2bfdaa469280" by "_delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:58:04 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-beeb8aaa-d863-4509-8ea5-44815c661184 tempest-TestStampPattern-1549278103 None] Lock "cinder-quobyte-992b32f6-4a2c-43f4-96d1-2bfdaa469280" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:58:04 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-beeb8aaa-d863-4509-8ea5-44815c661184 tempest-TestStampPattern-1549278103 None] Deleting offline snapshot 992b32f6-4a2c-43f4-96d1-2bfdaa469280 of volume d59d0b6e-b8f7-4d08-aff1-01260306dacb {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 06:58:04 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-beeb8aaa-d863-4509-8ea5-44815c661184 tempest-TestStampPattern-1549278103 None] snapshot_file for this snap is: volume-d59d0b6e-b8f7-4d08-aff1-01260306dacb.992b32f6-4a2c-43f4-96d1-2bfdaa469280 {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 06:58:04 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00c5e7f-281f-4d18-b0d6-2518261f73d5]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:58:04 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-beeb8aaa-d863-4509-8ea5-44815c661184 tempest-TestStampPattern-1549278103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d59d0b6e-b8f7-4d08-aff1-01260306dacb.992b32f6-4a2c-43f4-96d1-2bfdaa469280 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:58:04 devstack sudo[117516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d59d0b6e-b8f7-4d08-aff1-01260306dacb.992b32f6-4a2c-43f4-96d1-2bfdaa469280 Sep 08 06:58:04 devstack sudo[117516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:58:05 devstack sudo[117516]: pam_unix(sudo:session): session closed for user root Sep 08 06:58:05 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-beeb8aaa-d863-4509-8ea5-44815c661184 tempest-TestStampPattern-1549278103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d59d0b6e-b8f7-4d08-aff1-01260306dacb.992b32f6-4a2c-43f4-96d1-2bfdaa469280" returned: 0 in 0.401s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:58:05 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-beeb8aaa-d863-4509-8ea5-44815c661184 tempest-TestStampPattern-1549278103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d59d0b6e-b8f7-4d08-aff1-01260306dacb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 06:58:05 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd39af7e-c7a1-4521-9040-08f1bdbc3680]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:58:05 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-beeb8aaa-d863-4509-8ea5-44815c661184 tempest-TestStampPattern-1549278103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d59d0b6e-b8f7-4d08-aff1-01260306dacb {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:58:05 devstack sudo[117537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d59d0b6e-b8f7-4d08-aff1-01260306dacb Sep 08 06:58:05 devstack sudo[117537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:58:05 devstack sudo[117537]: pam_unix(sudo:session): session closed for user root Sep 08 06:58:05 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-beeb8aaa-d863-4509-8ea5-44815c661184 tempest-TestStampPattern-1549278103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d59d0b6e-b8f7-4d08-aff1-01260306dacb" returned: 0 in 0.616s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:58:05 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-beeb8aaa-d863-4509-8ea5-44815c661184 tempest-TestStampPattern-1549278103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d59d0b6e-b8f7-4d08-aff1-01260306dacb.992b32f6-4a2c-43f4-96d1-2bfdaa469280 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:58:05 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-edf282fe-29c7-46f9-80fa-06df3027c3b2 req-6a31b29a-1558-458c-a442-178e175f6cc4 tempest-TestInstancesWithCinderVolumes-616773652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:58:05 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-edf282fe-29c7-46f9-80fa-06df3027c3b2 req-6a31b29a-1558-458c-a442-178e175f6cc4 tempest-TestInstancesWithCinderVolumes-616773652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:58:05 devstack sudo[117568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d59d0b6e-b8f7-4d08-aff1-01260306dacb.992b32f6-4a2c-43f4-96d1-2bfdaa469280 Sep 08 06:58:05 devstack sudo[117568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:58:05 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-edf282fe-29c7-46f9-80fa-06df3027c3b2 req-6a31b29a-1558-458c-a442-178e175f6cc4 tempest-TestInstancesWithCinderVolumes-616773652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:58:05 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-edf282fe-29c7-46f9-80fa-06df3027c3b2 req-6a31b29a-1558-458c-a442-178e175f6cc4 tempest-TestInstancesWithCinderVolumes-616773652 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d', 'name': 'volume-2d872c8b-3b02-4237-9702-a69ee7daf093', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e9257a86-3573-49d1-8515-f0876e0a65d8', 'enforce_multipath': True} {{(pid=87507) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 06:58:05 devstack cinder-volume[87507]: INFO cinder.volume.manager [req-edf282fe-29c7-46f9-80fa-06df3027c3b2 req-6a31b29a-1558-458c-a442-178e175f6cc4 tempest-TestInstancesWithCinderVolumes-616773652 None] attachment_update completed successfully. Sep 08 06:58:06 devstack sudo[117568]: pam_unix(sudo:session): session closed for user root Sep 08 06:58:06 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-beeb8aaa-d863-4509-8ea5-44815c661184 tempest-TestStampPattern-1549278103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d59d0b6e-b8f7-4d08-aff1-01260306dacb.992b32f6-4a2c-43f4-96d1-2bfdaa469280" returned: 0 in 0.493s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:58:06 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-beeb8aaa-d863-4509-8ea5-44815c661184 tempest-TestStampPattern-1549278103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d59d0b6e-b8f7-4d08-aff1-01260306dacb.992b32f6-4a2c-43f4-96d1-2bfdaa469280 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:58:06 devstack sudo[117589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d59d0b6e-b8f7-4d08-aff1-01260306dacb.992b32f6-4a2c-43f4-96d1-2bfdaa469280 Sep 08 06:58:06 devstack sudo[117589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:58:06 devstack sudo[117589]: pam_unix(sudo:session): session closed for user root Sep 08 06:58:06 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-beeb8aaa-d863-4509-8ea5-44815c661184 tempest-TestStampPattern-1549278103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d59d0b6e-b8f7-4d08-aff1-01260306dacb.992b32f6-4a2c-43f4-96d1-2bfdaa469280" returned: 0 in 0.271s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:58:06 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-beeb8aaa-d863-4509-8ea5-44815c661184 tempest-TestStampPattern-1549278103 None] Lock "cinder-quobyte-992b32f6-4a2c-43f4-96d1-2bfdaa469280" released by "_delete_snapshot" :: held 1.902s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:58:06 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-beeb8aaa-d863-4509-8ea5-44815c661184 tempest-TestStampPattern-1549278103 None] Lock "cinder-quobyte-d59d0b6e-b8f7-4d08-aff1-01260306dacb" released by "delete_snapshot" :: held 1.927s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:58:06 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-beeb8aaa-d863-4509-8ea5-44815c661184 tempest-TestStampPattern-1549278103 None] Created reservations ['f4e94809-7a79-45d2-b725-f6e6fdb10618', '1bcbb427-1cd3-463a-afa6-6b18e36f67c5', '5c62665e-1314-4c76-b2c6-880c931f67e1', '89cae4c8-ca3a-40f8-9b32-43d1ee29cfea'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:58:06 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-beeb8aaa-d863-4509-8ea5-44815c661184 tempest-TestStampPattern-1549278103 None] Delete snapshot completed successfully. Sep 08 06:58:06 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-beeb8aaa-d863-4509-8ea5-44815c661184 tempest-TestStampPattern-1549278103 None] Lock "cinder-992b32f6-4a2c-43f4-96d1-2bfdaa469280-delete_snapshot" released by "delete_snapshot" :: held 2.098s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:58:11 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-e52fa378-966e-4ac2-a93d-0b41184fac8e tempest-TestStampPattern-1549278103 None] Acquiring lock "cinder-d59d0b6e-b8f7-4d08-aff1-01260306dacb-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:58:11 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-e52fa378-966e-4ac2-a93d-0b41184fac8e tempest-TestStampPattern-1549278103 None] Lock "cinder-d59d0b6e-b8f7-4d08-aff1-01260306dacb-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:58:11 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-e52fa378-966e-4ac2-a93d-0b41184fac8e tempest-TestStampPattern-1549278103 None] Acquiring lock "cinder-quobyte-d59d0b6e-b8f7-4d08-aff1-01260306dacb" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:58:11 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-e52fa378-966e-4ac2-a93d-0b41184fac8e tempest-TestStampPattern-1549278103 None] Lock "cinder-quobyte-d59d0b6e-b8f7-4d08-aff1-01260306dacb" acquired by "delete_volume" :: waited 0.020s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:58:11 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb63a85-8c74-4ad7-a5be-73679d1608d0]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:58:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e52fa378-966e-4ac2-a93d-0b41184fac8e tempest-TestStampPattern-1549278103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d59d0b6e-b8f7-4d08-aff1-01260306dacb {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:58:11 devstack sudo[118201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d59d0b6e-b8f7-4d08-aff1-01260306dacb Sep 08 06:58:11 devstack sudo[118201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:58:11 devstack sudo[118201]: pam_unix(sudo:session): session closed for user root Sep 08 06:58:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e52fa378-966e-4ac2-a93d-0b41184fac8e tempest-TestStampPattern-1549278103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d59d0b6e-b8f7-4d08-aff1-01260306dacb" returned: 0 in 0.352s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:58:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e52fa378-966e-4ac2-a93d-0b41184fac8e tempest-TestStampPattern-1549278103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d59d0b6e-b8f7-4d08-aff1-01260306dacb {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:58:11 devstack sudo[118218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d59d0b6e-b8f7-4d08-aff1-01260306dacb Sep 08 06:58:11 devstack sudo[118218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:58:11 devstack sudo[118218]: pam_unix(sudo:session): session closed for user root Sep 08 06:58:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e52fa378-966e-4ac2-a93d-0b41184fac8e tempest-TestStampPattern-1549278103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d59d0b6e-b8f7-4d08-aff1-01260306dacb" returned: 0 in 0.239s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:58:11 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-e52fa378-966e-4ac2-a93d-0b41184fac8e tempest-TestStampPattern-1549278103 None] Lock "cinder-quobyte-d59d0b6e-b8f7-4d08-aff1-01260306dacb" released by "delete_volume" :: held 0.644s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:58:11 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-e52fa378-966e-4ac2-a93d-0b41184fac8e tempest-TestStampPattern-1549278103 None] Created reservations ['28f53b2e-0671-4eec-bd74-ed041535cbee', 'd5eb9bbe-28ee-4be2-926c-f5396e53c7be', 'ee09dda5-96a2-47b1-b050-981d438c818a', 'ff5f8987-13f0-4b4e-9994-ca0fc1994c85'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:58:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-e52fa378-966e-4ac2-a93d-0b41184fac8e tempest-TestStampPattern-1549278103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:58:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-e52fa378-966e-4ac2-a93d-0b41184fac8e tempest-TestStampPattern-1549278103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:58:11 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-e52fa378-966e-4ac2-a93d-0b41184fac8e tempest-TestStampPattern-1549278103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:58:11 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-e52fa378-966e-4ac2-a93d-0b41184fac8e tempest-TestStampPattern-1549278103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:58:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-e52fa378-966e-4ac2-a93d-0b41184fac8e tempest-TestStampPattern-1549278103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:58:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e52fa378-966e-4ac2-a93d-0b41184fac8e tempest-TestStampPattern-1549278103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:58:11 devstack sudo[118230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:58:11 devstack sudo[118230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:58:12 devstack sudo[118230]: pam_unix(sudo:session): session closed for user root Sep 08 06:58:12 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e52fa378-966e-4ac2-a93d-0b41184fac8e tempest-TestStampPattern-1549278103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.311s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:58:12 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-e52fa378-966e-4ac2-a93d-0b41184fac8e tempest-TestStampPattern-1549278103 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:58:12 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-e52fa378-966e-4ac2-a93d-0b41184fac8e tempest-TestStampPattern-1549278103 None] Deleted volume successfully. Sep 08 06:58:12 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-e52fa378-966e-4ac2-a93d-0b41184fac8e tempest-TestStampPattern-1549278103 None] Lock "cinder-d59d0b6e-b8f7-4d08-aff1-01260306dacb-delete_volume" released by "delete_volume" :: held 1.184s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:58:20 devstack cinder-volume[87507]: DEBUG oslo_service.periodic_task [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87507) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 06:58:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:58:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:58:20 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:58:20 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:58:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:58:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:58:20 devstack sudo[118486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:58:20 devstack sudo[118486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:58:20 devstack sudo[118486]: pam_unix(sudo:session): session closed for user root Sep 08 06:58:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.372s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:58:20 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:58:20 devstack cinder-volume[87507]: DEBUG oslo_service.periodic_task [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Running periodic task VolumeManager._thread_info {{(pid=87507) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 06:58:20 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] thread count: 29 {{(pid=87507) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 06:58:20 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] thread info: [<_MainThread(MainThread, started 127913129345152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87507) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 06:58:21 devstack cinder-volume[87507]: DEBUG dbcounter [-] [87507] Writing DB stats cinder:UPDATE=33,cinder:SELECT=42,cinder:INSERT=12,cinder:DELETE=1 {{(pid=87507) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 06:58:22 devstack cinder-volume[87507]: DEBUG dbcounter [-] [87507] Writing DB stats cinder:SELECT=40,cinder:UPDATE=37,cinder:DELETE=4,cinder:INSERT=12 {{(pid=87507) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 06:58:29 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:58:29 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Flow 'volume_create_manager' (b5235d5b-dc48-45a5-a3d2-bfad83077ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:58:29 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a46c4983-3e54-4a0c-8f2e-89cfd0a5ae66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:58:29 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a46c4983-3e54-4a0c-8f2e-89cfd0a5ae66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:58:30Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7c3f73e-53cf-4357-ba49-b276bf4e4434,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07d57fe6bc594a6abe7ba676521ec2e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:58:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:58:30Z,use_quota=True,user_id='7f9b457cf567458e87c8d0d8d1f9834f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1c44571-5363-4778-a1de-98b2dad30b54),volume_type_id=d1c44571-5363-4778-a1de-98b2dad30b54)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:58:29 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b6b4502-4b3c-43d7-8089-5abcd1f36f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:58:29 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b6b4502-4b3c-43d7-8089-5abcd1f36f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:58:29 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ddbe263-21f7-42c0-8168-0c356e56c9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:58:30 devstack cinder-volume[87507]: DEBUG cinder.image.glance [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Creating Keystone auth plugin from conf {{(pid=87507) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 08 06:58:30 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ddbe263-21f7-42c0-8168-0c356e56c9ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b7c3f73e-53cf-4357-ba49-b276bf4e4434', 'volume_name': 'volume-b7c3f73e-53cf-4357-ba49-b276bf4e4434', 'volume_size': 1, 'image_id': '33ce1e57-e89a-41d9-8ed9-298a22eb1367', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/33ce1e57-e89a-41d9-8ed9-298a22eb1367', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e0f4997693bec08673429b626a33def5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '07d57fe6bc594a6abe7ba676521ec2e8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'edd823453398ca2352be9cb32ab6db524a6821d809e24c06d3bc55b3c914583fc3ca348418851ca10f49bb7e1daef854418f1befb54e39d5966b8443e62e306c', 'id': '33ce1e57-e89a-41d9-8ed9-298a22eb1367', 'created_at': datetime.datetime(2026, 9, 8, 4, 58, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 4, 58, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33ce1e57-e89a-41d9-8ed9-298a22eb1367/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:58:30 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8bd1cbc-aa60-475a-8c15-cb541c2a6d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:58:30 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8bd1cbc-aa60-475a-8c15-cb541c2a6d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:58:30 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c15f4c5c-6375-4d9a-9f67-188ac2b9529d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:58:30 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Volume b7c3f73e-53cf-4357-ba49-b276bf4e4434: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b7c3f73e-53cf-4357-ba49-b276bf4e4434', 'volume_size': 1, 'image_id': '33ce1e57-e89a-41d9-8ed9-298a22eb1367', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/33ce1e57-e89a-41d9-8ed9-298a22eb1367', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e0f4997693bec08673429b626a33def5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '07d57fe6bc594a6abe7ba676521ec2e8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'edd823453398ca2352be9cb32ab6db524a6821d809e24c06d3bc55b3c914583fc3ca348418851ca10f49bb7e1daef854418f1befb54e39d5966b8443e62e306c', 'id': '33ce1e57-e89a-41d9-8ed9-298a22eb1367', 'created_at': datetime.datetime(2026, 9, 8, 4, 58, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 4, 58, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33ce1e57-e89a-41d9-8ed9-298a22eb1367/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 08 06:58:30 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Trying to clone b7c3f73e-53cf-4357-ba49-b276bf4e4434 from image 33ce1e57-e89a-41d9-8ed9-298a22eb1367 at location (None, [{'url': 'file:///opt/stack/data/glance/images/33ce1e57-e89a-41d9-8ed9-298a22eb1367', 'metadata': {}}]). {{(pid=87507) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 08 06:58:30 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_33ce1e57-e89a-41d9-8ed9-298a22eb1367_a2q3gp71devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87507) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 08 06:58:30 devstack cinder-volume[87507]: INFO cinder.image.image_utils [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Image download 0.00 MB at 0.00 MB/s Sep 08 06:58:30 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[754a6d8e-b249-4348-a6e9-b5c364f8d60c]: (4, 'raw') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:58:30 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_33ce1e57-e89a-41d9-8ed9-298a22eb1367_a2q3gp71devstack@QuobyteHD {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:58:30 devstack sudo[118874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_33ce1e57-e89a-41d9-8ed9-298a22eb1367_a2q3gp71devstack@QuobyteHD Sep 08 06:58:30 devstack sudo[118874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:58:30 devstack sudo[118874]: pam_unix(sudo:session): session closed for user root Sep 08 06:58:30 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_33ce1e57-e89a-41d9-8ed9-298a22eb1367_a2q3gp71devstack@QuobyteHD" returned: 0 in 0.320s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:58:30 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33ce1e57-e89a-41d9-8ed9-298a22eb1367_a2q3gp71devstack@QuobyteHD {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:58:30 devstack sudo[118887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33ce1e57-e89a-41d9-8ed9-298a22eb1367_a2q3gp71devstack@QuobyteHD Sep 08 06:58:30 devstack sudo[118887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:58:31 devstack sudo[118887]: pam_unix(sudo:session): session closed for user root Sep 08 06:58:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33ce1e57-e89a-41d9-8ed9-298a22eb1367_a2q3gp71devstack@QuobyteHD" returned: 1 in 0.331s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:58:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33ce1e57-e89a-41d9-8ed9-298a22eb1367_a2q3gp71devstack@QuobyteHD' failed. Not Retrying. {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 06:58:31 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Temporary image 33ce1e57-e89a-41d9-8ed9-298a22eb1367 is fetched for user 7f9b457cf567458e87c8d0d8d1f9834f. {{(pid=87507) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 08 06:58:31 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9112a244-e8d0-440f-9aab-1f084c19b94c]: (4, 'raw') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:58:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_33ce1e57-e89a-41d9-8ed9-298a22eb1367_a2q3gp71devstack@QuobyteHD {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:58:31 devstack sudo[118904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_33ce1e57-e89a-41d9-8ed9-298a22eb1367_a2q3gp71devstack@QuobyteHD Sep 08 06:58:31 devstack sudo[118904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:58:31 devstack sudo[118904]: pam_unix(sudo:session): session closed for user root Sep 08 06:58:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_33ce1e57-e89a-41d9-8ed9-298a22eb1367_a2q3gp71devstack@QuobyteHD" returned: 0 in 0.315s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:58:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33ce1e57-e89a-41d9-8ed9-298a22eb1367_a2q3gp71devstack@QuobyteHD {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:58:31 devstack sudo[118917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33ce1e57-e89a-41d9-8ed9-298a22eb1367_a2q3gp71devstack@QuobyteHD Sep 08 06:58:31 devstack sudo[118917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:58:31 devstack sudo[118917]: pam_unix(sudo:session): session closed for user root Sep 08 06:58:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33ce1e57-e89a-41d9-8ed9-298a22eb1367_a2q3gp71devstack@QuobyteHD" returned: 1 in 0.317s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:58:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33ce1e57-e89a-41d9-8ed9-298a22eb1367_a2q3gp71devstack@QuobyteHD' failed. Not Retrying. {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 06:58:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:58:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:58:31 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:58:30Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7c3f73e-53cf-4357-ba49-b276bf4e4434,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07d57fe6bc594a6abe7ba676521ec2e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:58:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:58:30Z,use_quota=True,user_id='7f9b457cf567458e87c8d0d8d1f9834f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1c44571-5363-4778-a1de-98b2dad30b54),volume_type_id=d1c44571-5363-4778-a1de-98b2dad30b54)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:58:31 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Creating volume b7c3f73e-53cf-4357-ba49-b276bf4e4434 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:58:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:58:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:58:31 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:58:31 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:58:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:58:31 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:58:31 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:58:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b7c3f73e-53cf-4357-ba49-b276bf4e4434 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:58:31 devstack sudo[118932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b7c3f73e-53cf-4357-ba49-b276bf4e4434 1073741824 Sep 08 06:58:31 devstack sudo[118932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:58:32 devstack sudo[118932]: pam_unix(sudo:session): session closed for user root Sep 08 06:58:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b7c3f73e-53cf-4357-ba49-b276bf4e4434 1073741824" returned: 0 in 0.402s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:58:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b7c3f73e-53cf-4357-ba49-b276bf4e4434 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:58:32 devstack sudo[118952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b7c3f73e-53cf-4357-ba49-b276bf4e4434 Sep 08 06:58:32 devstack sudo[118952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:58:32 devstack sudo[118952]: pam_unix(sudo:session): session closed for user root Sep 08 06:58:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b7c3f73e-53cf-4357-ba49-b276bf4e4434" returned: 0 in 0.242s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:58:32 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:58:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:58:32 devstack cinder-volume[87507]: DEBUG cinder.volume.volume_utils [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Attempting download of 33ce1e57-e89a-41d9-8ed9-298a22eb1367 ((None, [{'url': 'file:///opt/stack/data/glance/images/33ce1e57-e89a-41d9-8ed9-298a22eb1367', 'metadata': {}}])) to volume b7c3f73e-53cf-4357-ba49-b276bf4e4434. {{(pid=87507) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 08 06:58:32 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c0b534-0dc4-4d05-a556-b32f1b70437c]: (4, 'raw') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:58:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_33ce1e57-e89a-41d9-8ed9-298a22eb1367_mbqknvzj {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:58:32 devstack sudo[118964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_33ce1e57-e89a-41d9-8ed9-298a22eb1367_mbqknvzj Sep 08 06:58:32 devstack sudo[118964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:58:32 devstack sudo[118964]: pam_unix(sudo:session): session closed for user root Sep 08 06:58:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_33ce1e57-e89a-41d9-8ed9-298a22eb1367_mbqknvzj" returned: 0 in 0.316s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:58:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_33ce1e57-e89a-41d9-8ed9-298a22eb1367_mbqknvzj {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:58:32 devstack sudo[118977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_33ce1e57-e89a-41d9-8ed9-298a22eb1367_mbqknvzj Sep 08 06:58:32 devstack sudo[118977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:58:33 devstack sudo[118977]: pam_unix(sudo:session): session closed for user root Sep 08 06:58:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_33ce1e57-e89a-41d9-8ed9-298a22eb1367_mbqknvzj" returned: 1 in 0.320s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:58:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_33ce1e57-e89a-41d9-8ed9-298a22eb1367_mbqknvzj' failed. Not Retrying. {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 06:58:33 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6a34b8-ad95-4111-b30c-8f4351f443f1]: (4, 'raw') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:58:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_33ce1e57-e89a-41d9-8ed9-298a22eb1367_a2q3gp71devstack@QuobyteHD {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:58:33 devstack sudo[118990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_33ce1e57-e89a-41d9-8ed9-298a22eb1367_a2q3gp71devstack@QuobyteHD Sep 08 06:58:33 devstack sudo[118990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:58:33 devstack sudo[118990]: pam_unix(sudo:session): session closed for user root Sep 08 06:58:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_33ce1e57-e89a-41d9-8ed9-298a22eb1367_a2q3gp71devstack@QuobyteHD" returned: 0 in 0.321s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:58:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33ce1e57-e89a-41d9-8ed9-298a22eb1367_a2q3gp71devstack@QuobyteHD {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:58:33 devstack sudo[119005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33ce1e57-e89a-41d9-8ed9-298a22eb1367_a2q3gp71devstack@QuobyteHD Sep 08 06:58:33 devstack sudo[119005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:58:33 devstack sudo[119005]: pam_unix(sudo:session): session closed for user root Sep 08 06:58:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33ce1e57-e89a-41d9-8ed9-298a22eb1367_a2q3gp71devstack@QuobyteHD" returned: 1 in 0.327s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:58:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33ce1e57-e89a-41d9-8ed9-298a22eb1367_a2q3gp71devstack@QuobyteHD' failed. Not Retrying. {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 06:58:33 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] 33ce1e57-e89a-41d9-8ed9-298a22eb1367 was raw, converting to qcow2 {{(pid=87507) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 08 06:58:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_33ce1e57-e89a-41d9-8ed9-298a22eb1367_a2q3gp71devstack@QuobyteHD /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b7c3f73e-53cf-4357-ba49-b276bf4e4434 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:58:33 devstack sudo[119020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_33ce1e57-e89a-41d9-8ed9-298a22eb1367_a2q3gp71devstack@QuobyteHD /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b7c3f73e-53cf-4357-ba49-b276bf4e4434 Sep 08 06:58:33 devstack sudo[119020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:58:34 devstack sudo[119020]: pam_unix(sudo:session): session closed for user root Sep 08 06:58:34 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_33ce1e57-e89a-41d9-8ed9-298a22eb1367_a2q3gp71devstack@QuobyteHD /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b7c3f73e-53cf-4357-ba49-b276bf4e4434" returned: 0 in 0.429s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:58:34 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_33ce1e57-e89a-41d9-8ed9-298a22eb1367_a2q3gp71devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b7c3f73e-53cf-4357-ba49-b276bf4e4434 {{(pid=87507) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 06:58:34 devstack cinder-volume[87507]: INFO cinder.image.image_utils [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Converted 0.00 MB image at 0.00 MB/s Sep 08 06:58:34 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b7c3f73e-53cf-4357-ba49-b276bf4e4434 1G {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:58:34 devstack sudo[119037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b7c3f73e-53cf-4357-ba49-b276bf4e4434 1G Sep 08 06:58:34 devstack sudo[119037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:58:34 devstack sudo[119037]: pam_unix(sudo:session): session closed for user root Sep 08 06:58:34 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b7c3f73e-53cf-4357-ba49-b276bf4e4434 1G" returned: 0 in 0.296s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:58:34 devstack cinder-volume[87507]: DEBUG cinder.volume.volume_utils [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Downloaded image 33ce1e57-e89a-41d9-8ed9-298a22eb1367 ((None, [{'url': 'file:///opt/stack/data/glance/images/33ce1e57-e89a-41d9-8ed9-298a22eb1367', 'metadata': {}}])) to volume b7c3f73e-53cf-4357-ba49-b276bf4e4434 successfully. {{(pid=87507) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 08 06:58:34 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Temporary image 33ce1e57-e89a-41d9-8ed9-298a22eb1367 for user 7f9b457cf567458e87c8d0d8d1f9834f is deleted. {{(pid=87507) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 08 06:58:34 devstack cinder-volume[87507]: DEBUG cinder.volume.volume_utils [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Marking volume b7c3f73e-53cf-4357-ba49-b276bf4e4434 as bootable. {{(pid=87507) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 08 06:58:34 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Copying metadata from image 33ce1e57-e89a-41d9-8ed9-298a22eb1367 to b7c3f73e-53cf-4357-ba49-b276bf4e4434. {{(pid=87507) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 08 06:58:34 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Creating volume glance metadata for volume b7c3f73e-53cf-4357-ba49-b276bf4e4434 backed by image 33ce1e57-e89a-41d9-8ed9-298a22eb1367 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '33ce1e57-e89a-41d9-8ed9-298a22eb1367', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'e0f4997693bec08673429b626a33def5', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87507) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 08 06:58:34 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c15f4c5c-6375-4d9a-9f67-188ac2b9529d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7c3f73e-53cf-4357-ba49-b276bf4e4434', 'volume_size': 1, 'image_id': '33ce1e57-e89a-41d9-8ed9-298a22eb1367', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/33ce1e57-e89a-41d9-8ed9-298a22eb1367', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e0f4997693bec08673429b626a33def5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '07d57fe6bc594a6abe7ba676521ec2e8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'edd823453398ca2352be9cb32ab6db524a6821d809e24c06d3bc55b3c914583fc3ca348418851ca10f49bb7e1daef854418f1befb54e39d5966b8443e62e306c', 'id': '33ce1e57-e89a-41d9-8ed9-298a22eb1367', 'created_at': datetime.datetime(2026, 9, 8, 4, 58, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 4, 58, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33ce1e57-e89a-41d9-8ed9-298a22eb1367/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:58:34 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fe950d6-8f3b-48dc-a98e-78bc5a4cdb9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:58:34 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Volume volume-b7c3f73e-53cf-4357-ba49-b276bf4e4434 (b7c3f73e-53cf-4357-ba49-b276bf4e4434): created successfully Sep 08 06:58:34 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fe950d6-8f3b-48dc-a98e-78bc5a4cdb9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:58:34 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Flow 'volume_create_manager' (b5235d5b-dc48-45a5-a3d2-bfad83077ac3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:58:34 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-818e91ea-21ae-435f-8041-5863bea942a4 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Created volume successfully. Sep 08 06:58:35 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-736ebd8e-4559-462c-a2e4-ec92b5d6b520 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Acquiring lock "cinder-b7c3f73e-53cf-4357-ba49-b276bf4e4434-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:58:35 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-736ebd8e-4559-462c-a2e4-ec92b5d6b520 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Lock "cinder-b7c3f73e-53cf-4357-ba49-b276bf4e4434-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:58:35 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-736ebd8e-4559-462c-a2e4-ec92b5d6b520 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Acquiring lock "cinder-quobyte-b7c3f73e-53cf-4357-ba49-b276bf4e4434" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:58:35 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-736ebd8e-4559-462c-a2e4-ec92b5d6b520 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Lock "cinder-quobyte-b7c3f73e-53cf-4357-ba49-b276bf4e4434" acquired by "delete_volume" :: waited 0.016s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:58:35 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f77cf99-c38a-49b8-a240-ef1b69b38ab8]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:58:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-736ebd8e-4559-462c-a2e4-ec92b5d6b520 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b7c3f73e-53cf-4357-ba49-b276bf4e4434 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:58:35 devstack sudo[119076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b7c3f73e-53cf-4357-ba49-b276bf4e4434 Sep 08 06:58:35 devstack sudo[119076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:58:35 devstack sudo[119076]: pam_unix(sudo:session): session closed for user root Sep 08 06:58:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-736ebd8e-4559-462c-a2e4-ec92b5d6b520 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b7c3f73e-53cf-4357-ba49-b276bf4e4434" returned: 0 in 0.364s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:58:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-736ebd8e-4559-462c-a2e4-ec92b5d6b520 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b7c3f73e-53cf-4357-ba49-b276bf4e4434 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:58:35 devstack sudo[119099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b7c3f73e-53cf-4357-ba49-b276bf4e4434 Sep 08 06:58:35 devstack sudo[119099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:58:35 devstack sudo[119099]: pam_unix(sudo:session): session closed for user root Sep 08 06:58:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-736ebd8e-4559-462c-a2e4-ec92b5d6b520 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b7c3f73e-53cf-4357-ba49-b276bf4e4434" returned: 0 in 0.269s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:58:35 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-736ebd8e-4559-462c-a2e4-ec92b5d6b520 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Lock "cinder-quobyte-b7c3f73e-53cf-4357-ba49-b276bf4e4434" released by "delete_volume" :: held 0.674s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:58:36 devstack cinder-volume[87507]: WARNING cinder.quota [None req-736ebd8e-4559-462c-a2e4-ec92b5d6b520 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 08 06:58:36 devstack cinder-volume[87507]: WARNING cinder.quota [None req-736ebd8e-4559-462c-a2e4-ec92b5d6b520 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 08 06:58:36 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-736ebd8e-4559-462c-a2e4-ec92b5d6b520 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Created reservations ['51d9bd34-d90b-43f5-84ad-e70c11cd5540', 'cd38421e-b659-4509-896e-decd44f9b225', '5fff82da-25b2-431f-9f03-cc4df447c822', '83fe7a94-c4e1-4301-b6d6-66a2357410e1'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:58:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-736ebd8e-4559-462c-a2e4-ec92b5d6b520 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:58:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-736ebd8e-4559-462c-a2e4-ec92b5d6b520 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:58:36 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-736ebd8e-4559-462c-a2e4-ec92b5d6b520 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:58:36 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-736ebd8e-4559-462c-a2e4-ec92b5d6b520 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:58:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-736ebd8e-4559-462c-a2e4-ec92b5d6b520 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:58:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-736ebd8e-4559-462c-a2e4-ec92b5d6b520 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:58:36 devstack sudo[119117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:58:36 devstack sudo[119117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:58:36 devstack sudo[119117]: pam_unix(sudo:session): session closed for user root Sep 08 06:58:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-736ebd8e-4559-462c-a2e4-ec92b5d6b520 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.282s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:58:36 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-736ebd8e-4559-462c-a2e4-ec92b5d6b520 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:58:36 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-736ebd8e-4559-462c-a2e4-ec92b5d6b520 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Deleted volume successfully. Sep 08 06:58:36 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-736ebd8e-4559-462c-a2e4-ec92b5d6b520 tempest-VolumeAndVolumeTypeFromImageTest-598626996 None] Lock "cinder-b7c3f73e-53cf-4357-ba49-b276bf4e4434-delete_volume" released by "delete_volume" :: held 1.263s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:58:40 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-457fc4e5-9e22-4f3b-83ba-226456e24837 tempest-VolumeDependencyTests-690845755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:58:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-457fc4e5-9e22-4f3b-83ba-226456e24837 tempest-VolumeDependencyTests-690845755 None] Flow 'volume_create_manager' (e5fdb066-afbf-45f2-bc27-a737906380ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:58:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-457fc4e5-9e22-4f3b-83ba-226456e24837 tempest-VolumeDependencyTests-690845755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46a799bc-16a5-49f7-b452-4f55998337a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:58:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-457fc4e5-9e22-4f3b-83ba-226456e24837 tempest-VolumeDependencyTests-690845755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46a799bc-16a5-49f7-b452-4f55998337a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:58:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-401334373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a27edc59-8fbc-4bef-b328-cf65425d7056,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e8c791ed18c4821a095762696a780c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:58:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:58:40Z,use_quota=True,user_id='f818b6995e01414d920ae54ef9930e66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:58:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-457fc4e5-9e22-4f3b-83ba-226456e24837 tempest-VolumeDependencyTests-690845755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb76d15f-1f14-4873-937b-074649dc57e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:58:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-457fc4e5-9e22-4f3b-83ba-226456e24837 tempest-VolumeDependencyTests-690845755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb76d15f-1f14-4873-937b-074649dc57e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:58:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-457fc4e5-9e22-4f3b-83ba-226456e24837 tempest-VolumeDependencyTests-690845755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae6bab48-4452-4f2c-ad1d-e0be02263afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:58:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-457fc4e5-9e22-4f3b-83ba-226456e24837 tempest-VolumeDependencyTests-690845755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae6bab48-4452-4f2c-ad1d-e0be02263afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a27edc59-8fbc-4bef-b328-cf65425d7056', 'volume_name': 'volume-a27edc59-8fbc-4bef-b328-cf65425d7056', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:58:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-457fc4e5-9e22-4f3b-83ba-226456e24837 tempest-VolumeDependencyTests-690845755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af117b4e-bbb2-4a6e-86ff-8d1cd18547f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:58:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-457fc4e5-9e22-4f3b-83ba-226456e24837 tempest-VolumeDependencyTests-690845755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af117b4e-bbb2-4a6e-86ff-8d1cd18547f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:58:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-457fc4e5-9e22-4f3b-83ba-226456e24837 tempest-VolumeDependencyTests-690845755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0721e858-40be-4f92-9efe-ade604aaa892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:58:40 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-457fc4e5-9e22-4f3b-83ba-226456e24837 tempest-VolumeDependencyTests-690845755 None] Volume a27edc59-8fbc-4bef-b328-cf65425d7056: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a27edc59-8fbc-4bef-b328-cf65425d7056', 'volume_size': 1} Sep 08 06:58:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-457fc4e5-9e22-4f3b-83ba-226456e24837 tempest-VolumeDependencyTests-690845755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:58:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-457fc4e5-9e22-4f3b-83ba-226456e24837 tempest-VolumeDependencyTests-690845755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:58:40 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-457fc4e5-9e22-4f3b-83ba-226456e24837 tempest-VolumeDependencyTests-690845755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:58:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-401334373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a27edc59-8fbc-4bef-b328-cf65425d7056,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e8c791ed18c4821a095762696a780c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:58:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:58:40Z,use_quota=True,user_id='f818b6995e01414d920ae54ef9930e66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:58:40 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-457fc4e5-9e22-4f3b-83ba-226456e24837 tempest-VolumeDependencyTests-690845755 None] Creating volume a27edc59-8fbc-4bef-b328-cf65425d7056 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:58:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-457fc4e5-9e22-4f3b-83ba-226456e24837 tempest-VolumeDependencyTests-690845755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:58:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-457fc4e5-9e22-4f3b-83ba-226456e24837 tempest-VolumeDependencyTests-690845755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:58:40 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-457fc4e5-9e22-4f3b-83ba-226456e24837 tempest-VolumeDependencyTests-690845755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:58:40 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-457fc4e5-9e22-4f3b-83ba-226456e24837 tempest-VolumeDependencyTests-690845755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:58:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-457fc4e5-9e22-4f3b-83ba-226456e24837 tempest-VolumeDependencyTests-690845755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:58:40 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-457fc4e5-9e22-4f3b-83ba-226456e24837 tempest-VolumeDependencyTests-690845755 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:58:40 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-457fc4e5-9e22-4f3b-83ba-226456e24837 tempest-VolumeDependencyTests-690845755 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:58:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-457fc4e5-9e22-4f3b-83ba-226456e24837 tempest-VolumeDependencyTests-690845755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a27edc59-8fbc-4bef-b328-cf65425d7056 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:58:40 devstack sudo[119251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a27edc59-8fbc-4bef-b328-cf65425d7056 1073741824 Sep 08 06:58:40 devstack sudo[119251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:58:40 devstack sudo[119251]: pam_unix(sudo:session): session closed for user root Sep 08 06:58:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-457fc4e5-9e22-4f3b-83ba-226456e24837 tempest-VolumeDependencyTests-690845755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a27edc59-8fbc-4bef-b328-cf65425d7056 1073741824" returned: 0 in 0.402s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:58:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-457fc4e5-9e22-4f3b-83ba-226456e24837 tempest-VolumeDependencyTests-690845755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a27edc59-8fbc-4bef-b328-cf65425d7056 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:58:41 devstack sudo[119268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a27edc59-8fbc-4bef-b328-cf65425d7056 Sep 08 06:58:41 devstack sudo[119268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:58:41 devstack sudo[119268]: pam_unix(sudo:session): session closed for user root Sep 08 06:58:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-457fc4e5-9e22-4f3b-83ba-226456e24837 tempest-VolumeDependencyTests-690845755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a27edc59-8fbc-4bef-b328-cf65425d7056" returned: 0 in 0.256s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:58:41 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-457fc4e5-9e22-4f3b-83ba-226456e24837 tempest-VolumeDependencyTests-690845755 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:58:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-457fc4e5-9e22-4f3b-83ba-226456e24837 tempest-VolumeDependencyTests-690845755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:58:41 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-457fc4e5-9e22-4f3b-83ba-226456e24837 tempest-VolumeDependencyTests-690845755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0721e858-40be-4f92-9efe-ade604aaa892) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a27edc59-8fbc-4bef-b328-cf65425d7056', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:58:41 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-457fc4e5-9e22-4f3b-83ba-226456e24837 tempest-VolumeDependencyTests-690845755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ef96546-c955-4ae5-b7b0-8f47907f8f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:58:41 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-457fc4e5-9e22-4f3b-83ba-226456e24837 tempest-VolumeDependencyTests-690845755 None] Volume volume-a27edc59-8fbc-4bef-b328-cf65425d7056 (a27edc59-8fbc-4bef-b328-cf65425d7056): created successfully Sep 08 06:58:41 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-457fc4e5-9e22-4f3b-83ba-226456e24837 tempest-VolumeDependencyTests-690845755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ef96546-c955-4ae5-b7b0-8f47907f8f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:58:41 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-457fc4e5-9e22-4f3b-83ba-226456e24837 tempest-VolumeDependencyTests-690845755 None] Flow 'volume_create_manager' (e5fdb066-afbf-45f2-bc27-a737906380ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:58:41 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-457fc4e5-9e22-4f3b-83ba-226456e24837 tempest-VolumeDependencyTests-690845755 None] Created volume successfully. Sep 08 06:58:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-19519225-34aa-43a0-8882-d0ec92915f9f tempest-VolumeDependencyTests-690845755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:58:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-19519225-34aa-43a0-8882-d0ec92915f9f tempest-VolumeDependencyTests-690845755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:58:41 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-19519225-34aa-43a0-8882-d0ec92915f9f tempest-VolumeDependencyTests-690845755 None] Creating offline snapshot 6a2e62a7-d907-4f86-840f-09f020e56490 of volume a27edc59-8fbc-4bef-b328-cf65425d7056 {{(pid=87507) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 06:58:41 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7f3174-f09e-4635-8f18-7ed78439545d]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:58:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-19519225-34aa-43a0-8882-d0ec92915f9f tempest-VolumeDependencyTests-690845755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a27edc59-8fbc-4bef-b328-cf65425d7056 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:58:41 devstack sudo[119302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a27edc59-8fbc-4bef-b328-cf65425d7056 Sep 08 06:58:41 devstack sudo[119302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:58:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-919100af-9ac8-4d4d-83b7-47f13e3b1ce6 req-614ce342-e358-4f89-9ef5-cc7629e517d4 tempest-TestInstancesWithCinderVolumes-616773652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:58:42 devstack sudo[119302]: pam_unix(sudo:session): session closed for user root Sep 08 06:58:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-19519225-34aa-43a0-8882-d0ec92915f9f tempest-VolumeDependencyTests-690845755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a27edc59-8fbc-4bef-b328-cf65425d7056" returned: 0 in 0.410s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:58:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-19519225-34aa-43a0-8882-d0ec92915f9f tempest-VolumeDependencyTests-690845755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a27edc59-8fbc-4bef-b328-cf65425d7056,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a27edc59-8fbc-4bef-b328-cf65425d7056.6a2e62a7-d907-4f86-840f-09f020e56490 1G {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:58:42 devstack sudo[119327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a27edc59-8fbc-4bef-b328-cf65425d7056,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a27edc59-8fbc-4bef-b328-cf65425d7056.6a2e62a7-d907-4f86-840f-09f020e56490 1G Sep 08 06:58:42 devstack sudo[119327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:58:42 devstack sudo[119327]: pam_unix(sudo:session): session closed for user root Sep 08 06:58:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-19519225-34aa-43a0-8882-d0ec92915f9f tempest-VolumeDependencyTests-690845755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a27edc59-8fbc-4bef-b328-cf65425d7056,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a27edc59-8fbc-4bef-b328-cf65425d7056.6a2e62a7-d907-4f86-840f-09f020e56490 1G" returned: 0 in 0.375s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:58:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-19519225-34aa-43a0-8882-d0ec92915f9f tempest-VolumeDependencyTests-690845755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a27edc59-8fbc-4bef-b328-cf65425d7056 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a27edc59-8fbc-4bef-b328-cf65425d7056.6a2e62a7-d907-4f86-840f-09f020e56490 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:58:42 devstack sudo[119345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a27edc59-8fbc-4bef-b328-cf65425d7056 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a27edc59-8fbc-4bef-b328-cf65425d7056.6a2e62a7-d907-4f86-840f-09f020e56490 Sep 08 06:58:42 devstack sudo[119345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:58:42 devstack sudo[119345]: pam_unix(sudo:session): session closed for user root Sep 08 06:58:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-19519225-34aa-43a0-8882-d0ec92915f9f tempest-VolumeDependencyTests-690845755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a27edc59-8fbc-4bef-b328-cf65425d7056 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a27edc59-8fbc-4bef-b328-cf65425d7056.6a2e62a7-d907-4f86-840f-09f020e56490" returned: 0 in 0.293s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:58:42 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-19519225-34aa-43a0-8882-d0ec92915f9f tempest-VolumeDependencyTests-690845755 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a27edc59-8fbc-4bef-b328-cf65425d7056.6a2e62a7-d907-4f86-840f-09f020e56490 is being set with open permissions: ugo+rw Sep 08 06:58:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-19519225-34aa-43a0-8882-d0ec92915f9f tempest-VolumeDependencyTests-690845755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a27edc59-8fbc-4bef-b328-cf65425d7056.6a2e62a7-d907-4f86-840f-09f020e56490 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:58:42 devstack sudo[119359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a27edc59-8fbc-4bef-b328-cf65425d7056.6a2e62a7-d907-4f86-840f-09f020e56490 Sep 08 06:58:42 devstack sudo[119359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:58:43 devstack sudo[119359]: pam_unix(sudo:session): session closed for user root Sep 08 06:58:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-19519225-34aa-43a0-8882-d0ec92915f9f tempest-VolumeDependencyTests-690845755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a27edc59-8fbc-4bef-b328-cf65425d7056.6a2e62a7-d907-4f86-840f-09f020e56490" returned: 0 in 0.252s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:58:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-19519225-34aa-43a0-8882-d0ec92915f9f tempest-VolumeDependencyTests-690845755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a27edc59-8fbc-4bef-b328-cf65425d7056.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:58:43 devstack sudo[119368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a27edc59-8fbc-4bef-b328-cf65425d7056.info Sep 08 06:58:43 devstack sudo[119368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:58:43 devstack sudo[119368]: pam_unix(sudo:session): session closed for user root Sep 08 06:58:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-19519225-34aa-43a0-8882-d0ec92915f9f tempest-VolumeDependencyTests-690845755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a27edc59-8fbc-4bef-b328-cf65425d7056.info" returned: 0 in 0.250s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:58:43 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-19519225-34aa-43a0-8882-d0ec92915f9f tempest-VolumeDependencyTests-690845755 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a27edc59-8fbc-4bef-b328-cf65425d7056.info is being set with open permissions: ugo+rw Sep 08 06:58:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-19519225-34aa-43a0-8882-d0ec92915f9f tempest-VolumeDependencyTests-690845755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a27edc59-8fbc-4bef-b328-cf65425d7056.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:58:43 devstack sudo[119380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a27edc59-8fbc-4bef-b328-cf65425d7056.info Sep 08 06:58:43 devstack sudo[119380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:58:43 devstack sudo[119380]: pam_unix(sudo:session): session closed for user root Sep 08 06:58:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-19519225-34aa-43a0-8882-d0ec92915f9f tempest-VolumeDependencyTests-690845755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a27edc59-8fbc-4bef-b328-cf65425d7056.info" returned: 0 in 0.243s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:58:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-19519225-34aa-43a0-8882-d0ec92915f9f tempest-VolumeDependencyTests-690845755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.919s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:58:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-919100af-9ac8-4d4d-83b7-47f13e3b1ce6 req-614ce342-e358-4f89-9ef5-cc7629e517d4 tempest-TestInstancesWithCinderVolumes-616773652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.534s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:58:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-919100af-9ac8-4d4d-83b7-47f13e3b1ce6 req-614ce342-e358-4f89-9ef5-cc7629e517d4 tempest-TestInstancesWithCinderVolumes-616773652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:58:43 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-19519225-34aa-43a0-8882-d0ec92915f9f tempest-VolumeDependencyTests-690845755 None] Create snapshot completed successfully Sep 08 06:58:43 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-919100af-9ac8-4d4d-83b7-47f13e3b1ce6 req-614ce342-e358-4f89-9ef5-cc7629e517d4 tempest-TestInstancesWithCinderVolumes-616773652 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d', 'name': 'volume-f98ddce5-8367-4033-a051-36a5c2c8f1ce', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2106f9e6-7b82-469e-b5c5-7752b85f1e83', 'enforce_multipath': True} {{(pid=87507) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 06:58:43 devstack cinder-volume[87507]: INFO cinder.volume.manager [req-919100af-9ac8-4d4d-83b7-47f13e3b1ce6 req-614ce342-e358-4f89-9ef5-cc7629e517d4 tempest-TestInstancesWithCinderVolumes-616773652 None] attachment_update completed successfully. Sep 08 06:58:44 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-6502f042-e856-4521-8f47-677b0f09a3cb tempest-VolumeDependencyTests-690845755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:58:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6502f042-e856-4521-8f47-677b0f09a3cb tempest-VolumeDependencyTests-690845755 None] Flow 'volume_create_manager' (69d31013-75f9-4306-a678-94c2035019af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:58:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6502f042-e856-4521-8f47-677b0f09a3cb tempest-VolumeDependencyTests-690845755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edbcf361-7d60-49cf-988f-6e5495f4a5fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:58:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6502f042-e856-4521-8f47-677b0f09a3cb tempest-VolumeDependencyTests-690845755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edbcf361-7d60-49cf-988f-6e5495f4a5fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:58:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1990074577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cab66241-bdca-4f32-9f4d-36f1bd839445,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e8c791ed18c4821a095762696a780c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:58:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6a2e62a7-d907-4f86-840f-09f020e56490,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:58:44Z,use_quota=True,user_id='f818b6995e01414d920ae54ef9930e66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:58:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6502f042-e856-4521-8f47-677b0f09a3cb tempest-VolumeDependencyTests-690845755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f62a5aa-233c-4849-95b2-315d65fc36a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:58:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6502f042-e856-4521-8f47-677b0f09a3cb tempest-VolumeDependencyTests-690845755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f62a5aa-233c-4849-95b2-315d65fc36a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:58:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6502f042-e856-4521-8f47-677b0f09a3cb tempest-VolumeDependencyTests-690845755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bcdbe9c-ae44-44ba-91fc-c02fd65732f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:58:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6502f042-e856-4521-8f47-677b0f09a3cb tempest-VolumeDependencyTests-690845755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bcdbe9c-ae44-44ba-91fc-c02fd65732f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cab66241-bdca-4f32-9f4d-36f1bd839445', 'volume_name': 'volume-cab66241-bdca-4f32-9f4d-36f1bd839445', 'volume_size': 1, 'snapshot_id': '6a2e62a7-d907-4f86-840f-09f020e56490'}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:58:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6502f042-e856-4521-8f47-677b0f09a3cb tempest-VolumeDependencyTests-690845755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ad94f9f-505b-4dc3-9263-80f68cc5adfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:58:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6502f042-e856-4521-8f47-677b0f09a3cb tempest-VolumeDependencyTests-690845755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ad94f9f-505b-4dc3-9263-80f68cc5adfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:58:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6502f042-e856-4521-8f47-677b0f09a3cb tempest-VolumeDependencyTests-690845755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebd29612-f785-4d60-b2ce-70ff494bedf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:58:44 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-6502f042-e856-4521-8f47-677b0f09a3cb tempest-VolumeDependencyTests-690845755 None] Volume cab66241-bdca-4f32-9f4d-36f1bd839445: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cab66241-bdca-4f32-9f4d-36f1bd839445', 'volume_size': 1, 'snapshot_id': '6a2e62a7-d907-4f86-840f-09f020e56490'} Sep 08 06:58:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-6502f042-e856-4521-8f47-677b0f09a3cb tempest-VolumeDependencyTests-690845755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:58:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-6502f042-e856-4521-8f47-677b0f09a3cb tempest-VolumeDependencyTests-690845755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:58:44 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-6502f042-e856-4521-8f47-677b0f09a3cb tempest-VolumeDependencyTests-690845755 None] Acquiring lock "cinder-quobyte-6a2e62a7-d907-4f86-840f-09f020e56490-cab66241-bdca-4f32-9f4d-36f1bd839445" by "_create_volume_from_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:58:44 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-6502f042-e856-4521-8f47-677b0f09a3cb tempest-VolumeDependencyTests-690845755 None] Lock "cinder-quobyte-6a2e62a7-d907-4f86-840f-09f020e56490-cab66241-bdca-4f32-9f4d-36f1bd839445" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:58:44 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-6502f042-e856-4521-8f47-677b0f09a3cb tempest-VolumeDependencyTests-690845755 None] Creating volume cab66241-bdca-4f32-9f4d-36f1bd839445 from snapshot 6a2e62a7-d907-4f86-840f-09f020e56490 {{(pid=87507) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 08 06:58:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-6502f042-e856-4521-8f47-677b0f09a3cb tempest-VolumeDependencyTests-690845755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:58:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-6502f042-e856-4521-8f47-677b0f09a3cb tempest-VolumeDependencyTests-690845755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:58:44 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-6502f042-e856-4521-8f47-677b0f09a3cb tempest-VolumeDependencyTests-690845755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:58:44 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-6502f042-e856-4521-8f47-677b0f09a3cb tempest-VolumeDependencyTests-690845755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:58:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-6502f042-e856-4521-8f47-677b0f09a3cb tempest-VolumeDependencyTests-690845755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:58:44 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-6502f042-e856-4521-8f47-677b0f09a3cb tempest-VolumeDependencyTests-690845755 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:58:44 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-6502f042-e856-4521-8f47-677b0f09a3cb tempest-VolumeDependencyTests-690845755 None] Acquiring lock "cinder-quobyte-cab66241-bdca-4f32-9f4d-36f1bd839445" by "_copy_volume_from_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:58:44 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-6502f042-e856-4521-8f47-677b0f09a3cb tempest-VolumeDependencyTests-690845755 None] Lock "cinder-quobyte-cab66241-bdca-4f32-9f4d-36f1bd839445" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:58:44 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-6502f042-e856-4521-8f47-677b0f09a3cb tempest-VolumeDependencyTests-690845755 None] snapshot: 6a2e62a7-d907-4f86-840f-09f020e56490, volume: cab66241-bdca-4f32-9f4d-36f1bd839445, {{(pid=87507) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 08 06:58:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-6502f042-e856-4521-8f47-677b0f09a3cb tempest-VolumeDependencyTests-690845755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:58:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-6502f042-e856-4521-8f47-677b0f09a3cb tempest-VolumeDependencyTests-690845755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:58:44 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-6502f042-e856-4521-8f47-677b0f09a3cb tempest-VolumeDependencyTests-690845755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:58:44 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-6502f042-e856-4521-8f47-677b0f09a3cb tempest-VolumeDependencyTests-690845755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:58:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-6502f042-e856-4521-8f47-677b0f09a3cb tempest-VolumeDependencyTests-690845755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:58:44 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[04220569-bb11-4af1-aee8-e412834e46bd]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:58:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6502f042-e856-4521-8f47-677b0f09a3cb tempest-VolumeDependencyTests-690845755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a27edc59-8fbc-4bef-b328-cf65425d7056.6a2e62a7-d907-4f86-840f-09f020e56490 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:58:44 devstack sudo[119421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a27edc59-8fbc-4bef-b328-cf65425d7056.6a2e62a7-d907-4f86-840f-09f020e56490 Sep 08 06:58:44 devstack sudo[119421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:58:44 devstack sudo[119421]: pam_unix(sudo:session): session closed for user root Sep 08 06:58:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6502f042-e856-4521-8f47-677b0f09a3cb tempest-VolumeDependencyTests-690845755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a27edc59-8fbc-4bef-b328-cf65425d7056.6a2e62a7-d907-4f86-840f-09f020e56490" returned: 0 in 0.352s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:58:44 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-6502f042-e856-4521-8f47-677b0f09a3cb tempest-VolumeDependencyTests-690845755 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a27edc59-8fbc-4bef-b328-cf65425d7056(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 06:58:44 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c351c492-0f22-4333-a510-8baefdd31107]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:58:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6502f042-e856-4521-8f47-677b0f09a3cb tempest-VolumeDependencyTests-690845755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a27edc59-8fbc-4bef-b328-cf65425d7056 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:58:45 devstack sudo[119439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a27edc59-8fbc-4bef-b328-cf65425d7056 Sep 08 06:58:45 devstack sudo[119439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:58:45 devstack sudo[119439]: pam_unix(sudo:session): session closed for user root Sep 08 06:58:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6502f042-e856-4521-8f47-677b0f09a3cb tempest-VolumeDependencyTests-690845755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a27edc59-8fbc-4bef-b328-cf65425d7056" returned: 0 in 0.372s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:58:45 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-6502f042-e856-4521-8f47-677b0f09a3cb tempest-VolumeDependencyTests-690845755 None] will copy from snapshot at /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a27edc59-8fbc-4bef-b328-cf65425d7056 {{(pid=87507) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 08 06:58:45 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-6502f042-e856-4521-8f47-677b0f09a3cb tempest-VolumeDependencyTests-690845755 None] Creating direct copy from snapshot {{(pid=87507) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 08 06:58:45 devstack cinder-volume[87507]: DEBUG cinder.utils [None req-6502f042-e856-4521-8f47-677b0f09a3cb tempest-VolumeDependencyTests-690845755 None] Path /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cab66241-bdca-4f32-9f4d-36f1bd839445 not found in is_blk_device check {{(pid=87507) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 08 06:58:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6502f042-e856-4521-8f47-677b0f09a3cb tempest-VolumeDependencyTests-690845755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a27edc59-8fbc-4bef-b328-cf65425d7056 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cab66241-bdca-4f32-9f4d-36f1bd839445 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:58:45 devstack sudo[119460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a27edc59-8fbc-4bef-b328-cf65425d7056 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cab66241-bdca-4f32-9f4d-36f1bd839445 Sep 08 06:58:45 devstack sudo[119460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:58:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-1f2cf821-5794-4143-a1b0-1a2f92abdd26 req-4a8ee2e5-83ca-4618-abcf-677212cbb40b tempest-TestInstancesWithCinderVolumes-616773652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:58:50 devstack sudo[119460]: pam_unix(sudo:session): session closed for user root Sep 08 06:58:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6502f042-e856-4521-8f47-677b0f09a3cb tempest-VolumeDependencyTests-690845755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a27edc59-8fbc-4bef-b328-cf65425d7056 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cab66241-bdca-4f32-9f4d-36f1bd839445" returned: 0 in 4.664s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:58:50 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-6502f042-e856-4521-8f47-677b0f09a3cb tempest-VolumeDependencyTests-690845755 None] Image conversion details: src /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a27edc59-8fbc-4bef-b328-cf65425d7056, size 1024.00 MB, duration 4.66 sec, destination /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cab66241-bdca-4f32-9f4d-36f1bd839445 {{(pid=87507) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 06:58:50 devstack cinder-volume[87507]: INFO cinder.image.image_utils [None req-6502f042-e856-4521-8f47-677b0f09a3cb tempest-VolumeDependencyTests-690845755 None] Converted 1024.00 MB image at 219.51 MB/s Sep 08 06:58:50 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-6502f042-e856-4521-8f47-677b0f09a3cb tempest-VolumeDependencyTests-690845755 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cab66241-bdca-4f32-9f4d-36f1bd839445 is being set with open permissions: ugo+rw Sep 08 06:58:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6502f042-e856-4521-8f47-677b0f09a3cb tempest-VolumeDependencyTests-690845755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cab66241-bdca-4f32-9f4d-36f1bd839445 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:58:50 devstack sudo[119625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cab66241-bdca-4f32-9f4d-36f1bd839445 Sep 08 06:58:50 devstack sudo[119625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:58:50 devstack sudo[119625]: pam_unix(sudo:session): session closed for user root Sep 08 06:58:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6502f042-e856-4521-8f47-677b0f09a3cb tempest-VolumeDependencyTests-690845755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cab66241-bdca-4f32-9f4d-36f1bd839445" returned: 0 in 0.257s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:58:50 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-6502f042-e856-4521-8f47-677b0f09a3cb tempest-VolumeDependencyTests-690845755 None] Lock "cinder-quobyte-cab66241-bdca-4f32-9f4d-36f1bd839445" released by "_copy_volume_from_snapshot" :: held 5.725s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:58:50 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-6502f042-e856-4521-8f47-677b0f09a3cb tempest-VolumeDependencyTests-690845755 None] Lock "cinder-quobyte-6a2e62a7-d907-4f86-840f-09f020e56490-cab66241-bdca-4f32-9f4d-36f1bd839445" released by "_create_volume_from_snapshot" :: held 5.783s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:58:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-6502f042-e856-4521-8f47-677b0f09a3cb tempest-VolumeDependencyTests-690845755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.802s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:58:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-1f2cf821-5794-4143-a1b0-1a2f92abdd26 req-4a8ee2e5-83ca-4618-abcf-677212cbb40b tempest-TestInstancesWithCinderVolumes-616773652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.607s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:58:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [req-1f2cf821-5794-4143-a1b0-1a2f92abdd26 req-4a8ee2e5-83ca-4618-abcf-677212cbb40b tempest-TestInstancesWithCinderVolumes-616773652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:58:50 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6502f042-e856-4521-8f47-677b0f09a3cb tempest-VolumeDependencyTests-690845755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebd29612-f785-4d60-b2ce-70ff494bedf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cab66241-bdca-4f32-9f4d-36f1bd839445', 'volume_size': 1, 'snapshot_id': '6a2e62a7-d907-4f86-840f-09f020e56490'}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:58:50 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6502f042-e856-4521-8f47-677b0f09a3cb tempest-VolumeDependencyTests-690845755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc936e6b-3309-498a-8c37-1bb488f3c105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:58:50 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-6502f042-e856-4521-8f47-677b0f09a3cb tempest-VolumeDependencyTests-690845755 None] Volume volume-cab66241-bdca-4f32-9f4d-36f1bd839445 (cab66241-bdca-4f32-9f4d-36f1bd839445): created successfully Sep 08 06:58:50 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6502f042-e856-4521-8f47-677b0f09a3cb tempest-VolumeDependencyTests-690845755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc936e6b-3309-498a-8c37-1bb488f3c105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:58:50 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6502f042-e856-4521-8f47-677b0f09a3cb tempest-VolumeDependencyTests-690845755 None] Flow 'volume_create_manager' (69d31013-75f9-4306-a678-94c2035019af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:58:50 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-1f2cf821-5794-4143-a1b0-1a2f92abdd26 req-4a8ee2e5-83ca-4618-abcf-677212cbb40b tempest-TestInstancesWithCinderVolumes-616773652 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d', 'name': 'volume-81ce9bdd-df69-4c27-a209-68c22f33ba83', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fdba83c7-d8e7-4f30-9136-67ba26bdb2cf', 'enforce_multipath': True} {{(pid=87507) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 06:58:50 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-6502f042-e856-4521-8f47-677b0f09a3cb tempest-VolumeDependencyTests-690845755 None] Created volume successfully. Sep 08 06:58:50 devstack cinder-volume[87507]: INFO cinder.volume.manager [req-1f2cf821-5794-4143-a1b0-1a2f92abdd26 req-4a8ee2e5-83ca-4618-abcf-677212cbb40b tempest-TestInstancesWithCinderVolumes-616773652 None] attachment_update completed successfully. Sep 08 06:58:51 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-3baceb59-2605-47bf-be9d-9f5f3b91ab6f tempest-VolumeDependencyTests-690845755 None] Acquiring lock "cinder-6a2e62a7-d907-4f86-840f-09f020e56490-delete_snapshot" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:58:51 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-3baceb59-2605-47bf-be9d-9f5f3b91ab6f tempest-VolumeDependencyTests-690845755 None] Lock "cinder-6a2e62a7-d907-4f86-840f-09f020e56490-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:58:51 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-3baceb59-2605-47bf-be9d-9f5f3b91ab6f tempest-VolumeDependencyTests-690845755 None] Acquiring lock "cinder-quobyte-a27edc59-8fbc-4bef-b328-cf65425d7056" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:58:51 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-3baceb59-2605-47bf-be9d-9f5f3b91ab6f tempest-VolumeDependencyTests-690845755 None] Lock "cinder-quobyte-a27edc59-8fbc-4bef-b328-cf65425d7056" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:58:51 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-3baceb59-2605-47bf-be9d-9f5f3b91ab6f tempest-VolumeDependencyTests-690845755 None] Acquiring lock "cinder-quobyte-6a2e62a7-d907-4f86-840f-09f020e56490" by "_delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:58:51 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-3baceb59-2605-47bf-be9d-9f5f3b91ab6f tempest-VolumeDependencyTests-690845755 None] Lock "cinder-quobyte-6a2e62a7-d907-4f86-840f-09f020e56490" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:58:51 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-3baceb59-2605-47bf-be9d-9f5f3b91ab6f tempest-VolumeDependencyTests-690845755 None] Deleting offline snapshot 6a2e62a7-d907-4f86-840f-09f020e56490 of volume a27edc59-8fbc-4bef-b328-cf65425d7056 {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 06:58:51 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-3baceb59-2605-47bf-be9d-9f5f3b91ab6f tempest-VolumeDependencyTests-690845755 None] snapshot_file for this snap is: volume-a27edc59-8fbc-4bef-b328-cf65425d7056.6a2e62a7-d907-4f86-840f-09f020e56490 {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 06:58:51 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dbc19ae-b9a6-4862-97c4-115c302b4b2e]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:58:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3baceb59-2605-47bf-be9d-9f5f3b91ab6f tempest-VolumeDependencyTests-690845755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a27edc59-8fbc-4bef-b328-cf65425d7056.6a2e62a7-d907-4f86-840f-09f020e56490 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:58:51 devstack sudo[119666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a27edc59-8fbc-4bef-b328-cf65425d7056.6a2e62a7-d907-4f86-840f-09f020e56490 Sep 08 06:58:51 devstack sudo[119666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:58:51 devstack sudo[119666]: pam_unix(sudo:session): session closed for user root Sep 08 06:58:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3baceb59-2605-47bf-be9d-9f5f3b91ab6f tempest-VolumeDependencyTests-690845755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a27edc59-8fbc-4bef-b328-cf65425d7056.6a2e62a7-d907-4f86-840f-09f020e56490" returned: 0 in 0.357s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:58:51 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-3baceb59-2605-47bf-be9d-9f5f3b91ab6f tempest-VolumeDependencyTests-690845755 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a27edc59-8fbc-4bef-b328-cf65425d7056(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 06:58:51 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e9c8e6-68c1-451a-8be3-59dcf5c355d1]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:58:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3baceb59-2605-47bf-be9d-9f5f3b91ab6f tempest-VolumeDependencyTests-690845755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a27edc59-8fbc-4bef-b328-cf65425d7056 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:58:51 devstack sudo[119683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a27edc59-8fbc-4bef-b328-cf65425d7056 Sep 08 06:58:51 devstack sudo[119683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:58:52 devstack sudo[119683]: pam_unix(sudo:session): session closed for user root Sep 08 06:58:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3baceb59-2605-47bf-be9d-9f5f3b91ab6f tempest-VolumeDependencyTests-690845755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a27edc59-8fbc-4bef-b328-cf65425d7056" returned: 0 in 0.549s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:58:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3baceb59-2605-47bf-be9d-9f5f3b91ab6f tempest-VolumeDependencyTests-690845755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a27edc59-8fbc-4bef-b328-cf65425d7056.6a2e62a7-d907-4f86-840f-09f020e56490 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:58:52 devstack sudo[119714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a27edc59-8fbc-4bef-b328-cf65425d7056.6a2e62a7-d907-4f86-840f-09f020e56490 Sep 08 06:58:52 devstack sudo[119714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:58:52 devstack sudo[119714]: pam_unix(sudo:session): session closed for user root Sep 08 06:58:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3baceb59-2605-47bf-be9d-9f5f3b91ab6f tempest-VolumeDependencyTests-690845755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a27edc59-8fbc-4bef-b328-cf65425d7056.6a2e62a7-d907-4f86-840f-09f020e56490" returned: 0 in 0.355s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:58:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3baceb59-2605-47bf-be9d-9f5f3b91ab6f tempest-VolumeDependencyTests-690845755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a27edc59-8fbc-4bef-b328-cf65425d7056.6a2e62a7-d907-4f86-840f-09f020e56490 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:58:52 devstack sudo[119728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a27edc59-8fbc-4bef-b328-cf65425d7056.6a2e62a7-d907-4f86-840f-09f020e56490 Sep 08 06:58:52 devstack sudo[119728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:58:52 devstack sudo[119728]: pam_unix(sudo:session): session closed for user root Sep 08 06:58:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3baceb59-2605-47bf-be9d-9f5f3b91ab6f tempest-VolumeDependencyTests-690845755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a27edc59-8fbc-4bef-b328-cf65425d7056.6a2e62a7-d907-4f86-840f-09f020e56490" returned: 0 in 0.266s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:58:52 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-3baceb59-2605-47bf-be9d-9f5f3b91ab6f tempest-VolumeDependencyTests-690845755 None] Lock "cinder-quobyte-6a2e62a7-d907-4f86-840f-09f020e56490" released by "_delete_snapshot" :: held 1.621s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:58:52 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-3baceb59-2605-47bf-be9d-9f5f3b91ab6f tempest-VolumeDependencyTests-690845755 None] Lock "cinder-quobyte-a27edc59-8fbc-4bef-b328-cf65425d7056" released by "delete_snapshot" :: held 1.644s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:58:52 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-3baceb59-2605-47bf-be9d-9f5f3b91ab6f tempest-VolumeDependencyTests-690845755 None] Created reservations ['4ca2af52-1a8c-470a-aa4a-9bdecb467653', '7bd6618f-5b06-480c-907f-b444b53134ea', '40fe7409-395e-42c8-9e33-6ee7cf13f3df', '579d52c7-3388-4033-af2a-0a6511663188'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:58:52 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-3baceb59-2605-47bf-be9d-9f5f3b91ab6f tempest-VolumeDependencyTests-690845755 None] Delete snapshot completed successfully. Sep 08 06:58:52 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-3baceb59-2605-47bf-be9d-9f5f3b91ab6f tempest-VolumeDependencyTests-690845755 None] Lock "cinder-6a2e62a7-d907-4f86-840f-09f020e56490-delete_snapshot" released by "delete_snapshot" :: held 1.795s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:58:53 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-42537cc2-479f-4fea-998a-1258a0458fc5 tempest-VolumeDependencyTests-690845755 None] Acquiring lock "cinder-a27edc59-8fbc-4bef-b328-cf65425d7056-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:58:53 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-42537cc2-479f-4fea-998a-1258a0458fc5 tempest-VolumeDependencyTests-690845755 None] Lock "cinder-a27edc59-8fbc-4bef-b328-cf65425d7056-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:58:53 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-42537cc2-479f-4fea-998a-1258a0458fc5 tempest-VolumeDependencyTests-690845755 None] Acquiring lock "cinder-quobyte-a27edc59-8fbc-4bef-b328-cf65425d7056" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:58:53 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-42537cc2-479f-4fea-998a-1258a0458fc5 tempest-VolumeDependencyTests-690845755 None] Lock "cinder-quobyte-a27edc59-8fbc-4bef-b328-cf65425d7056" acquired by "delete_volume" :: waited 0.021s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:58:53 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a2ea30-b8e8-469f-a9b9-b16645d7c054]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:58:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-42537cc2-479f-4fea-998a-1258a0458fc5 tempest-VolumeDependencyTests-690845755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a27edc59-8fbc-4bef-b328-cf65425d7056 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:58:53 devstack sudo[119758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a27edc59-8fbc-4bef-b328-cf65425d7056 Sep 08 06:58:53 devstack sudo[119758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:58:53 devstack sudo[119758]: pam_unix(sudo:session): session closed for user root Sep 08 06:58:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-42537cc2-479f-4fea-998a-1258a0458fc5 tempest-VolumeDependencyTests-690845755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a27edc59-8fbc-4bef-b328-cf65425d7056" returned: 0 in 0.356s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:58:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-42537cc2-479f-4fea-998a-1258a0458fc5 tempest-VolumeDependencyTests-690845755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a27edc59-8fbc-4bef-b328-cf65425d7056 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:58:53 devstack sudo[119777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a27edc59-8fbc-4bef-b328-cf65425d7056 Sep 08 06:58:53 devstack sudo[119777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:58:54 devstack sudo[119777]: pam_unix(sudo:session): session closed for user root Sep 08 06:58:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-42537cc2-479f-4fea-998a-1258a0458fc5 tempest-VolumeDependencyTests-690845755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a27edc59-8fbc-4bef-b328-cf65425d7056" returned: 0 in 0.253s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:58:54 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-42537cc2-479f-4fea-998a-1258a0458fc5 tempest-VolumeDependencyTests-690845755 None] Lock "cinder-quobyte-a27edc59-8fbc-4bef-b328-cf65425d7056" released by "delete_volume" :: held 0.668s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:58:54 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-42537cc2-479f-4fea-998a-1258a0458fc5 tempest-VolumeDependencyTests-690845755 None] Created reservations ['d796b60b-e30c-49fc-8863-425359c9ad26', 'e5fb4b4c-583e-479c-a0c6-f6c0c595c842', 'a9d7fc5b-b167-47da-893f-7fae9d185d8a', 'be91ce20-7917-455e-937c-56e38b539e9a'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:58:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-42537cc2-479f-4fea-998a-1258a0458fc5 tempest-VolumeDependencyTests-690845755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:58:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-42537cc2-479f-4fea-998a-1258a0458fc5 tempest-VolumeDependencyTests-690845755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:58:54 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-42537cc2-479f-4fea-998a-1258a0458fc5 tempest-VolumeDependencyTests-690845755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:58:54 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-42537cc2-479f-4fea-998a-1258a0458fc5 tempest-VolumeDependencyTests-690845755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:58:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-42537cc2-479f-4fea-998a-1258a0458fc5 tempest-VolumeDependencyTests-690845755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:58:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-42537cc2-479f-4fea-998a-1258a0458fc5 tempest-VolumeDependencyTests-690845755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:58:54 devstack sudo[119803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:58:54 devstack sudo[119803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:58:54 devstack sudo[119803]: pam_unix(sudo:session): session closed for user root Sep 08 06:58:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-42537cc2-479f-4fea-998a-1258a0458fc5 tempest-VolumeDependencyTests-690845755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.266s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:58:54 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-42537cc2-479f-4fea-998a-1258a0458fc5 tempest-VolumeDependencyTests-690845755 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:58:54 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-42537cc2-479f-4fea-998a-1258a0458fc5 tempest-VolumeDependencyTests-690845755 None] Deleted volume successfully. Sep 08 06:58:54 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-42537cc2-479f-4fea-998a-1258a0458fc5 tempest-VolumeDependencyTests-690845755 None] Lock "cinder-a27edc59-8fbc-4bef-b328-cf65425d7056-delete_volume" released by "delete_volume" :: held 1.172s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:58:54 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-8e1f213f-ac3e-402a-b4b6-4fc1844c6f70 tempest-VolumeDependencyTests-690845755 None] Acquiring lock "cinder-cab66241-bdca-4f32-9f4d-36f1bd839445-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:58:54 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-8e1f213f-ac3e-402a-b4b6-4fc1844c6f70 tempest-VolumeDependencyTests-690845755 None] Lock "cinder-cab66241-bdca-4f32-9f4d-36f1bd839445-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:58:54 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-8e1f213f-ac3e-402a-b4b6-4fc1844c6f70 tempest-VolumeDependencyTests-690845755 None] Acquiring lock "cinder-quobyte-cab66241-bdca-4f32-9f4d-36f1bd839445" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:58:54 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-8e1f213f-ac3e-402a-b4b6-4fc1844c6f70 tempest-VolumeDependencyTests-690845755 None] Lock "cinder-quobyte-cab66241-bdca-4f32-9f4d-36f1bd839445" acquired by "delete_volume" :: waited 0.019s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:58:54 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[399b20ad-b1c7-4db0-a94a-21865ef20139]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:58:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8e1f213f-ac3e-402a-b4b6-4fc1844c6f70 tempest-VolumeDependencyTests-690845755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cab66241-bdca-4f32-9f4d-36f1bd839445 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:58:54 devstack sudo[119826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cab66241-bdca-4f32-9f4d-36f1bd839445 Sep 08 06:58:54 devstack sudo[119826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:58:55 devstack sudo[119826]: pam_unix(sudo:session): session closed for user root Sep 08 06:58:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8e1f213f-ac3e-402a-b4b6-4fc1844c6f70 tempest-VolumeDependencyTests-690845755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cab66241-bdca-4f32-9f4d-36f1bd839445" returned: 0 in 0.365s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:58:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8e1f213f-ac3e-402a-b4b6-4fc1844c6f70 tempest-VolumeDependencyTests-690845755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cab66241-bdca-4f32-9f4d-36f1bd839445 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:58:55 devstack sudo[119845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cab66241-bdca-4f32-9f4d-36f1bd839445 Sep 08 06:58:55 devstack sudo[119845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:58:55 devstack sudo[119845]: pam_unix(sudo:session): session closed for user root Sep 08 06:58:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8e1f213f-ac3e-402a-b4b6-4fc1844c6f70 tempest-VolumeDependencyTests-690845755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cab66241-bdca-4f32-9f4d-36f1bd839445" returned: 0 in 0.279s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:58:55 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-8e1f213f-ac3e-402a-b4b6-4fc1844c6f70 tempest-VolumeDependencyTests-690845755 None] Lock "cinder-quobyte-cab66241-bdca-4f32-9f4d-36f1bd839445" released by "delete_volume" :: held 0.685s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:58:55 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-8e1f213f-ac3e-402a-b4b6-4fc1844c6f70 tempest-VolumeDependencyTests-690845755 None] Created reservations ['5afeb52e-48ee-4411-901c-513c5288bd37', 'd196ab6a-3196-40bf-9f17-3da4ba2fec10', 'f1de886a-30a3-424c-b4be-10cb96817951', 'e0667e97-e176-44c9-8172-5986f23d4f76'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:58:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8e1f213f-ac3e-402a-b4b6-4fc1844c6f70 tempest-VolumeDependencyTests-690845755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:58:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8e1f213f-ac3e-402a-b4b6-4fc1844c6f70 tempest-VolumeDependencyTests-690845755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:58:55 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8e1f213f-ac3e-402a-b4b6-4fc1844c6f70 tempest-VolumeDependencyTests-690845755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:58:55 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8e1f213f-ac3e-402a-b4b6-4fc1844c6f70 tempest-VolumeDependencyTests-690845755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:58:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8e1f213f-ac3e-402a-b4b6-4fc1844c6f70 tempest-VolumeDependencyTests-690845755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:58:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8e1f213f-ac3e-402a-b4b6-4fc1844c6f70 tempest-VolumeDependencyTests-690845755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:58:55 devstack sudo[119864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:58:55 devstack sudo[119864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:58:55 devstack cinder-volume[87507]: INFO cinder.volume.manager [req-d0fb5095-e225-4700-b20e-cfd8bcca9669 req-c7bf6285-430a-45cd-9bef-bfd79d8d1fee tempest-TestInstancesWithCinderVolumes-616773652 None] Terminate volume connection completed successfully. Sep 08 06:58:55 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-d0fb5095-e225-4700-b20e-cfd8bcca9669 req-c7bf6285-430a-45cd-9bef-bfd79d8d1fee tempest-TestInstancesWithCinderVolumes-616773652 None] Deleting attachment 2106f9e6-7b82-469e-b5c5-7752b85f1e83. {{(pid=87507) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 06:58:55 devstack sudo[119864]: pam_unix(sudo:session): session closed for user root Sep 08 06:58:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8e1f213f-ac3e-402a-b4b6-4fc1844c6f70 tempest-VolumeDependencyTests-690845755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.262s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:58:55 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-8e1f213f-ac3e-402a-b4b6-4fc1844c6f70 tempest-VolumeDependencyTests-690845755 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:58:55 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-8e1f213f-ac3e-402a-b4b6-4fc1844c6f70 tempest-VolumeDependencyTests-690845755 None] Deleted volume successfully. Sep 08 06:58:55 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-8e1f213f-ac3e-402a-b4b6-4fc1844c6f70 tempest-VolumeDependencyTests-690845755 None] Lock "cinder-cab66241-bdca-4f32-9f4d-36f1bd839445-delete_volume" released by "delete_volume" :: held 1.185s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:58:56 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-53a7fa98-2a06-43d3-9b99-55c72fef6ed6 tempest-TestInstancesWithCinderVolumes-616773652 None] Acquiring lock "cinder-f98ddce5-8367-4033-a051-36a5c2c8f1ce-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:58:56 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-53a7fa98-2a06-43d3-9b99-55c72fef6ed6 tempest-TestInstancesWithCinderVolumes-616773652 None] Lock "cinder-f98ddce5-8367-4033-a051-36a5c2c8f1ce-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:58:56 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-53a7fa98-2a06-43d3-9b99-55c72fef6ed6 tempest-TestInstancesWithCinderVolumes-616773652 None] Acquiring lock "cinder-quobyte-f98ddce5-8367-4033-a051-36a5c2c8f1ce" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:58:56 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-53a7fa98-2a06-43d3-9b99-55c72fef6ed6 tempest-TestInstancesWithCinderVolumes-616773652 None] Lock "cinder-quobyte-f98ddce5-8367-4033-a051-36a5c2c8f1ce" acquired by "delete_volume" :: waited 0.017s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:58:56 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e618d405-4ff3-44ef-b4dd-573627f164d8]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:58:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-53a7fa98-2a06-43d3-9b99-55c72fef6ed6 tempest-TestInstancesWithCinderVolumes-616773652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f98ddce5-8367-4033-a051-36a5c2c8f1ce {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:58:56 devstack sudo[119898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f98ddce5-8367-4033-a051-36a5c2c8f1ce Sep 08 06:58:56 devstack sudo[119898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:58:56 devstack sudo[119898]: pam_unix(sudo:session): session closed for user root Sep 08 06:58:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-53a7fa98-2a06-43d3-9b99-55c72fef6ed6 tempest-TestInstancesWithCinderVolumes-616773652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f98ddce5-8367-4033-a051-36a5c2c8f1ce" returned: 0 in 0.443s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:58:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-53a7fa98-2a06-43d3-9b99-55c72fef6ed6 tempest-TestInstancesWithCinderVolumes-616773652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f98ddce5-8367-4033-a051-36a5c2c8f1ce {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:58:56 devstack sudo[119916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f98ddce5-8367-4033-a051-36a5c2c8f1ce Sep 08 06:58:56 devstack sudo[119916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:58:57 devstack sudo[119916]: pam_unix(sudo:session): session closed for user root Sep 08 06:58:57 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-53a7fa98-2a06-43d3-9b99-55c72fef6ed6 tempest-TestInstancesWithCinderVolumes-616773652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f98ddce5-8367-4033-a051-36a5c2c8f1ce" returned: 0 in 0.342s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:58:57 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-53a7fa98-2a06-43d3-9b99-55c72fef6ed6 tempest-TestInstancesWithCinderVolumes-616773652 None] Lock "cinder-quobyte-f98ddce5-8367-4033-a051-36a5c2c8f1ce" released by "delete_volume" :: held 0.845s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:58:57 devstack cinder-volume[87507]: WARNING cinder.quota [None req-53a7fa98-2a06-43d3-9b99-55c72fef6ed6 tempest-TestInstancesWithCinderVolumes-616773652 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-734205242-574870176 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-734205242-574870176, it is now deprecated. Please use the default quota class for default quota. Sep 08 06:58:57 devstack cinder-volume[87507]: WARNING cinder.quota [None req-53a7fa98-2a06-43d3-9b99-55c72fef6ed6 tempest-TestInstancesWithCinderVolumes-616773652 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-734205242-574870176 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-734205242-574870176, it is now deprecated. Please use the default quota class for default quota. Sep 08 06:58:57 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-53a7fa98-2a06-43d3-9b99-55c72fef6ed6 tempest-TestInstancesWithCinderVolumes-616773652 None] Created reservations ['fd81bb28-a32d-43a4-ada2-95e1becf8371', '6d0bc5f9-693c-492c-adc8-6eb06b63c15c', '21571e2c-4995-486f-8ea2-8556692c1d8a', 'd7ba2407-dcb1-450e-bcbd-90d9cea47a18'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:58:57 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-53a7fa98-2a06-43d3-9b99-55c72fef6ed6 tempest-TestInstancesWithCinderVolumes-616773652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:58:57 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-53a7fa98-2a06-43d3-9b99-55c72fef6ed6 tempest-TestInstancesWithCinderVolumes-616773652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:58:57 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-53a7fa98-2a06-43d3-9b99-55c72fef6ed6 tempest-TestInstancesWithCinderVolumes-616773652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:58:57 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-53a7fa98-2a06-43d3-9b99-55c72fef6ed6 tempest-TestInstancesWithCinderVolumes-616773652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:58:57 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-53a7fa98-2a06-43d3-9b99-55c72fef6ed6 tempest-TestInstancesWithCinderVolumes-616773652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:58:57 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-53a7fa98-2a06-43d3-9b99-55c72fef6ed6 tempest-TestInstancesWithCinderVolumes-616773652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:58:57 devstack sudo[119937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:58:57 devstack sudo[119937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:58:57 devstack sudo[119937]: pam_unix(sudo:session): session closed for user root Sep 08 06:58:57 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-53a7fa98-2a06-43d3-9b99-55c72fef6ed6 tempest-TestInstancesWithCinderVolumes-616773652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.286s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:58:57 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-53a7fa98-2a06-43d3-9b99-55c72fef6ed6 tempest-TestInstancesWithCinderVolumes-616773652 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:58:57 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-53a7fa98-2a06-43d3-9b99-55c72fef6ed6 tempest-TestInstancesWithCinderVolumes-616773652 None] Deleted volume successfully. Sep 08 06:58:57 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-53a7fa98-2a06-43d3-9b99-55c72fef6ed6 tempest-TestInstancesWithCinderVolumes-616773652 None] Lock "cinder-f98ddce5-8367-4033-a051-36a5c2c8f1ce-delete_volume" released by "delete_volume" :: held 1.385s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:59:00 devstack cinder-volume[87507]: INFO cinder.volume.manager [req-4522e7c4-5c1a-4687-b30f-4e20a77e799b req-d93b7c5e-4bd6-4d2c-a69b-a968747e7f99 tempest-TestInstancesWithCinderVolumes-616773652 None] Terminate volume connection completed successfully. Sep 08 06:59:00 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-4522e7c4-5c1a-4687-b30f-4e20a77e799b req-d93b7c5e-4bd6-4d2c-a69b-a968747e7f99 tempest-TestInstancesWithCinderVolumes-616773652 None] Deleting attachment fdba83c7-d8e7-4f30-9136-67ba26bdb2cf. {{(pid=87507) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 06:59:01 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-813e5a14-d4b7-42f0-9854-29fa9fd4ac45 tempest-TestInstancesWithCinderVolumes-616773652 None] Acquiring lock "cinder-81ce9bdd-df69-4c27-a209-68c22f33ba83-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:59:01 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-813e5a14-d4b7-42f0-9854-29fa9fd4ac45 tempest-TestInstancesWithCinderVolumes-616773652 None] Lock "cinder-81ce9bdd-df69-4c27-a209-68c22f33ba83-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:59:01 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-813e5a14-d4b7-42f0-9854-29fa9fd4ac45 tempest-TestInstancesWithCinderVolumes-616773652 None] Acquiring lock "cinder-quobyte-81ce9bdd-df69-4c27-a209-68c22f33ba83" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:59:01 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-813e5a14-d4b7-42f0-9854-29fa9fd4ac45 tempest-TestInstancesWithCinderVolumes-616773652 None] Lock "cinder-quobyte-81ce9bdd-df69-4c27-a209-68c22f33ba83" acquired by "delete_volume" :: waited 0.026s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:59:01 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c362e8f8-e5d7-4cd7-8841-8244b7fc8074]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:59:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-813e5a14-d4b7-42f0-9854-29fa9fd4ac45 tempest-TestInstancesWithCinderVolumes-616773652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-81ce9bdd-df69-4c27-a209-68c22f33ba83 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:59:01 devstack sudo[120082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-81ce9bdd-df69-4c27-a209-68c22f33ba83 Sep 08 06:59:01 devstack sudo[120082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:59:01 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:59:01 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] Flow 'volume_create_manager' (7ec05dc3-d050-48b6-86c8-81c79ed2589f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:59:01 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ebc357b-b2a0-463a-b2f4-65eb2b01013f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:59:01 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ebc357b-b2a0-463a-b2f4-65eb2b01013f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:59:01Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0ebcdb8-3652-4df3-b2df-21067624610d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20f6452ac179459cb0ac9e3e12323332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:59:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:59:01Z,use_quota=True,user_id='39a41d25be2948e89b65f0c4de65bdfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:59:01 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4035c73f-c25b-40db-8efd-eb49d1bb38fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:59:01 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4035c73f-c25b-40db-8efd-eb49d1bb38fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:59:01 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e97fda76-ea11-4140-b75d-b61dad264dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:59:01 devstack cinder-volume[87507]: DEBUG cinder.image.glance [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] Creating Keystone auth plugin from conf {{(pid=87507) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 08 06:59:01 devstack sudo[120082]: pam_unix(sudo:session): session closed for user root Sep 08 06:59:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-813e5a14-d4b7-42f0-9854-29fa9fd4ac45 tempest-TestInstancesWithCinderVolumes-616773652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-81ce9bdd-df69-4c27-a209-68c22f33ba83" returned: 0 in 0.425s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:59:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-813e5a14-d4b7-42f0-9854-29fa9fd4ac45 tempest-TestInstancesWithCinderVolumes-616773652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-81ce9bdd-df69-4c27-a209-68c22f33ba83 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:59:01 devstack sudo[120100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-81ce9bdd-df69-4c27-a209-68c22f33ba83 Sep 08 06:59:01 devstack sudo[120100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:59:01 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e97fda76-ea11-4140-b75d-b61dad264dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e0ebcdb8-3652-4df3-b2df-21067624610d', 'volume_name': 'volume-e0ebcdb8-3652-4df3-b2df-21067624610d', 'volume_size': 1, 'image_id': 'de9ca45d-d8f2-4b87-9460-0907d93f0275', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/de9ca45d-d8f2-4b87-9460-0907d93f0275', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5446191591232e7bd4afc91ecad5d3f0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '20f6452ac179459cb0ac9e3e12323332', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6bf8f89b7def575749d39194600725adb2c83c5614b505dada8e27791dc71a00a1e7911c4aa61e317c0015a457fb8f512694914d54efeeecea8997f9f0912a2e', 'id': 'de9ca45d-d8f2-4b87-9460-0907d93f0275', 'created_at': datetime.datetime(2026, 9, 8, 4, 58, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 4, 59, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/de9ca45d-d8f2-4b87-9460-0907d93f0275/file', 'properties': {}}, 'image_service': }' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:59:01 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2bc4513-1324-4ffb-ae4d-02a9baf97f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:59:01 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2bc4513-1324-4ffb-ae4d-02a9baf97f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:59:01 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4506870-9878-4e3f-b0d2-5a0f4ae089b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:59:01 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] Volume e0ebcdb8-3652-4df3-b2df-21067624610d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e0ebcdb8-3652-4df3-b2df-21067624610d', 'volume_size': 1, 'image_id': 'de9ca45d-d8f2-4b87-9460-0907d93f0275', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/de9ca45d-d8f2-4b87-9460-0907d93f0275', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5446191591232e7bd4afc91ecad5d3f0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '20f6452ac179459cb0ac9e3e12323332', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6bf8f89b7def575749d39194600725adb2c83c5614b505dada8e27791dc71a00a1e7911c4aa61e317c0015a457fb8f512694914d54efeeecea8997f9f0912a2e', 'id': 'de9ca45d-d8f2-4b87-9460-0907d93f0275', 'created_at': datetime.datetime(2026, 9, 8, 4, 58, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 4, 59, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/de9ca45d-d8f2-4b87-9460-0907d93f0275/file', 'properties': {}}, 'image_service': } Sep 08 06:59:01 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] Trying to clone e0ebcdb8-3652-4df3-b2df-21067624610d from image de9ca45d-d8f2-4b87-9460-0907d93f0275 at location (None, [{'url': 'file:///opt/stack/data/glance/images/de9ca45d-d8f2-4b87-9460-0907d93f0275', 'metadata': {}}]). {{(pid=87507) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 08 06:59:01 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_de9ca45d-d8f2-4b87-9460-0907d93f0275_c6j35094devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87507) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 08 06:59:01 devstack cinder-volume[87507]: INFO cinder.image.image_utils [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] Image download 0.00 MB at 0.00 MB/s Sep 08 06:59:01 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[413b0775-d396-42c3-ba28-c18158f4e66b]: (4, 'raw') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:59:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_de9ca45d-d8f2-4b87-9460-0907d93f0275_c6j35094devstack@QuobyteHD {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:59:01 devstack sudo[120100]: pam_unix(sudo:session): session closed for user root Sep 08 06:59:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-813e5a14-d4b7-42f0-9854-29fa9fd4ac45 tempest-TestInstancesWithCinderVolumes-616773652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-81ce9bdd-df69-4c27-a209-68c22f33ba83" returned: 0 in 0.295s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:59:01 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-813e5a14-d4b7-42f0-9854-29fa9fd4ac45 tempest-TestInstancesWithCinderVolumes-616773652 None] Lock "cinder-quobyte-81ce9bdd-df69-4c27-a209-68c22f33ba83" released by "delete_volume" :: held 0.786s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:59:02 devstack cinder-volume[87507]: WARNING cinder.quota [None req-813e5a14-d4b7-42f0-9854-29fa9fd4ac45 tempest-TestInstancesWithCinderVolumes-616773652 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1748933453-1190738723 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1748933453-1190738723, it is now deprecated. Please use the default quota class for default quota. Sep 08 06:59:02 devstack cinder-volume[87507]: WARNING cinder.quota [None req-813e5a14-d4b7-42f0-9854-29fa9fd4ac45 tempest-TestInstancesWithCinderVolumes-616773652 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1748933453-1190738723 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1748933453-1190738723, it is now deprecated. Please use the default quota class for default quota. Sep 08 06:59:02 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-813e5a14-d4b7-42f0-9854-29fa9fd4ac45 tempest-TestInstancesWithCinderVolumes-616773652 None] Created reservations ['efe076bf-37c2-4900-9276-a14c256443db', 'a729c103-7c56-4c46-9e3a-5a03a885367c', '57b584f4-838d-4bda-b2c3-02daa2aaff2a', 'a5af4c09-ca93-445f-acab-8852d99b4b23'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:59:02 devstack sudo[120109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_de9ca45d-d8f2-4b87-9460-0907d93f0275_c6j35094devstack@QuobyteHD Sep 08 06:59:02 devstack sudo[120109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:59:02 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-813e5a14-d4b7-42f0-9854-29fa9fd4ac45 tempest-TestInstancesWithCinderVolumes-616773652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:59:02 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-813e5a14-d4b7-42f0-9854-29fa9fd4ac45 tempest-TestInstancesWithCinderVolumes-616773652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:59:02 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-813e5a14-d4b7-42f0-9854-29fa9fd4ac45 tempest-TestInstancesWithCinderVolumes-616773652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:59:02 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-813e5a14-d4b7-42f0-9854-29fa9fd4ac45 tempest-TestInstancesWithCinderVolumes-616773652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:59:02 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-813e5a14-d4b7-42f0-9854-29fa9fd4ac45 tempest-TestInstancesWithCinderVolumes-616773652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:59:02 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-813e5a14-d4b7-42f0-9854-29fa9fd4ac45 tempest-TestInstancesWithCinderVolumes-616773652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:59:02 devstack sudo[120121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:59:02 devstack sudo[120121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:59:02 devstack sudo[120109]: pam_unix(sudo:session): session closed for user root Sep 08 06:59:02 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_de9ca45d-d8f2-4b87-9460-0907d93f0275_c6j35094devstack@QuobyteHD" returned: 0 in 0.417s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:59:02 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_de9ca45d-d8f2-4b87-9460-0907d93f0275_c6j35094devstack@QuobyteHD {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:59:02 devstack sudo[120128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_de9ca45d-d8f2-4b87-9460-0907d93f0275_c6j35094devstack@QuobyteHD Sep 08 06:59:02 devstack sudo[120128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:59:02 devstack sudo[120121]: pam_unix(sudo:session): session closed for user root Sep 08 06:59:02 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-813e5a14-d4b7-42f0-9854-29fa9fd4ac45 tempest-TestInstancesWithCinderVolumes-616773652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.300s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:59:02 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-813e5a14-d4b7-42f0-9854-29fa9fd4ac45 tempest-TestInstancesWithCinderVolumes-616773652 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:59:02 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-813e5a14-d4b7-42f0-9854-29fa9fd4ac45 tempest-TestInstancesWithCinderVolumes-616773652 None] Deleted volume successfully. Sep 08 06:59:02 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-813e5a14-d4b7-42f0-9854-29fa9fd4ac45 tempest-TestInstancesWithCinderVolumes-616773652 None] Lock "cinder-81ce9bdd-df69-4c27-a209-68c22f33ba83-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:59:02 devstack sudo[120128]: pam_unix(sudo:session): session closed for user root Sep 08 06:59:02 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_de9ca45d-d8f2-4b87-9460-0907d93f0275_c6j35094devstack@QuobyteHD" returned: 1 in 0.375s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:59:02 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_de9ca45d-d8f2-4b87-9460-0907d93f0275_c6j35094devstack@QuobyteHD' failed. Not Retrying. {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 06:59:02 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] Temporary image de9ca45d-d8f2-4b87-9460-0907d93f0275 is fetched for user 39a41d25be2948e89b65f0c4de65bdfe. {{(pid=87507) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 08 06:59:02 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[950c493b-0874-415a-acb5-6689f7e965ce]: (4, 'raw') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:59:02 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_de9ca45d-d8f2-4b87-9460-0907d93f0275_c6j35094devstack@QuobyteHD {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:59:02 devstack sudo[120150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_de9ca45d-d8f2-4b87-9460-0907d93f0275_c6j35094devstack@QuobyteHD Sep 08 06:59:02 devstack sudo[120150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:59:03 devstack sudo[120150]: pam_unix(sudo:session): session closed for user root Sep 08 06:59:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_de9ca45d-d8f2-4b87-9460-0907d93f0275_c6j35094devstack@QuobyteHD" returned: 0 in 0.396s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:59:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_de9ca45d-d8f2-4b87-9460-0907d93f0275_c6j35094devstack@QuobyteHD {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:59:03 devstack sudo[120166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_de9ca45d-d8f2-4b87-9460-0907d93f0275_c6j35094devstack@QuobyteHD Sep 08 06:59:03 devstack sudo[120166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:59:03 devstack sudo[120166]: pam_unix(sudo:session): session closed for user root Sep 08 06:59:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_de9ca45d-d8f2-4b87-9460-0907d93f0275_c6j35094devstack@QuobyteHD" returned: 1 in 0.341s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:59:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_de9ca45d-d8f2-4b87-9460-0907d93f0275_c6j35094devstack@QuobyteHD' failed. Not Retrying. {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 06:59:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:59:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:59:03 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:59:01Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0ebcdb8-3652-4df3-b2df-21067624610d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20f6452ac179459cb0ac9e3e12323332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:59:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:59:01Z,use_quota=True,user_id='39a41d25be2948e89b65f0c4de65bdfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:59:03 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] Creating volume e0ebcdb8-3652-4df3-b2df-21067624610d {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:59:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:59:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:59:03 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:59:03 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:59:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:59:03 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:59:03 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:59:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e0ebcdb8-3652-4df3-b2df-21067624610d 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:59:03 devstack sudo[120180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e0ebcdb8-3652-4df3-b2df-21067624610d 1073741824 Sep 08 06:59:03 devstack sudo[120180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:59:04 devstack sudo[120180]: pam_unix(sudo:session): session closed for user root Sep 08 06:59:04 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e0ebcdb8-3652-4df3-b2df-21067624610d 1073741824" returned: 0 in 0.550s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:59:04 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e0ebcdb8-3652-4df3-b2df-21067624610d {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:59:04 devstack sudo[120208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e0ebcdb8-3652-4df3-b2df-21067624610d Sep 08 06:59:04 devstack sudo[120208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:59:04 devstack sudo[120208]: pam_unix(sudo:session): session closed for user root Sep 08 06:59:04 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e0ebcdb8-3652-4df3-b2df-21067624610d" returned: 0 in 0.456s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:59:04 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:59:04 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:59:04 devstack cinder-volume[87507]: DEBUG cinder.volume.volume_utils [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] Attempting download of de9ca45d-d8f2-4b87-9460-0907d93f0275 ((None, [{'url': 'file:///opt/stack/data/glance/images/de9ca45d-d8f2-4b87-9460-0907d93f0275', 'metadata': {}}])) to volume e0ebcdb8-3652-4df3-b2df-21067624610d. {{(pid=87507) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 08 06:59:04 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae7e4a7-e94e-4a52-9117-f6ee55dd8099]: (4, 'raw') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:59:04 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_de9ca45d-d8f2-4b87-9460-0907d93f0275_iqgtu0ya {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:59:04 devstack sudo[120243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_de9ca45d-d8f2-4b87-9460-0907d93f0275_iqgtu0ya Sep 08 06:59:04 devstack sudo[120243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:59:05 devstack sudo[120243]: pam_unix(sudo:session): session closed for user root Sep 08 06:59:05 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_de9ca45d-d8f2-4b87-9460-0907d93f0275_iqgtu0ya" returned: 0 in 0.383s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:59:05 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_de9ca45d-d8f2-4b87-9460-0907d93f0275_iqgtu0ya {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:59:05 devstack sudo[120257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_de9ca45d-d8f2-4b87-9460-0907d93f0275_iqgtu0ya Sep 08 06:59:05 devstack sudo[120257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:59:05 devstack cinder-volume[87507]: INFO cinder.volume.manager [req-cad2655e-fb30-4020-92ac-f00ef4021196 req-e7a8c158-cf6f-41ab-8120-133385fc388e tempest-TestInstancesWithCinderVolumes-616773652 None] Terminate volume connection completed successfully. Sep 08 06:59:05 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [req-cad2655e-fb30-4020-92ac-f00ef4021196 req-e7a8c158-cf6f-41ab-8120-133385fc388e tempest-TestInstancesWithCinderVolumes-616773652 None] Deleting attachment e9257a86-3573-49d1-8515-f0876e0a65d8. {{(pid=87507) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 06:59:05 devstack sudo[120257]: pam_unix(sudo:session): session closed for user root Sep 08 06:59:05 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_de9ca45d-d8f2-4b87-9460-0907d93f0275_iqgtu0ya" returned: 1 in 0.391s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:59:05 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_de9ca45d-d8f2-4b87-9460-0907d93f0275_iqgtu0ya' failed. Not Retrying. {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 06:59:05 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c77c2d-b87e-44f1-901e-845e37588126]: (4, 'raw') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:59:05 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_de9ca45d-d8f2-4b87-9460-0907d93f0275_c6j35094devstack@QuobyteHD {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:59:05 devstack sudo[120274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_de9ca45d-d8f2-4b87-9460-0907d93f0275_c6j35094devstack@QuobyteHD Sep 08 06:59:05 devstack sudo[120274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:59:05 devstack sudo[120274]: pam_unix(sudo:session): session closed for user root Sep 08 06:59:05 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_de9ca45d-d8f2-4b87-9460-0907d93f0275_c6j35094devstack@QuobyteHD" returned: 0 in 0.358s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:59:05 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_de9ca45d-d8f2-4b87-9460-0907d93f0275_c6j35094devstack@QuobyteHD {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:59:05 devstack sudo[120290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_de9ca45d-d8f2-4b87-9460-0907d93f0275_c6j35094devstack@QuobyteHD Sep 08 06:59:05 devstack sudo[120290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:59:06 devstack sudo[120290]: pam_unix(sudo:session): session closed for user root Sep 08 06:59:06 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_de9ca45d-d8f2-4b87-9460-0907d93f0275_c6j35094devstack@QuobyteHD" returned: 1 in 0.326s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:59:06 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_de9ca45d-d8f2-4b87-9460-0907d93f0275_c6j35094devstack@QuobyteHD' failed. Not Retrying. {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 06:59:06 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] de9ca45d-d8f2-4b87-9460-0907d93f0275 was raw, converting to qcow2 {{(pid=87507) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 08 06:59:06 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_de9ca45d-d8f2-4b87-9460-0907d93f0275_c6j35094devstack@QuobyteHD /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e0ebcdb8-3652-4df3-b2df-21067624610d {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:59:06 devstack sudo[120304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_de9ca45d-d8f2-4b87-9460-0907d93f0275_c6j35094devstack@QuobyteHD /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e0ebcdb8-3652-4df3-b2df-21067624610d Sep 08 06:59:06 devstack sudo[120304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:59:06 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-45b8650e-6d3d-4520-847d-84c9cc00230d tempest-TestInstancesWithCinderVolumes-616773652 None] Acquiring lock "cinder-2d872c8b-3b02-4237-9702-a69ee7daf093-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:59:06 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-45b8650e-6d3d-4520-847d-84c9cc00230d tempest-TestInstancesWithCinderVolumes-616773652 None] Lock "cinder-2d872c8b-3b02-4237-9702-a69ee7daf093-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:59:06 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-45b8650e-6d3d-4520-847d-84c9cc00230d tempest-TestInstancesWithCinderVolumes-616773652 None] Acquiring lock "cinder-quobyte-2d872c8b-3b02-4237-9702-a69ee7daf093" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:59:06 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-45b8650e-6d3d-4520-847d-84c9cc00230d tempest-TestInstancesWithCinderVolumes-616773652 None] Lock "cinder-quobyte-2d872c8b-3b02-4237-9702-a69ee7daf093" acquired by "delete_volume" :: waited 0.018s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:59:06 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af5b1c9-fcaa-4bc6-9fdb-4c48d28ecf01]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:59:06 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-45b8650e-6d3d-4520-847d-84c9cc00230d tempest-TestInstancesWithCinderVolumes-616773652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2d872c8b-3b02-4237-9702-a69ee7daf093 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:59:06 devstack sudo[120304]: pam_unix(sudo:session): session closed for user root Sep 08 06:59:06 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_de9ca45d-d8f2-4b87-9460-0907d93f0275_c6j35094devstack@QuobyteHD /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e0ebcdb8-3652-4df3-b2df-21067624610d" returned: 0 in 0.491s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:59:06 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_de9ca45d-d8f2-4b87-9460-0907d93f0275_c6j35094devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e0ebcdb8-3652-4df3-b2df-21067624610d {{(pid=87507) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 06:59:06 devstack cinder-volume[87507]: INFO cinder.image.image_utils [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] Converted 0.00 MB image at 0.00 MB/s Sep 08 06:59:06 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e0ebcdb8-3652-4df3-b2df-21067624610d 1G {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:59:06 devstack sudo[120328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e0ebcdb8-3652-4df3-b2df-21067624610d 1G Sep 08 06:59:06 devstack sudo[120328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:59:06 devstack sudo[120324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2d872c8b-3b02-4237-9702-a69ee7daf093 Sep 08 06:59:06 devstack sudo[120324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:59:06 devstack sudo[120324]: pam_unix(sudo:session): session closed for user root Sep 08 06:59:06 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-45b8650e-6d3d-4520-847d-84c9cc00230d tempest-TestInstancesWithCinderVolumes-616773652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2d872c8b-3b02-4237-9702-a69ee7daf093" returned: 0 in 0.377s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:59:06 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-45b8650e-6d3d-4520-847d-84c9cc00230d tempest-TestInstancesWithCinderVolumes-616773652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2d872c8b-3b02-4237-9702-a69ee7daf093 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:59:06 devstack sudo[120347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2d872c8b-3b02-4237-9702-a69ee7daf093 Sep 08 06:59:06 devstack sudo[120328]: pam_unix(sudo:session): session closed for user root Sep 08 06:59:06 devstack sudo[120347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:59:06 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e0ebcdb8-3652-4df3-b2df-21067624610d 1G" returned: 0 in 0.319s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:59:06 devstack cinder-volume[87507]: DEBUG cinder.volume.volume_utils [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] Downloaded image de9ca45d-d8f2-4b87-9460-0907d93f0275 ((None, [{'url': 'file:///opt/stack/data/glance/images/de9ca45d-d8f2-4b87-9460-0907d93f0275', 'metadata': {}}])) to volume e0ebcdb8-3652-4df3-b2df-21067624610d successfully. {{(pid=87507) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 08 06:59:06 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] Temporary image de9ca45d-d8f2-4b87-9460-0907d93f0275 for user 39a41d25be2948e89b65f0c4de65bdfe is deleted. {{(pid=87507) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 08 06:59:06 devstack cinder-volume[87507]: DEBUG cinder.volume.volume_utils [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] Marking volume e0ebcdb8-3652-4df3-b2df-21067624610d as bootable. {{(pid=87507) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 08 06:59:06 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] Copying metadata from image de9ca45d-d8f2-4b87-9460-0907d93f0275 to e0ebcdb8-3652-4df3-b2df-21067624610d. {{(pid=87507) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 08 06:59:06 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] Creating volume glance metadata for volume e0ebcdb8-3652-4df3-b2df-21067624610d backed by image de9ca45d-d8f2-4b87-9460-0907d93f0275 with: {'image_id': 'de9ca45d-d8f2-4b87-9460-0907d93f0275', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '5446191591232e7bd4afc91ecad5d3f0', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87507) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 08 06:59:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4506870-9878-4e3f-b0d2-5a0f4ae089b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0ebcdb8-3652-4df3-b2df-21067624610d', 'volume_size': 1, 'image_id': 'de9ca45d-d8f2-4b87-9460-0907d93f0275', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/de9ca45d-d8f2-4b87-9460-0907d93f0275', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5446191591232e7bd4afc91ecad5d3f0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '20f6452ac179459cb0ac9e3e12323332', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6bf8f89b7def575749d39194600725adb2c83c5614b505dada8e27791dc71a00a1e7911c4aa61e317c0015a457fb8f512694914d54efeeecea8997f9f0912a2e', 'id': 'de9ca45d-d8f2-4b87-9460-0907d93f0275', 'created_at': datetime.datetime(2026, 9, 8, 4, 58, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 4, 59, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/de9ca45d-d8f2-4b87-9460-0907d93f0275/file', 'properties': {}}, 'image_service': }' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:59:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6616bb09-abf6-4f65-872f-95bea5e1aee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:59:07 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] Volume volume-e0ebcdb8-3652-4df3-b2df-21067624610d (e0ebcdb8-3652-4df3-b2df-21067624610d): created successfully Sep 08 06:59:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6616bb09-abf6-4f65-872f-95bea5e1aee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:59:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] Flow 'volume_create_manager' (7ec05dc3-d050-48b6-86c8-81c79ed2589f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:59:07 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-1c0a8ace-8969-495e-9b45-bee6525267aa tempest-VolumeImageDependencyTests-1138964039 None] Created volume successfully. Sep 08 06:59:07 devstack sudo[120347]: pam_unix(sudo:session): session closed for user root Sep 08 06:59:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-45b8650e-6d3d-4520-847d-84c9cc00230d tempest-TestInstancesWithCinderVolumes-616773652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2d872c8b-3b02-4237-9702-a69ee7daf093" returned: 0 in 0.252s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:59:07 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-45b8650e-6d3d-4520-847d-84c9cc00230d tempest-TestInstancesWithCinderVolumes-616773652 None] Lock "cinder-quobyte-2d872c8b-3b02-4237-9702-a69ee7daf093" released by "delete_volume" :: held 0.665s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:59:07 devstack cinder-volume[87507]: WARNING cinder.quota [None req-45b8650e-6d3d-4520-847d-84c9cc00230d tempest-TestInstancesWithCinderVolumes-616773652 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1763930320-825526844 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1763930320-825526844, it is now deprecated. Please use the default quota class for default quota. Sep 08 06:59:07 devstack cinder-volume[87507]: WARNING cinder.quota [None req-45b8650e-6d3d-4520-847d-84c9cc00230d tempest-TestInstancesWithCinderVolumes-616773652 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1763930320-825526844 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1763930320-825526844, it is now deprecated. Please use the default quota class for default quota. Sep 08 06:59:07 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-45b8650e-6d3d-4520-847d-84c9cc00230d tempest-TestInstancesWithCinderVolumes-616773652 None] Created reservations ['6378985f-9ef3-46d2-b9b2-6cbaa02298f6', 'e0d50445-fe8b-4107-b13c-ce2d4de7395a', '241df5c0-1bf9-4465-9702-39b1e434e2ed', '64f09266-b459-4fc3-98a7-def7306f46b8'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:59:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-45b8650e-6d3d-4520-847d-84c9cc00230d tempest-TestInstancesWithCinderVolumes-616773652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:59:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-45b8650e-6d3d-4520-847d-84c9cc00230d tempest-TestInstancesWithCinderVolumes-616773652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:59:07 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-45b8650e-6d3d-4520-847d-84c9cc00230d tempest-TestInstancesWithCinderVolumes-616773652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:59:07 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-45b8650e-6d3d-4520-847d-84c9cc00230d tempest-TestInstancesWithCinderVolumes-616773652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:59:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-45b8650e-6d3d-4520-847d-84c9cc00230d tempest-TestInstancesWithCinderVolumes-616773652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:59:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-45b8650e-6d3d-4520-847d-84c9cc00230d tempest-TestInstancesWithCinderVolumes-616773652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:59:07 devstack sudo[120362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:59:07 devstack sudo[120362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:59:07 devstack sudo[120362]: pam_unix(sudo:session): session closed for user root Sep 08 06:59:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-45b8650e-6d3d-4520-847d-84c9cc00230d tempest-TestInstancesWithCinderVolumes-616773652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.246s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:59:07 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-45b8650e-6d3d-4520-847d-84c9cc00230d tempest-TestInstancesWithCinderVolumes-616773652 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:59:07 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-45b8650e-6d3d-4520-847d-84c9cc00230d tempest-TestInstancesWithCinderVolumes-616773652 None] Deleted volume successfully. Sep 08 06:59:07 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-45b8650e-6d3d-4520-847d-84c9cc00230d tempest-TestInstancesWithCinderVolumes-616773652 None] Lock "cinder-2d872c8b-3b02-4237-9702-a69ee7daf093-delete_volume" released by "delete_volume" :: held 1.110s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:59:07 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-7a139a20-45cc-4d81-ba7e-08e974575f13 tempest-VolumeImageDependencyTests-1138964039 None] Acquiring lock "cinder-e0ebcdb8-3652-4df3-b2df-21067624610d-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:59:07 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-7a139a20-45cc-4d81-ba7e-08e974575f13 tempest-VolumeImageDependencyTests-1138964039 None] Lock "cinder-e0ebcdb8-3652-4df3-b2df-21067624610d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:59:07 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-7a139a20-45cc-4d81-ba7e-08e974575f13 tempest-VolumeImageDependencyTests-1138964039 None] Acquiring lock "cinder-quobyte-e0ebcdb8-3652-4df3-b2df-21067624610d" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:59:07 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-7a139a20-45cc-4d81-ba7e-08e974575f13 tempest-VolumeImageDependencyTests-1138964039 None] Lock "cinder-quobyte-e0ebcdb8-3652-4df3-b2df-21067624610d" acquired by "delete_volume" :: waited 0.015s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:59:08 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4c0468-7218-4462-b437-c23e17e15c7d]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:59:08 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7a139a20-45cc-4d81-ba7e-08e974575f13 tempest-VolumeImageDependencyTests-1138964039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e0ebcdb8-3652-4df3-b2df-21067624610d {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:59:08 devstack sudo[120383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e0ebcdb8-3652-4df3-b2df-21067624610d Sep 08 06:59:08 devstack sudo[120383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:59:08 devstack sudo[120383]: pam_unix(sudo:session): session closed for user root Sep 08 06:59:08 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7a139a20-45cc-4d81-ba7e-08e974575f13 tempest-VolumeImageDependencyTests-1138964039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e0ebcdb8-3652-4df3-b2df-21067624610d" returned: 0 in 0.402s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:59:08 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7a139a20-45cc-4d81-ba7e-08e974575f13 tempest-VolumeImageDependencyTests-1138964039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e0ebcdb8-3652-4df3-b2df-21067624610d {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:59:08 devstack sudo[120400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e0ebcdb8-3652-4df3-b2df-21067624610d Sep 08 06:59:08 devstack sudo[120400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:59:08 devstack sudo[120400]: pam_unix(sudo:session): session closed for user root Sep 08 06:59:08 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7a139a20-45cc-4d81-ba7e-08e974575f13 tempest-VolumeImageDependencyTests-1138964039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e0ebcdb8-3652-4df3-b2df-21067624610d" returned: 0 in 0.253s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:59:08 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-7a139a20-45cc-4d81-ba7e-08e974575f13 tempest-VolumeImageDependencyTests-1138964039 None] Lock "cinder-quobyte-e0ebcdb8-3652-4df3-b2df-21067624610d" released by "delete_volume" :: held 0.701s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:59:08 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-7a139a20-45cc-4d81-ba7e-08e974575f13 tempest-VolumeImageDependencyTests-1138964039 None] Created reservations ['77d7bb67-0728-4852-8f53-b7e75bdd7aa9', '1996dd95-4dd6-45f1-984a-8c55535c8e64', '09da6e7b-69df-4859-ab80-d50ce6401120', '07779304-9ca1-44e9-95e3-369d4df22f5e'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:59:08 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-7a139a20-45cc-4d81-ba7e-08e974575f13 tempest-VolumeImageDependencyTests-1138964039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:59:08 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-7a139a20-45cc-4d81-ba7e-08e974575f13 tempest-VolumeImageDependencyTests-1138964039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:59:08 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-7a139a20-45cc-4d81-ba7e-08e974575f13 tempest-VolumeImageDependencyTests-1138964039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:59:08 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-7a139a20-45cc-4d81-ba7e-08e974575f13 tempest-VolumeImageDependencyTests-1138964039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:59:08 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-7a139a20-45cc-4d81-ba7e-08e974575f13 tempest-VolumeImageDependencyTests-1138964039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:59:08 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7a139a20-45cc-4d81-ba7e-08e974575f13 tempest-VolumeImageDependencyTests-1138964039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:59:08 devstack sudo[120415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:59:08 devstack sudo[120415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:59:09 devstack sudo[120415]: pam_unix(sudo:session): session closed for user root Sep 08 06:59:09 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7a139a20-45cc-4d81-ba7e-08e974575f13 tempest-VolumeImageDependencyTests-1138964039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.292s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:59:09 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-7a139a20-45cc-4d81-ba7e-08e974575f13 tempest-VolumeImageDependencyTests-1138964039 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:59:09 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-7a139a20-45cc-4d81-ba7e-08e974575f13 tempest-VolumeImageDependencyTests-1138964039 None] Deleted volume successfully. Sep 08 06:59:09 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-7a139a20-45cc-4d81-ba7e-08e974575f13 tempest-VolumeImageDependencyTests-1138964039 None] Lock "cinder-e0ebcdb8-3652-4df3-b2df-21067624610d-delete_volume" released by "delete_volume" :: held 1.228s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:59:12 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-b09c9da5-150d-44e1-8a6b-84227dad6d5d tempest-CinderUnicodeTest-32846782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:59:12 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b09c9da5-150d-44e1-8a6b-84227dad6d5d tempest-CinderUnicodeTest-32846782 None] Flow 'volume_create_manager' (4b136a8c-025f-431f-a05c-8f8d51a56cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:59:12 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b09c9da5-150d-44e1-8a6b-84227dad6d5d tempest-CinderUnicodeTest-32846782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6a96a06-b7ac-496c-a70e-6192e887c1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:59:12 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b09c9da5-150d-44e1-8a6b-84227dad6d5d tempest-CinderUnicodeTest-32846782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6a96a06-b7ac-496c-a70e-6192e887c1e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:59:12Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d706d23-2f8c-4e05-b01c-d418c01014f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b8c17518d6242c39b05383f722b2cf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:59:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:59:12Z,use_quota=True,user_id='c612ca73debc4c6d8442d7c3e16ccfeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:59:12 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b09c9da5-150d-44e1-8a6b-84227dad6d5d tempest-CinderUnicodeTest-32846782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f60987f-aff3-471a-90a4-fe0ded4b85d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:59:12 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b09c9da5-150d-44e1-8a6b-84227dad6d5d tempest-CinderUnicodeTest-32846782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f60987f-aff3-471a-90a4-fe0ded4b85d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:59:12 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b09c9da5-150d-44e1-8a6b-84227dad6d5d tempest-CinderUnicodeTest-32846782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1bef977-d011-4b75-a7b0-25ce52bd4a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:59:12 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b09c9da5-150d-44e1-8a6b-84227dad6d5d tempest-CinderUnicodeTest-32846782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1bef977-d011-4b75-a7b0-25ce52bd4a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d706d23-2f8c-4e05-b01c-d418c01014f4', 'volume_name': 'volume-0d706d23-2f8c-4e05-b01c-d418c01014f4', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:59:12 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b09c9da5-150d-44e1-8a6b-84227dad6d5d tempest-CinderUnicodeTest-32846782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a98187b-8bb5-4845-a338-e9fbddc9fc19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:59:12 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b09c9da5-150d-44e1-8a6b-84227dad6d5d tempest-CinderUnicodeTest-32846782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a98187b-8bb5-4845-a338-e9fbddc9fc19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:59:12 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b09c9da5-150d-44e1-8a6b-84227dad6d5d tempest-CinderUnicodeTest-32846782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abac71fb-860c-40b1-bdbe-d66d892e4920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:59:12 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-b09c9da5-150d-44e1-8a6b-84227dad6d5d tempest-CinderUnicodeTest-32846782 None] Volume 0d706d23-2f8c-4e05-b01c-d418c01014f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d706d23-2f8c-4e05-b01c-d418c01014f4', 'volume_size': 1} Sep 08 06:59:12 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b09c9da5-150d-44e1-8a6b-84227dad6d5d tempest-CinderUnicodeTest-32846782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:59:12 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b09c9da5-150d-44e1-8a6b-84227dad6d5d tempest-CinderUnicodeTest-32846782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:59:12 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-b09c9da5-150d-44e1-8a6b-84227dad6d5d tempest-CinderUnicodeTest-32846782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:59:12Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d706d23-2f8c-4e05-b01c-d418c01014f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b8c17518d6242c39b05383f722b2cf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:59:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:59:12Z,use_quota=True,user_id='c612ca73debc4c6d8442d7c3e16ccfeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:59:12 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-b09c9da5-150d-44e1-8a6b-84227dad6d5d tempest-CinderUnicodeTest-32846782 None] Creating volume 0d706d23-2f8c-4e05-b01c-d418c01014f4 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:59:12 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b09c9da5-150d-44e1-8a6b-84227dad6d5d tempest-CinderUnicodeTest-32846782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:59:12 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b09c9da5-150d-44e1-8a6b-84227dad6d5d tempest-CinderUnicodeTest-32846782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:59:12 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-b09c9da5-150d-44e1-8a6b-84227dad6d5d tempest-CinderUnicodeTest-32846782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:59:12 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-b09c9da5-150d-44e1-8a6b-84227dad6d5d tempest-CinderUnicodeTest-32846782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:59:12 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b09c9da5-150d-44e1-8a6b-84227dad6d5d tempest-CinderUnicodeTest-32846782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:59:12 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-b09c9da5-150d-44e1-8a6b-84227dad6d5d tempest-CinderUnicodeTest-32846782 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:59:12 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-b09c9da5-150d-44e1-8a6b-84227dad6d5d tempest-CinderUnicodeTest-32846782 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:59:12 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b09c9da5-150d-44e1-8a6b-84227dad6d5d tempest-CinderUnicodeTest-32846782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0d706d23-2f8c-4e05-b01c-d418c01014f4 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:59:12 devstack sudo[120527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0d706d23-2f8c-4e05-b01c-d418c01014f4 1073741824 Sep 08 06:59:12 devstack sudo[120527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:59:12 devstack sudo[120527]: pam_unix(sudo:session): session closed for user root Sep 08 06:59:12 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b09c9da5-150d-44e1-8a6b-84227dad6d5d tempest-CinderUnicodeTest-32846782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0d706d23-2f8c-4e05-b01c-d418c01014f4 1073741824" returned: 0 in 0.513s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:59:12 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b09c9da5-150d-44e1-8a6b-84227dad6d5d tempest-CinderUnicodeTest-32846782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0d706d23-2f8c-4e05-b01c-d418c01014f4 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:59:12 devstack sudo[120548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0d706d23-2f8c-4e05-b01c-d418c01014f4 Sep 08 06:59:12 devstack sudo[120548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:59:13 devstack sudo[120548]: pam_unix(sudo:session): session closed for user root Sep 08 06:59:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b09c9da5-150d-44e1-8a6b-84227dad6d5d tempest-CinderUnicodeTest-32846782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0d706d23-2f8c-4e05-b01c-d418c01014f4" returned: 0 in 0.282s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:59:13 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-b09c9da5-150d-44e1-8a6b-84227dad6d5d tempest-CinderUnicodeTest-32846782 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:59:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b09c9da5-150d-44e1-8a6b-84227dad6d5d tempest-CinderUnicodeTest-32846782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:59:13 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b09c9da5-150d-44e1-8a6b-84227dad6d5d tempest-CinderUnicodeTest-32846782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abac71fb-860c-40b1-bdbe-d66d892e4920) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d706d23-2f8c-4e05-b01c-d418c01014f4', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:59:13 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b09c9da5-150d-44e1-8a6b-84227dad6d5d tempest-CinderUnicodeTest-32846782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af432378-3d58-4401-83f0-e6fdc08fffb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:59:13 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-b09c9da5-150d-44e1-8a6b-84227dad6d5d tempest-CinderUnicodeTest-32846782 None] Volume volume-0d706d23-2f8c-4e05-b01c-d418c01014f4 (0d706d23-2f8c-4e05-b01c-d418c01014f4): created successfully Sep 08 06:59:13 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b09c9da5-150d-44e1-8a6b-84227dad6d5d tempest-CinderUnicodeTest-32846782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af432378-3d58-4401-83f0-e6fdc08fffb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:59:13 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b09c9da5-150d-44e1-8a6b-84227dad6d5d tempest-CinderUnicodeTest-32846782 None] Flow 'volume_create_manager' (4b136a8c-025f-431f-a05c-8f8d51a56cdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:59:13 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-b09c9da5-150d-44e1-8a6b-84227dad6d5d tempest-CinderUnicodeTest-32846782 None] Created volume successfully. Sep 08 06:59:14 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-64619a1b-d3bb-4ff0-93e9-db58c2ce4594 tempest-CinderUnicodeTest-32846782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:59:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-64619a1b-d3bb-4ff0-93e9-db58c2ce4594 tempest-CinderUnicodeTest-32846782 None] Flow 'volume_create_manager' (b66f2ab9-204a-4355-bddd-034bbbdb21df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:59:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-64619a1b-d3bb-4ff0-93e9-db58c2ce4594 tempest-CinderUnicodeTest-32846782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2164f3fa-ab7c-4213-99db-5f788925cfd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:59:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-64619a1b-d3bb-4ff0-93e9-db58c2ce4594 tempest-CinderUnicodeTest-32846782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2164f3fa-ab7c-4213-99db-5f788925cfd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:59:15Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1919733131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d260ef3-bbec-4bea-91f6-6c7864b8d043,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b8c17518d6242c39b05383f722b2cf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:59:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:59:15Z,use_quota=True,user_id='c612ca73debc4c6d8442d7c3e16ccfeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:59:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-64619a1b-d3bb-4ff0-93e9-db58c2ce4594 tempest-CinderUnicodeTest-32846782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51a441e7-5f90-440f-84e8-027c50b52c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:59:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-64619a1b-d3bb-4ff0-93e9-db58c2ce4594 tempest-CinderUnicodeTest-32846782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51a441e7-5f90-440f-84e8-027c50b52c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:59:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-64619a1b-d3bb-4ff0-93e9-db58c2ce4594 tempest-CinderUnicodeTest-32846782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc51e918-1bcf-4765-bbea-92829c2cecea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:59:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-64619a1b-d3bb-4ff0-93e9-db58c2ce4594 tempest-CinderUnicodeTest-32846782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc51e918-1bcf-4765-bbea-92829c2cecea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d260ef3-bbec-4bea-91f6-6c7864b8d043', 'volume_name': 'volume-9d260ef3-bbec-4bea-91f6-6c7864b8d043', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:59:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-64619a1b-d3bb-4ff0-93e9-db58c2ce4594 tempest-CinderUnicodeTest-32846782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8ce743a-0c05-4a47-a170-6a6cadb46f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:59:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-64619a1b-d3bb-4ff0-93e9-db58c2ce4594 tempest-CinderUnicodeTest-32846782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8ce743a-0c05-4a47-a170-6a6cadb46f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:59:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-64619a1b-d3bb-4ff0-93e9-db58c2ce4594 tempest-CinderUnicodeTest-32846782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f74fde86-6673-46ff-ba1a-d6ae2ec447b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:59:14 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-64619a1b-d3bb-4ff0-93e9-db58c2ce4594 tempest-CinderUnicodeTest-32846782 None] Volume 9d260ef3-bbec-4bea-91f6-6c7864b8d043: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d260ef3-bbec-4bea-91f6-6c7864b8d043', 'volume_size': 1} Sep 08 06:59:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-64619a1b-d3bb-4ff0-93e9-db58c2ce4594 tempest-CinderUnicodeTest-32846782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:59:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-64619a1b-d3bb-4ff0-93e9-db58c2ce4594 tempest-CinderUnicodeTest-32846782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:59:14 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-64619a1b-d3bb-4ff0-93e9-db58c2ce4594 tempest-CinderUnicodeTest-32846782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:59:15Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1919733131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d260ef3-bbec-4bea-91f6-6c7864b8d043,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b8c17518d6242c39b05383f722b2cf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:59:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:59:15Z,use_quota=True,user_id='c612ca73debc4c6d8442d7c3e16ccfeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:59:14 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-64619a1b-d3bb-4ff0-93e9-db58c2ce4594 tempest-CinderUnicodeTest-32846782 None] Creating volume 9d260ef3-bbec-4bea-91f6-6c7864b8d043 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:59:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-64619a1b-d3bb-4ff0-93e9-db58c2ce4594 tempest-CinderUnicodeTest-32846782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:59:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-64619a1b-d3bb-4ff0-93e9-db58c2ce4594 tempest-CinderUnicodeTest-32846782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:59:14 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-64619a1b-d3bb-4ff0-93e9-db58c2ce4594 tempest-CinderUnicodeTest-32846782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:59:14 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-64619a1b-d3bb-4ff0-93e9-db58c2ce4594 tempest-CinderUnicodeTest-32846782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:59:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-64619a1b-d3bb-4ff0-93e9-db58c2ce4594 tempest-CinderUnicodeTest-32846782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:59:14 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-64619a1b-d3bb-4ff0-93e9-db58c2ce4594 tempest-CinderUnicodeTest-32846782 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:59:14 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-64619a1b-d3bb-4ff0-93e9-db58c2ce4594 tempest-CinderUnicodeTest-32846782 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:59:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-64619a1b-d3bb-4ff0-93e9-db58c2ce4594 tempest-CinderUnicodeTest-32846782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9d260ef3-bbec-4bea-91f6-6c7864b8d043 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:59:14 devstack sudo[120613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9d260ef3-bbec-4bea-91f6-6c7864b8d043 1073741824 Sep 08 06:59:14 devstack sudo[120613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:59:15 devstack sudo[120613]: pam_unix(sudo:session): session closed for user root Sep 08 06:59:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-64619a1b-d3bb-4ff0-93e9-db58c2ce4594 tempest-CinderUnicodeTest-32846782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9d260ef3-bbec-4bea-91f6-6c7864b8d043 1073741824" returned: 0 in 0.448s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:59:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-64619a1b-d3bb-4ff0-93e9-db58c2ce4594 tempest-CinderUnicodeTest-32846782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9d260ef3-bbec-4bea-91f6-6c7864b8d043 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:59:15 devstack sudo[120634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9d260ef3-bbec-4bea-91f6-6c7864b8d043 Sep 08 06:59:15 devstack sudo[120634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:59:15 devstack sudo[120634]: pam_unix(sudo:session): session closed for user root Sep 08 06:59:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-64619a1b-d3bb-4ff0-93e9-db58c2ce4594 tempest-CinderUnicodeTest-32846782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9d260ef3-bbec-4bea-91f6-6c7864b8d043" returned: 0 in 0.254s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:59:15 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-64619a1b-d3bb-4ff0-93e9-db58c2ce4594 tempest-CinderUnicodeTest-32846782 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:59:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-64619a1b-d3bb-4ff0-93e9-db58c2ce4594 tempest-CinderUnicodeTest-32846782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:59:15 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-64619a1b-d3bb-4ff0-93e9-db58c2ce4594 tempest-CinderUnicodeTest-32846782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f74fde86-6673-46ff-ba1a-d6ae2ec447b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d260ef3-bbec-4bea-91f6-6c7864b8d043', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:59:15 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-64619a1b-d3bb-4ff0-93e9-db58c2ce4594 tempest-CinderUnicodeTest-32846782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (841f2580-0b53-4d53-bb34-df1eb73dda16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:59:15 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-64619a1b-d3bb-4ff0-93e9-db58c2ce4594 tempest-CinderUnicodeTest-32846782 None] Volume volume-9d260ef3-bbec-4bea-91f6-6c7864b8d043 (9d260ef3-bbec-4bea-91f6-6c7864b8d043): created successfully Sep 08 06:59:15 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-64619a1b-d3bb-4ff0-93e9-db58c2ce4594 tempest-CinderUnicodeTest-32846782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (841f2580-0b53-4d53-bb34-df1eb73dda16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:59:15 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-64619a1b-d3bb-4ff0-93e9-db58c2ce4594 tempest-CinderUnicodeTest-32846782 None] Flow 'volume_create_manager' (b66f2ab9-204a-4355-bddd-034bbbdb21df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:59:15 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-64619a1b-d3bb-4ff0-93e9-db58c2ce4594 tempest-CinderUnicodeTest-32846782 None] Created volume successfully. Sep 08 06:59:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a5c3fa2b-6ab9-4124-b6c9-82001141cdb1 tempest-CinderUnicodeTest-32846782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:59:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a5c3fa2b-6ab9-4124-b6c9-82001141cdb1 tempest-CinderUnicodeTest-32846782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:59:16 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-a5c3fa2b-6ab9-4124-b6c9-82001141cdb1 tempest-CinderUnicodeTest-32846782 None] Creating offline snapshot e504a802-6d53-4cba-a0cf-5018e8cb2242 of volume 9d260ef3-bbec-4bea-91f6-6c7864b8d043 {{(pid=87507) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 06:59:16 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c3c1d7-66ce-4548-b0b6-a86c5451d27f]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:59:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a5c3fa2b-6ab9-4124-b6c9-82001141cdb1 tempest-CinderUnicodeTest-32846782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9d260ef3-bbec-4bea-91f6-6c7864b8d043 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:59:16 devstack sudo[120664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9d260ef3-bbec-4bea-91f6-6c7864b8d043 Sep 08 06:59:16 devstack sudo[120664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:59:16 devstack sudo[120664]: pam_unix(sudo:session): session closed for user root Sep 08 06:59:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a5c3fa2b-6ab9-4124-b6c9-82001141cdb1 tempest-CinderUnicodeTest-32846782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9d260ef3-bbec-4bea-91f6-6c7864b8d043" returned: 0 in 0.412s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:59:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a5c3fa2b-6ab9-4124-b6c9-82001141cdb1 tempest-CinderUnicodeTest-32846782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9d260ef3-bbec-4bea-91f6-6c7864b8d043,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9d260ef3-bbec-4bea-91f6-6c7864b8d043.e504a802-6d53-4cba-a0cf-5018e8cb2242 1G {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:59:16 devstack sudo[120681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9d260ef3-bbec-4bea-91f6-6c7864b8d043,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9d260ef3-bbec-4bea-91f6-6c7864b8d043.e504a802-6d53-4cba-a0cf-5018e8cb2242 1G Sep 08 06:59:16 devstack sudo[120681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:59:17 devstack sudo[120681]: pam_unix(sudo:session): session closed for user root Sep 08 06:59:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a5c3fa2b-6ab9-4124-b6c9-82001141cdb1 tempest-CinderUnicodeTest-32846782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9d260ef3-bbec-4bea-91f6-6c7864b8d043,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9d260ef3-bbec-4bea-91f6-6c7864b8d043.e504a802-6d53-4cba-a0cf-5018e8cb2242 1G" returned: 0 in 0.443s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:59:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a5c3fa2b-6ab9-4124-b6c9-82001141cdb1 tempest-CinderUnicodeTest-32846782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d260ef3-bbec-4bea-91f6-6c7864b8d043 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9d260ef3-bbec-4bea-91f6-6c7864b8d043.e504a802-6d53-4cba-a0cf-5018e8cb2242 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:59:17 devstack sudo[120701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d260ef3-bbec-4bea-91f6-6c7864b8d043 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9d260ef3-bbec-4bea-91f6-6c7864b8d043.e504a802-6d53-4cba-a0cf-5018e8cb2242 Sep 08 06:59:17 devstack sudo[120701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:59:17 devstack sudo[120701]: pam_unix(sudo:session): session closed for user root Sep 08 06:59:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a5c3fa2b-6ab9-4124-b6c9-82001141cdb1 tempest-CinderUnicodeTest-32846782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d260ef3-bbec-4bea-91f6-6c7864b8d043 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9d260ef3-bbec-4bea-91f6-6c7864b8d043.e504a802-6d53-4cba-a0cf-5018e8cb2242" returned: 0 in 0.327s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:59:17 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-a5c3fa2b-6ab9-4124-b6c9-82001141cdb1 tempest-CinderUnicodeTest-32846782 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9d260ef3-bbec-4bea-91f6-6c7864b8d043.e504a802-6d53-4cba-a0cf-5018e8cb2242 is being set with open permissions: ugo+rw Sep 08 06:59:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a5c3fa2b-6ab9-4124-b6c9-82001141cdb1 tempest-CinderUnicodeTest-32846782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9d260ef3-bbec-4bea-91f6-6c7864b8d043.e504a802-6d53-4cba-a0cf-5018e8cb2242 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:59:17 devstack sudo[120717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9d260ef3-bbec-4bea-91f6-6c7864b8d043.e504a802-6d53-4cba-a0cf-5018e8cb2242 Sep 08 06:59:17 devstack sudo[120717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:59:17 devstack sudo[120717]: pam_unix(sudo:session): session closed for user root Sep 08 06:59:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a5c3fa2b-6ab9-4124-b6c9-82001141cdb1 tempest-CinderUnicodeTest-32846782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9d260ef3-bbec-4bea-91f6-6c7864b8d043.e504a802-6d53-4cba-a0cf-5018e8cb2242" returned: 0 in 0.273s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:59:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a5c3fa2b-6ab9-4124-b6c9-82001141cdb1 tempest-CinderUnicodeTest-32846782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9d260ef3-bbec-4bea-91f6-6c7864b8d043.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:59:17 devstack sudo[120729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9d260ef3-bbec-4bea-91f6-6c7864b8d043.info Sep 08 06:59:17 devstack sudo[120729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:59:18 devstack sudo[120729]: pam_unix(sudo:session): session closed for user root Sep 08 06:59:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a5c3fa2b-6ab9-4124-b6c9-82001141cdb1 tempest-CinderUnicodeTest-32846782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9d260ef3-bbec-4bea-91f6-6c7864b8d043.info" returned: 0 in 0.250s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:59:18 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-a5c3fa2b-6ab9-4124-b6c9-82001141cdb1 tempest-CinderUnicodeTest-32846782 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9d260ef3-bbec-4bea-91f6-6c7864b8d043.info is being set with open permissions: ugo+rw Sep 08 06:59:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a5c3fa2b-6ab9-4124-b6c9-82001141cdb1 tempest-CinderUnicodeTest-32846782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9d260ef3-bbec-4bea-91f6-6c7864b8d043.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:59:18 devstack sudo[120739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9d260ef3-bbec-4bea-91f6-6c7864b8d043.info Sep 08 06:59:18 devstack sudo[120739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:59:18 devstack sudo[120739]: pam_unix(sudo:session): session closed for user root Sep 08 06:59:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a5c3fa2b-6ab9-4124-b6c9-82001141cdb1 tempest-CinderUnicodeTest-32846782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9d260ef3-bbec-4bea-91f6-6c7864b8d043.info" returned: 0 in 0.256s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:59:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a5c3fa2b-6ab9-4124-b6c9-82001141cdb1 tempest-CinderUnicodeTest-32846782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.054s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:59:18 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-a5c3fa2b-6ab9-4124-b6c9-82001141cdb1 tempest-CinderUnicodeTest-32846782 None] Create snapshot completed successfully Sep 08 06:59:19 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-4444a421-d3cc-47b8-a67a-1fa330ac49a2 tempest-CinderUnicodeTest-32846782 None] Acquiring lock "cinder-e504a802-6d53-4cba-a0cf-5018e8cb2242-delete_snapshot" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:59:19 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-4444a421-d3cc-47b8-a67a-1fa330ac49a2 tempest-CinderUnicodeTest-32846782 None] Lock "cinder-e504a802-6d53-4cba-a0cf-5018e8cb2242-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:59:19 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-4444a421-d3cc-47b8-a67a-1fa330ac49a2 tempest-CinderUnicodeTest-32846782 None] Acquiring lock "cinder-quobyte-9d260ef3-bbec-4bea-91f6-6c7864b8d043" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:59:19 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-4444a421-d3cc-47b8-a67a-1fa330ac49a2 tempest-CinderUnicodeTest-32846782 None] Lock "cinder-quobyte-9d260ef3-bbec-4bea-91f6-6c7864b8d043" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:59:19 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-4444a421-d3cc-47b8-a67a-1fa330ac49a2 tempest-CinderUnicodeTest-32846782 None] Acquiring lock "cinder-quobyte-e504a802-6d53-4cba-a0cf-5018e8cb2242" by "_delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:59:19 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-4444a421-d3cc-47b8-a67a-1fa330ac49a2 tempest-CinderUnicodeTest-32846782 None] Lock "cinder-quobyte-e504a802-6d53-4cba-a0cf-5018e8cb2242" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:59:19 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-4444a421-d3cc-47b8-a67a-1fa330ac49a2 tempest-CinderUnicodeTest-32846782 None] Deleting offline snapshot e504a802-6d53-4cba-a0cf-5018e8cb2242 of volume 9d260ef3-bbec-4bea-91f6-6c7864b8d043 {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 06:59:19 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-4444a421-d3cc-47b8-a67a-1fa330ac49a2 tempest-CinderUnicodeTest-32846782 None] snapshot_file for this snap is: volume-9d260ef3-bbec-4bea-91f6-6c7864b8d043.e504a802-6d53-4cba-a0cf-5018e8cb2242 {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 06:59:19 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a76a47-96de-45c0-9802-57b0297593fc]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:59:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4444a421-d3cc-47b8-a67a-1fa330ac49a2 tempest-CinderUnicodeTest-32846782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9d260ef3-bbec-4bea-91f6-6c7864b8d043.e504a802-6d53-4cba-a0cf-5018e8cb2242 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:59:19 devstack sudo[120792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9d260ef3-bbec-4bea-91f6-6c7864b8d043.e504a802-6d53-4cba-a0cf-5018e8cb2242 Sep 08 06:59:19 devstack sudo[120792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:59:20 devstack sudo[120792]: pam_unix(sudo:session): session closed for user root Sep 08 06:59:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4444a421-d3cc-47b8-a67a-1fa330ac49a2 tempest-CinderUnicodeTest-32846782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9d260ef3-bbec-4bea-91f6-6c7864b8d043.e504a802-6d53-4cba-a0cf-5018e8cb2242" returned: 0 in 0.377s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:59:20 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-4444a421-d3cc-47b8-a67a-1fa330ac49a2 tempest-CinderUnicodeTest-32846782 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d260ef3-bbec-4bea-91f6-6c7864b8d043(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 06:59:20 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5545455c-3071-4f15-a409-963d1e9222e5]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:59:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4444a421-d3cc-47b8-a67a-1fa330ac49a2 tempest-CinderUnicodeTest-32846782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9d260ef3-bbec-4bea-91f6-6c7864b8d043 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:59:20 devstack cinder-volume[87507]: DEBUG oslo_service.periodic_task [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87507) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 06:59:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:59:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:59:20 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:59:20 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:59:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:59:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:59:20 devstack sudo[120810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:59:20 devstack sudo[120810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:59:20 devstack sudo[120809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9d260ef3-bbec-4bea-91f6-6c7864b8d043 Sep 08 06:59:20 devstack sudo[120809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:59:20 devstack sudo[120810]: pam_unix(sudo:session): session closed for user root Sep 08 06:59:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.282s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:59:20 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:59:20 devstack cinder-volume[87507]: DEBUG oslo_service.periodic_task [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Running periodic task VolumeManager._thread_info {{(pid=87507) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 06:59:20 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] thread count: 29 {{(pid=87507) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 06:59:20 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] thread info: [<_MainThread(MainThread, started 127913129345152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87507) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 06:59:20 devstack sudo[120809]: pam_unix(sudo:session): session closed for user root Sep 08 06:59:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4444a421-d3cc-47b8-a67a-1fa330ac49a2 tempest-CinderUnicodeTest-32846782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9d260ef3-bbec-4bea-91f6-6c7864b8d043" returned: 0 in 0.383s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:59:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4444a421-d3cc-47b8-a67a-1fa330ac49a2 tempest-CinderUnicodeTest-32846782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9d260ef3-bbec-4bea-91f6-6c7864b8d043.e504a802-6d53-4cba-a0cf-5018e8cb2242 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:59:20 devstack sudo[120829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9d260ef3-bbec-4bea-91f6-6c7864b8d043.e504a802-6d53-4cba-a0cf-5018e8cb2242 Sep 08 06:59:20 devstack sudo[120829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:59:20 devstack sudo[120829]: pam_unix(sudo:session): session closed for user root Sep 08 06:59:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4444a421-d3cc-47b8-a67a-1fa330ac49a2 tempest-CinderUnicodeTest-32846782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9d260ef3-bbec-4bea-91f6-6c7864b8d043.e504a802-6d53-4cba-a0cf-5018e8cb2242" returned: 0 in 0.360s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:59:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4444a421-d3cc-47b8-a67a-1fa330ac49a2 tempest-CinderUnicodeTest-32846782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9d260ef3-bbec-4bea-91f6-6c7864b8d043.e504a802-6d53-4cba-a0cf-5018e8cb2242 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:59:20 devstack sudo[120844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9d260ef3-bbec-4bea-91f6-6c7864b8d043.e504a802-6d53-4cba-a0cf-5018e8cb2242 Sep 08 06:59:20 devstack sudo[120844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:59:21 devstack sudo[120844]: pam_unix(sudo:session): session closed for user root Sep 08 06:59:21 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4444a421-d3cc-47b8-a67a-1fa330ac49a2 tempest-CinderUnicodeTest-32846782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9d260ef3-bbec-4bea-91f6-6c7864b8d043.e504a802-6d53-4cba-a0cf-5018e8cb2242" returned: 0 in 0.258s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:59:21 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-4444a421-d3cc-47b8-a67a-1fa330ac49a2 tempest-CinderUnicodeTest-32846782 None] Lock "cinder-quobyte-e504a802-6d53-4cba-a0cf-5018e8cb2242" released by "_delete_snapshot" :: held 1.512s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:59:21 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-4444a421-d3cc-47b8-a67a-1fa330ac49a2 tempest-CinderUnicodeTest-32846782 None] Lock "cinder-quobyte-9d260ef3-bbec-4bea-91f6-6c7864b8d043" released by "delete_snapshot" :: held 1.539s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:59:21 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-4444a421-d3cc-47b8-a67a-1fa330ac49a2 tempest-CinderUnicodeTest-32846782 None] Created reservations ['14767b1b-dba8-43ef-8f0f-91def5b16981', '8375ae48-6ada-4e24-8ac3-499ce697ab4c', '0b57c5d8-d7f6-4ab6-a06b-bea37f29666f', 'a3dce1a9-0482-455c-af3b-2a8b01e64e76'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:59:21 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-4444a421-d3cc-47b8-a67a-1fa330ac49a2 tempest-CinderUnicodeTest-32846782 None] Delete snapshot completed successfully. Sep 08 06:59:21 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-4444a421-d3cc-47b8-a67a-1fa330ac49a2 tempest-CinderUnicodeTest-32846782 None] Lock "cinder-e504a802-6d53-4cba-a0cf-5018e8cb2242-delete_snapshot" released by "delete_snapshot" :: held 1.721s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:59:21 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-87d60118-b08c-48ad-a239-5ade265b605c tempest-CinderUnicodeTest-32846782 None] Acquiring lock "cinder-9d260ef3-bbec-4bea-91f6-6c7864b8d043-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:59:21 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-87d60118-b08c-48ad-a239-5ade265b605c tempest-CinderUnicodeTest-32846782 None] Lock "cinder-9d260ef3-bbec-4bea-91f6-6c7864b8d043-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:59:21 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-87d60118-b08c-48ad-a239-5ade265b605c tempest-CinderUnicodeTest-32846782 None] Acquiring lock "cinder-quobyte-9d260ef3-bbec-4bea-91f6-6c7864b8d043" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:59:21 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-87d60118-b08c-48ad-a239-5ade265b605c tempest-CinderUnicodeTest-32846782 None] Lock "cinder-quobyte-9d260ef3-bbec-4bea-91f6-6c7864b8d043" acquired by "delete_volume" :: waited 0.017s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:59:21 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c45351-1e8d-4ff1-992c-f24ff81135ef]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:59:21 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-87d60118-b08c-48ad-a239-5ade265b605c tempest-CinderUnicodeTest-32846782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9d260ef3-bbec-4bea-91f6-6c7864b8d043 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:59:21 devstack sudo[120877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9d260ef3-bbec-4bea-91f6-6c7864b8d043 Sep 08 06:59:21 devstack sudo[120877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:59:22 devstack sudo[120877]: pam_unix(sudo:session): session closed for user root Sep 08 06:59:22 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-87d60118-b08c-48ad-a239-5ade265b605c tempest-CinderUnicodeTest-32846782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9d260ef3-bbec-4bea-91f6-6c7864b8d043" returned: 0 in 0.363s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:59:22 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-87d60118-b08c-48ad-a239-5ade265b605c tempest-CinderUnicodeTest-32846782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9d260ef3-bbec-4bea-91f6-6c7864b8d043 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:59:22 devstack sudo[120894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9d260ef3-bbec-4bea-91f6-6c7864b8d043 Sep 08 06:59:22 devstack sudo[120894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:59:22 devstack sudo[120894]: pam_unix(sudo:session): session closed for user root Sep 08 06:59:22 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-87d60118-b08c-48ad-a239-5ade265b605c tempest-CinderUnicodeTest-32846782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9d260ef3-bbec-4bea-91f6-6c7864b8d043" returned: 0 in 0.248s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:59:22 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-87d60118-b08c-48ad-a239-5ade265b605c tempest-CinderUnicodeTest-32846782 None] Lock "cinder-quobyte-9d260ef3-bbec-4bea-91f6-6c7864b8d043" released by "delete_volume" :: held 0.693s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:59:22 devstack cinder-volume[87507]: DEBUG dbcounter [-] [87507] Writing DB stats cinder:UPDATE=103,cinder:SELECT=94,cinder:INSERT=32,cinder:DELETE=6 {{(pid=87507) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 06:59:22 devstack cinder-volume[87507]: DEBUG dbcounter [-] [87507] Writing DB stats cinder:SELECT=99,cinder:INSERT=31,cinder:UPDATE=87,cinder:DELETE=9 {{(pid=87507) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 06:59:22 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-87d60118-b08c-48ad-a239-5ade265b605c tempest-CinderUnicodeTest-32846782 None] Created reservations ['11da3c92-507a-4fcb-9f47-63574959f51f', '9c2bf8e4-a30d-436e-817e-438a691fd320', 'c692811b-8bff-4044-8981-e6e9b565f4b9', '5b53f16b-81bf-4bb8-860e-a2527c57abf7'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:59:22 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-87d60118-b08c-48ad-a239-5ade265b605c tempest-CinderUnicodeTest-32846782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:59:22 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-87d60118-b08c-48ad-a239-5ade265b605c tempest-CinderUnicodeTest-32846782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:59:22 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-87d60118-b08c-48ad-a239-5ade265b605c tempest-CinderUnicodeTest-32846782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:59:22 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-87d60118-b08c-48ad-a239-5ade265b605c tempest-CinderUnicodeTest-32846782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:59:22 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-87d60118-b08c-48ad-a239-5ade265b605c tempest-CinderUnicodeTest-32846782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:59:22 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-87d60118-b08c-48ad-a239-5ade265b605c tempest-CinderUnicodeTest-32846782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:59:22 devstack sudo[120910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:59:22 devstack sudo[120910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:59:22 devstack sudo[120910]: pam_unix(sudo:session): session closed for user root Sep 08 06:59:22 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-87d60118-b08c-48ad-a239-5ade265b605c tempest-CinderUnicodeTest-32846782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.257s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:59:22 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-87d60118-b08c-48ad-a239-5ade265b605c tempest-CinderUnicodeTest-32846782 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:59:22 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-87d60118-b08c-48ad-a239-5ade265b605c tempest-CinderUnicodeTest-32846782 None] Deleted volume successfully. Sep 08 06:59:22 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-f578c408-181f-4916-b445-b7b11e7680a6 tempest-CinderUnicodeTest-32846782 None] Acquiring lock "cinder-0d706d23-2f8c-4e05-b01c-d418c01014f4-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:59:22 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-87d60118-b08c-48ad-a239-5ade265b605c tempest-CinderUnicodeTest-32846782 None] Lock "cinder-9d260ef3-bbec-4bea-91f6-6c7864b8d043-delete_volume" released by "delete_volume" :: held 1.186s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:59:22 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-f578c408-181f-4916-b445-b7b11e7680a6 tempest-CinderUnicodeTest-32846782 None] Lock "cinder-0d706d23-2f8c-4e05-b01c-d418c01014f4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:59:22 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-f578c408-181f-4916-b445-b7b11e7680a6 tempest-CinderUnicodeTest-32846782 None] Acquiring lock "cinder-quobyte-0d706d23-2f8c-4e05-b01c-d418c01014f4" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:59:22 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-f578c408-181f-4916-b445-b7b11e7680a6 tempest-CinderUnicodeTest-32846782 None] Lock "cinder-quobyte-0d706d23-2f8c-4e05-b01c-d418c01014f4" acquired by "delete_volume" :: waited 0.014s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:59:22 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24a2650-eea0-481c-a579-8cda4326fe3c]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:59:22 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f578c408-181f-4916-b445-b7b11e7680a6 tempest-CinderUnicodeTest-32846782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0d706d23-2f8c-4e05-b01c-d418c01014f4 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:59:23 devstack sudo[120925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0d706d23-2f8c-4e05-b01c-d418c01014f4 Sep 08 06:59:23 devstack sudo[120925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:59:23 devstack sudo[120925]: pam_unix(sudo:session): session closed for user root Sep 08 06:59:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f578c408-181f-4916-b445-b7b11e7680a6 tempest-CinderUnicodeTest-32846782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0d706d23-2f8c-4e05-b01c-d418c01014f4" returned: 0 in 0.388s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:59:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f578c408-181f-4916-b445-b7b11e7680a6 tempest-CinderUnicodeTest-32846782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0d706d23-2f8c-4e05-b01c-d418c01014f4 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:59:23 devstack sudo[120942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0d706d23-2f8c-4e05-b01c-d418c01014f4 Sep 08 06:59:23 devstack sudo[120942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:59:23 devstack sudo[120942]: pam_unix(sudo:session): session closed for user root Sep 08 06:59:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f578c408-181f-4916-b445-b7b11e7680a6 tempest-CinderUnicodeTest-32846782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0d706d23-2f8c-4e05-b01c-d418c01014f4" returned: 0 in 0.284s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:59:23 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-f578c408-181f-4916-b445-b7b11e7680a6 tempest-CinderUnicodeTest-32846782 None] Lock "cinder-quobyte-0d706d23-2f8c-4e05-b01c-d418c01014f4" released by "delete_volume" :: held 0.717s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:59:23 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-f578c408-181f-4916-b445-b7b11e7680a6 tempest-CinderUnicodeTest-32846782 None] Created reservations ['74e64f66-7b63-499b-a9bf-ab159e912de5', '12638517-0718-44d1-ae93-fe9cd8abb517', '067f8567-83b4-45d8-bcbd-85de86d5d36a', '8f77151f-7435-4bee-8935-34d64ce8e6e1'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:59:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-f578c408-181f-4916-b445-b7b11e7680a6 tempest-CinderUnicodeTest-32846782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:59:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-f578c408-181f-4916-b445-b7b11e7680a6 tempest-CinderUnicodeTest-32846782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:59:23 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-f578c408-181f-4916-b445-b7b11e7680a6 tempest-CinderUnicodeTest-32846782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:59:23 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-f578c408-181f-4916-b445-b7b11e7680a6 tempest-CinderUnicodeTest-32846782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:59:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-f578c408-181f-4916-b445-b7b11e7680a6 tempest-CinderUnicodeTest-32846782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:59:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f578c408-181f-4916-b445-b7b11e7680a6 tempest-CinderUnicodeTest-32846782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:59:23 devstack sudo[120957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:59:23 devstack sudo[120957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:59:24 devstack sudo[120957]: pam_unix(sudo:session): session closed for user root Sep 08 06:59:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f578c408-181f-4916-b445-b7b11e7680a6 tempest-CinderUnicodeTest-32846782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.251s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:59:24 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-f578c408-181f-4916-b445-b7b11e7680a6 tempest-CinderUnicodeTest-32846782 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:59:24 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-f578c408-181f-4916-b445-b7b11e7680a6 tempest-CinderUnicodeTest-32846782 None] Deleted volume successfully. Sep 08 06:59:24 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-f578c408-181f-4916-b445-b7b11e7680a6 tempest-CinderUnicodeTest-32846782 None] Lock "cinder-0d706d23-2f8c-4e05-b01c-d418c01014f4-delete_volume" released by "delete_volume" :: held 1.189s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:59:28 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-066681bc-b3bc-42f2-9757-fc1cf2b66489 tempest-ProjectReaderTests-381070331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:59:28 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-066681bc-b3bc-42f2-9757-fc1cf2b66489 tempest-ProjectReaderTests-381070331 None] Flow 'volume_create_manager' (388c3658-d114-42c8-9d00-31e8a6e75d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:59:28 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-066681bc-b3bc-42f2-9757-fc1cf2b66489 tempest-ProjectReaderTests-381070331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62bc6a0e-506d-4187-bc7c-44a14096a9c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:59:28 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-066681bc-b3bc-42f2-9757-fc1cf2b66489 tempest-ProjectReaderTests-381070331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62bc6a0e-506d-4187-bc7c-44a14096a9c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:59:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1182103671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d046f8d-1a59-4a4a-b784-b361e7a0562d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92fc69b8c90b45b69a9120d4fdb84c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:59:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:59:29Z,use_quota=True,user_id='25fc7a35eda643a79476b686c0fa7681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:59:28 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-066681bc-b3bc-42f2-9757-fc1cf2b66489 tempest-ProjectReaderTests-381070331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (434376f7-1122-4e28-8b90-31a4f171e40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:59:28 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-066681bc-b3bc-42f2-9757-fc1cf2b66489 tempest-ProjectReaderTests-381070331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (434376f7-1122-4e28-8b90-31a4f171e40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:59:28 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-066681bc-b3bc-42f2-9757-fc1cf2b66489 tempest-ProjectReaderTests-381070331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d5adcb8-ecd4-40f6-8119-534eca6ffee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:59:29 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-066681bc-b3bc-42f2-9757-fc1cf2b66489 tempest-ProjectReaderTests-381070331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d5adcb8-ecd4-40f6-8119-534eca6ffee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d046f8d-1a59-4a4a-b784-b361e7a0562d', 'volume_name': 'volume-8d046f8d-1a59-4a4a-b784-b361e7a0562d', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:59:29 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-066681bc-b3bc-42f2-9757-fc1cf2b66489 tempest-ProjectReaderTests-381070331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (460ee3d1-bf34-477d-b66a-06d7a4738bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:59:29 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-066681bc-b3bc-42f2-9757-fc1cf2b66489 tempest-ProjectReaderTests-381070331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (460ee3d1-bf34-477d-b66a-06d7a4738bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:59:29 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-066681bc-b3bc-42f2-9757-fc1cf2b66489 tempest-ProjectReaderTests-381070331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ffc674d-1b4b-4508-b903-118cc94970ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:59:29 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-066681bc-b3bc-42f2-9757-fc1cf2b66489 tempest-ProjectReaderTests-381070331 None] Volume 8d046f8d-1a59-4a4a-b784-b361e7a0562d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d046f8d-1a59-4a4a-b784-b361e7a0562d', 'volume_size': 1} Sep 08 06:59:29 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-066681bc-b3bc-42f2-9757-fc1cf2b66489 tempest-ProjectReaderTests-381070331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:59:29 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-066681bc-b3bc-42f2-9757-fc1cf2b66489 tempest-ProjectReaderTests-381070331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:59:29 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-066681bc-b3bc-42f2-9757-fc1cf2b66489 tempest-ProjectReaderTests-381070331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:59:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1182103671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d046f8d-1a59-4a4a-b784-b361e7a0562d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92fc69b8c90b45b69a9120d4fdb84c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:59:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:59:29Z,use_quota=True,user_id='25fc7a35eda643a79476b686c0fa7681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:59:29 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-066681bc-b3bc-42f2-9757-fc1cf2b66489 tempest-ProjectReaderTests-381070331 None] Creating volume 8d046f8d-1a59-4a4a-b784-b361e7a0562d {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:59:29 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-066681bc-b3bc-42f2-9757-fc1cf2b66489 tempest-ProjectReaderTests-381070331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:59:29 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-066681bc-b3bc-42f2-9757-fc1cf2b66489 tempest-ProjectReaderTests-381070331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:59:29 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-066681bc-b3bc-42f2-9757-fc1cf2b66489 tempest-ProjectReaderTests-381070331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:59:29 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-066681bc-b3bc-42f2-9757-fc1cf2b66489 tempest-ProjectReaderTests-381070331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:59:29 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-066681bc-b3bc-42f2-9757-fc1cf2b66489 tempest-ProjectReaderTests-381070331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:59:29 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-066681bc-b3bc-42f2-9757-fc1cf2b66489 tempest-ProjectReaderTests-381070331 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:59:29 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-066681bc-b3bc-42f2-9757-fc1cf2b66489 tempest-ProjectReaderTests-381070331 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:59:29 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-066681bc-b3bc-42f2-9757-fc1cf2b66489 tempest-ProjectReaderTests-381070331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8d046f8d-1a59-4a4a-b784-b361e7a0562d 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:59:29 devstack sudo[121152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8d046f8d-1a59-4a4a-b784-b361e7a0562d 1073741824 Sep 08 06:59:29 devstack sudo[121152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:59:29 devstack sudo[121152]: pam_unix(sudo:session): session closed for user root Sep 08 06:59:29 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-066681bc-b3bc-42f2-9757-fc1cf2b66489 tempest-ProjectReaderTests-381070331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8d046f8d-1a59-4a4a-b784-b361e7a0562d 1073741824" returned: 0 in 0.489s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:59:29 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-066681bc-b3bc-42f2-9757-fc1cf2b66489 tempest-ProjectReaderTests-381070331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8d046f8d-1a59-4a4a-b784-b361e7a0562d {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:59:29 devstack sudo[121174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8d046f8d-1a59-4a4a-b784-b361e7a0562d Sep 08 06:59:29 devstack sudo[121174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:59:29 devstack sudo[121174]: pam_unix(sudo:session): session closed for user root Sep 08 06:59:29 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-066681bc-b3bc-42f2-9757-fc1cf2b66489 tempest-ProjectReaderTests-381070331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8d046f8d-1a59-4a4a-b784-b361e7a0562d" returned: 0 in 0.271s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:59:29 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-066681bc-b3bc-42f2-9757-fc1cf2b66489 tempest-ProjectReaderTests-381070331 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:59:29 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-066681bc-b3bc-42f2-9757-fc1cf2b66489 tempest-ProjectReaderTests-381070331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:59:29 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-066681bc-b3bc-42f2-9757-fc1cf2b66489 tempest-ProjectReaderTests-381070331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ffc674d-1b4b-4508-b903-118cc94970ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d046f8d-1a59-4a4a-b784-b361e7a0562d', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:59:29 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-066681bc-b3bc-42f2-9757-fc1cf2b66489 tempest-ProjectReaderTests-381070331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87047d2f-8db4-46fa-a7fc-d37913bea315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:59:29 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-066681bc-b3bc-42f2-9757-fc1cf2b66489 tempest-ProjectReaderTests-381070331 None] Volume volume-8d046f8d-1a59-4a4a-b784-b361e7a0562d (8d046f8d-1a59-4a4a-b784-b361e7a0562d): created successfully Sep 08 06:59:29 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-066681bc-b3bc-42f2-9757-fc1cf2b66489 tempest-ProjectReaderTests-381070331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87047d2f-8db4-46fa-a7fc-d37913bea315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:59:29 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-066681bc-b3bc-42f2-9757-fc1cf2b66489 tempest-ProjectReaderTests-381070331 None] Flow 'volume_create_manager' (388c3658-d114-42c8-9d00-31e8a6e75d73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:59:29 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-066681bc-b3bc-42f2-9757-fc1cf2b66489 tempest-ProjectReaderTests-381070331 None] Created volume successfully. Sep 08 06:59:31 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-71b161e3-7230-4a19-ab13-5d50f17eb758 tempest-ProjectReaderTests-381070331 None] Acquiring lock "cinder-8d046f8d-1a59-4a4a-b784-b361e7a0562d-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:59:31 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-71b161e3-7230-4a19-ab13-5d50f17eb758 tempest-ProjectReaderTests-381070331 None] Lock "cinder-8d046f8d-1a59-4a4a-b784-b361e7a0562d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:59:31 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-71b161e3-7230-4a19-ab13-5d50f17eb758 tempest-ProjectReaderTests-381070331 None] Acquiring lock "cinder-quobyte-8d046f8d-1a59-4a4a-b784-b361e7a0562d" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:59:31 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-71b161e3-7230-4a19-ab13-5d50f17eb758 tempest-ProjectReaderTests-381070331 None] Lock "cinder-quobyte-8d046f8d-1a59-4a4a-b784-b361e7a0562d" acquired by "delete_volume" :: waited 0.015s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:59:31 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c16890-3af4-4a4e-8489-ff0eaa50890f]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:59:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-71b161e3-7230-4a19-ab13-5d50f17eb758 tempest-ProjectReaderTests-381070331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8d046f8d-1a59-4a4a-b784-b361e7a0562d {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:59:31 devstack sudo[121231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8d046f8d-1a59-4a4a-b784-b361e7a0562d Sep 08 06:59:31 devstack sudo[121231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:59:31 devstack sudo[121231]: pam_unix(sudo:session): session closed for user root Sep 08 06:59:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-71b161e3-7230-4a19-ab13-5d50f17eb758 tempest-ProjectReaderTests-381070331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8d046f8d-1a59-4a4a-b784-b361e7a0562d" returned: 0 in 0.391s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:59:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-71b161e3-7230-4a19-ab13-5d50f17eb758 tempest-ProjectReaderTests-381070331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8d046f8d-1a59-4a4a-b784-b361e7a0562d {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:59:31 devstack sudo[121248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8d046f8d-1a59-4a4a-b784-b361e7a0562d Sep 08 06:59:31 devstack sudo[121248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:59:32 devstack sudo[121248]: pam_unix(sudo:session): session closed for user root Sep 08 06:59:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-71b161e3-7230-4a19-ab13-5d50f17eb758 tempest-ProjectReaderTests-381070331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8d046f8d-1a59-4a4a-b784-b361e7a0562d" returned: 0 in 0.251s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:59:32 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-71b161e3-7230-4a19-ab13-5d50f17eb758 tempest-ProjectReaderTests-381070331 None] Lock "cinder-quobyte-8d046f8d-1a59-4a4a-b784-b361e7a0562d" released by "delete_volume" :: held 0.689s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:59:32 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-71b161e3-7230-4a19-ab13-5d50f17eb758 tempest-ProjectReaderTests-381070331 None] Created reservations ['9645b9b6-64a6-428a-9b00-089b617e22ef', '51b97eba-c50d-49d6-a8c6-472c57477e9b', 'b62c9900-76e1-4603-a18b-8e3241b53bad', 'a8b98649-5cb1-4dc7-939b-3aad2473f8f5'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:59:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-71b161e3-7230-4a19-ab13-5d50f17eb758 tempest-ProjectReaderTests-381070331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:59:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-71b161e3-7230-4a19-ab13-5d50f17eb758 tempest-ProjectReaderTests-381070331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:59:32 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-71b161e3-7230-4a19-ab13-5d50f17eb758 tempest-ProjectReaderTests-381070331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:59:32 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-71b161e3-7230-4a19-ab13-5d50f17eb758 tempest-ProjectReaderTests-381070331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:59:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-71b161e3-7230-4a19-ab13-5d50f17eb758 tempest-ProjectReaderTests-381070331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:59:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-71b161e3-7230-4a19-ab13-5d50f17eb758 tempest-ProjectReaderTests-381070331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:59:32 devstack sudo[121263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:59:32 devstack sudo[121263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:59:32 devstack sudo[121263]: pam_unix(sudo:session): session closed for user root Sep 08 06:59:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-71b161e3-7230-4a19-ab13-5d50f17eb758 tempest-ProjectReaderTests-381070331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.269s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:59:32 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-71b161e3-7230-4a19-ab13-5d50f17eb758 tempest-ProjectReaderTests-381070331 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:59:32 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-71b161e3-7230-4a19-ab13-5d50f17eb758 tempest-ProjectReaderTests-381070331 None] Deleted volume successfully. Sep 08 06:59:32 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-71b161e3-7230-4a19-ab13-5d50f17eb758 tempest-ProjectReaderTests-381070331 None] Lock "cinder-8d046f8d-1a59-4a4a-b784-b361e7a0562d-delete_volume" released by "delete_volume" :: held 1.216s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:59:32 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5924e08-3af1-4229-b642-cb0cbaf1f868 tempest-ProjectReaderTests-381070331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:59:32 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a5924e08-3af1-4229-b642-cb0cbaf1f868 tempest-ProjectReaderTests-381070331 None] Flow 'volume_create_manager' (af95c108-692f-4278-ab2d-19cbc01e0aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:59:32 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a5924e08-3af1-4229-b642-cb0cbaf1f868 tempest-ProjectReaderTests-381070331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2875a6ba-c3b1-4382-aa8d-ad3738c1c253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:59:32 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a5924e08-3af1-4229-b642-cb0cbaf1f868 tempest-ProjectReaderTests-381070331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2875a6ba-c3b1-4382-aa8d-ad3738c1c253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:59:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1000891209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5beecf5-a17b-43be-9aad-0f5e685e1257,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92fc69b8c90b45b69a9120d4fdb84c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:59:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:59:33Z,use_quota=True,user_id='25fc7a35eda643a79476b686c0fa7681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:59:32 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a5924e08-3af1-4229-b642-cb0cbaf1f868 tempest-ProjectReaderTests-381070331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (746c8d6e-212f-490f-9d9c-7ebc3ab98eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:59:32 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a5924e08-3af1-4229-b642-cb0cbaf1f868 tempest-ProjectReaderTests-381070331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (746c8d6e-212f-490f-9d9c-7ebc3ab98eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:59:32 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a5924e08-3af1-4229-b642-cb0cbaf1f868 tempest-ProjectReaderTests-381070331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31a59d55-9429-4aa4-856a-5a7379d37028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:59:33 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a5924e08-3af1-4229-b642-cb0cbaf1f868 tempest-ProjectReaderTests-381070331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31a59d55-9429-4aa4-856a-5a7379d37028) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5beecf5-a17b-43be-9aad-0f5e685e1257', 'volume_name': 'volume-a5beecf5-a17b-43be-9aad-0f5e685e1257', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:59:33 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a5924e08-3af1-4229-b642-cb0cbaf1f868 tempest-ProjectReaderTests-381070331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c7590a4-f221-47d0-b8c4-bdba589b4aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:59:33 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a5924e08-3af1-4229-b642-cb0cbaf1f868 tempest-ProjectReaderTests-381070331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c7590a4-f221-47d0-b8c4-bdba589b4aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:59:33 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a5924e08-3af1-4229-b642-cb0cbaf1f868 tempest-ProjectReaderTests-381070331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26f3eeeb-55af-4c63-a925-186863fbac7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:59:33 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-a5924e08-3af1-4229-b642-cb0cbaf1f868 tempest-ProjectReaderTests-381070331 None] Volume a5beecf5-a17b-43be-9aad-0f5e685e1257: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5beecf5-a17b-43be-9aad-0f5e685e1257', 'volume_size': 1} Sep 08 06:59:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a5924e08-3af1-4229-b642-cb0cbaf1f868 tempest-ProjectReaderTests-381070331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:59:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a5924e08-3af1-4229-b642-cb0cbaf1f868 tempest-ProjectReaderTests-381070331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:59:33 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-a5924e08-3af1-4229-b642-cb0cbaf1f868 tempest-ProjectReaderTests-381070331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:59:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1000891209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5beecf5-a17b-43be-9aad-0f5e685e1257,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92fc69b8c90b45b69a9120d4fdb84c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:59:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:59:33Z,use_quota=True,user_id='25fc7a35eda643a79476b686c0fa7681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:59:33 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-a5924e08-3af1-4229-b642-cb0cbaf1f868 tempest-ProjectReaderTests-381070331 None] Creating volume a5beecf5-a17b-43be-9aad-0f5e685e1257 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:59:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a5924e08-3af1-4229-b642-cb0cbaf1f868 tempest-ProjectReaderTests-381070331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:59:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a5924e08-3af1-4229-b642-cb0cbaf1f868 tempest-ProjectReaderTests-381070331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:59:33 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-a5924e08-3af1-4229-b642-cb0cbaf1f868 tempest-ProjectReaderTests-381070331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:59:33 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-a5924e08-3af1-4229-b642-cb0cbaf1f868 tempest-ProjectReaderTests-381070331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:59:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a5924e08-3af1-4229-b642-cb0cbaf1f868 tempest-ProjectReaderTests-381070331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:59:33 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-a5924e08-3af1-4229-b642-cb0cbaf1f868 tempest-ProjectReaderTests-381070331 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:59:33 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-a5924e08-3af1-4229-b642-cb0cbaf1f868 tempest-ProjectReaderTests-381070331 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:59:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a5924e08-3af1-4229-b642-cb0cbaf1f868 tempest-ProjectReaderTests-381070331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a5beecf5-a17b-43be-9aad-0f5e685e1257 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:59:33 devstack sudo[121293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a5beecf5-a17b-43be-9aad-0f5e685e1257 1073741824 Sep 08 06:59:33 devstack sudo[121293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:59:33 devstack sudo[121293]: pam_unix(sudo:session): session closed for user root Sep 08 06:59:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a5924e08-3af1-4229-b642-cb0cbaf1f868 tempest-ProjectReaderTests-381070331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a5beecf5-a17b-43be-9aad-0f5e685e1257 1073741824" returned: 0 in 0.455s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:59:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a5924e08-3af1-4229-b642-cb0cbaf1f868 tempest-ProjectReaderTests-381070331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a5beecf5-a17b-43be-9aad-0f5e685e1257 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:59:33 devstack sudo[121313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a5beecf5-a17b-43be-9aad-0f5e685e1257 Sep 08 06:59:33 devstack sudo[121313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:59:33 devstack sudo[121313]: pam_unix(sudo:session): session closed for user root Sep 08 06:59:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a5924e08-3af1-4229-b642-cb0cbaf1f868 tempest-ProjectReaderTests-381070331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a5beecf5-a17b-43be-9aad-0f5e685e1257" returned: 0 in 0.288s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:59:33 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-a5924e08-3af1-4229-b642-cb0cbaf1f868 tempest-ProjectReaderTests-381070331 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:59:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a5924e08-3af1-4229-b642-cb0cbaf1f868 tempest-ProjectReaderTests-381070331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:59:33 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a5924e08-3af1-4229-b642-cb0cbaf1f868 tempest-ProjectReaderTests-381070331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26f3eeeb-55af-4c63-a925-186863fbac7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5beecf5-a17b-43be-9aad-0f5e685e1257', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:59:33 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a5924e08-3af1-4229-b642-cb0cbaf1f868 tempest-ProjectReaderTests-381070331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93f3ad46-95fa-433a-94d0-c44b504a07ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:59:33 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-a5924e08-3af1-4229-b642-cb0cbaf1f868 tempest-ProjectReaderTests-381070331 None] Volume volume-a5beecf5-a17b-43be-9aad-0f5e685e1257 (a5beecf5-a17b-43be-9aad-0f5e685e1257): created successfully Sep 08 06:59:33 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a5924e08-3af1-4229-b642-cb0cbaf1f868 tempest-ProjectReaderTests-381070331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93f3ad46-95fa-433a-94d0-c44b504a07ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:59:33 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a5924e08-3af1-4229-b642-cb0cbaf1f868 tempest-ProjectReaderTests-381070331 None] Flow 'volume_create_manager' (af95c108-692f-4278-ab2d-19cbc01e0aca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:59:33 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-a5924e08-3af1-4229-b642-cb0cbaf1f868 tempest-ProjectReaderTests-381070331 None] Created volume successfully. Sep 08 06:59:34 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-3949b2c6-16e4-4a43-bea1-6d87c58ba614 tempest-ProjectReaderTests-381070331 None] Acquiring lock "cinder-a5beecf5-a17b-43be-9aad-0f5e685e1257-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:59:34 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-3949b2c6-16e4-4a43-bea1-6d87c58ba614 tempest-ProjectReaderTests-381070331 None] Lock "cinder-a5beecf5-a17b-43be-9aad-0f5e685e1257-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:59:34 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-3949b2c6-16e4-4a43-bea1-6d87c58ba614 tempest-ProjectReaderTests-381070331 None] Acquiring lock "cinder-quobyte-a5beecf5-a17b-43be-9aad-0f5e685e1257" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 06:59:34 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-3949b2c6-16e4-4a43-bea1-6d87c58ba614 tempest-ProjectReaderTests-381070331 None] Lock "cinder-quobyte-a5beecf5-a17b-43be-9aad-0f5e685e1257" acquired by "delete_volume" :: waited 0.025s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 06:59:34 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2fdf5b-282a-4a2f-b7a2-68be66e04598]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:59:34 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3949b2c6-16e4-4a43-bea1-6d87c58ba614 tempest-ProjectReaderTests-381070331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a5beecf5-a17b-43be-9aad-0f5e685e1257 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:59:34 devstack sudo[121335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a5beecf5-a17b-43be-9aad-0f5e685e1257 Sep 08 06:59:34 devstack sudo[121335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:59:34 devstack sudo[121335]: pam_unix(sudo:session): session closed for user root Sep 08 06:59:34 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3949b2c6-16e4-4a43-bea1-6d87c58ba614 tempest-ProjectReaderTests-381070331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a5beecf5-a17b-43be-9aad-0f5e685e1257" returned: 0 in 0.392s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:59:34 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3949b2c6-16e4-4a43-bea1-6d87c58ba614 tempest-ProjectReaderTests-381070331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a5beecf5-a17b-43be-9aad-0f5e685e1257 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:59:34 devstack sudo[121352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a5beecf5-a17b-43be-9aad-0f5e685e1257 Sep 08 06:59:34 devstack sudo[121352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:59:34 devstack sudo[121352]: pam_unix(sudo:session): session closed for user root Sep 08 06:59:34 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3949b2c6-16e4-4a43-bea1-6d87c58ba614 tempest-ProjectReaderTests-381070331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a5beecf5-a17b-43be-9aad-0f5e685e1257" returned: 0 in 0.248s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:59:34 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-3949b2c6-16e4-4a43-bea1-6d87c58ba614 tempest-ProjectReaderTests-381070331 None] Lock "cinder-quobyte-a5beecf5-a17b-43be-9aad-0f5e685e1257" released by "delete_volume" :: held 0.687s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:59:34 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-3949b2c6-16e4-4a43-bea1-6d87c58ba614 tempest-ProjectReaderTests-381070331 None] Created reservations ['a9646123-f612-4cbe-88cf-43bce49c30bf', '0ce73e62-fbe7-4c70-8e83-0b0eb6ef72d7', '8b442f43-a8b2-458e-8c81-fa9a731ac966', 'ff3a7ac8-3bd4-438b-8f20-d62b2f2d5c1f'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 06:59:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-3949b2c6-16e4-4a43-bea1-6d87c58ba614 tempest-ProjectReaderTests-381070331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:59:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-3949b2c6-16e4-4a43-bea1-6d87c58ba614 tempest-ProjectReaderTests-381070331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:59:35 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-3949b2c6-16e4-4a43-bea1-6d87c58ba614 tempest-ProjectReaderTests-381070331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:59:35 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-3949b2c6-16e4-4a43-bea1-6d87c58ba614 tempest-ProjectReaderTests-381070331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:59:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-3949b2c6-16e4-4a43-bea1-6d87c58ba614 tempest-ProjectReaderTests-381070331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:59:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3949b2c6-16e4-4a43-bea1-6d87c58ba614 tempest-ProjectReaderTests-381070331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:59:35 devstack sudo[121367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 06:59:35 devstack sudo[121367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:59:35 devstack sudo[121367]: pam_unix(sudo:session): session closed for user root Sep 08 06:59:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3949b2c6-16e4-4a43-bea1-6d87c58ba614 tempest-ProjectReaderTests-381070331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.280s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:59:35 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-3949b2c6-16e4-4a43-bea1-6d87c58ba614 tempest-ProjectReaderTests-381070331 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 06:59:35 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-3949b2c6-16e4-4a43-bea1-6d87c58ba614 tempest-ProjectReaderTests-381070331 None] Deleted volume successfully. Sep 08 06:59:35 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-3949b2c6-16e4-4a43-bea1-6d87c58ba614 tempest-ProjectReaderTests-381070331 None] Lock "cinder-a5beecf5-a17b-43be-9aad-0f5e685e1257-delete_volume" released by "delete_volume" :: held 1.226s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 06:59:39 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-afca2bce-13b0-4bbe-bb71-f250843987c9 tempest-TestImageHashVerification-1425205997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 06:59:39 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-afca2bce-13b0-4bbe-bb71-f250843987c9 tempest-TestImageHashVerification-1425205997 None] Flow 'volume_create_manager' (f5925b2a-c8a4-476e-b47d-cfbcdb8c09f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:59:39 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-afca2bce-13b0-4bbe-bb71-f250843987c9 tempest-TestImageHashVerification-1425205997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e35f71f4-c2fa-4643-bb72-b538df5fc81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:59:39 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-afca2bce-13b0-4bbe-bb71-f250843987c9 tempest-TestImageHashVerification-1425205997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e35f71f4-c2fa-4643-bb72-b538df5fc81c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:59:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-658056426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=666db0ac-0571-4cb4-af2d-d083e4c2bc9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98e556f71b1f42c7848fef649eadd514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:59:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:59:40Z,use_quota=True,user_id='7c548e24786640fb8f61efcc5b94e6ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:59:39 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-afca2bce-13b0-4bbe-bb71-f250843987c9 tempest-TestImageHashVerification-1425205997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a21cff3b-ebcf-45e3-8850-bdd53eb60b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:59:39 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-afca2bce-13b0-4bbe-bb71-f250843987c9 tempest-TestImageHashVerification-1425205997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a21cff3b-ebcf-45e3-8850-bdd53eb60b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:59:39 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-afca2bce-13b0-4bbe-bb71-f250843987c9 tempest-TestImageHashVerification-1425205997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeaf9f2d-25b0-42ff-8e89-c582691a8487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:59:39 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-afca2bce-13b0-4bbe-bb71-f250843987c9 tempest-TestImageHashVerification-1425205997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeaf9f2d-25b0-42ff-8e89-c582691a8487) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '666db0ac-0571-4cb4-af2d-d083e4c2bc9d', 'volume_name': 'volume-666db0ac-0571-4cb4-af2d-d083e4c2bc9d', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:59:39 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-afca2bce-13b0-4bbe-bb71-f250843987c9 tempest-TestImageHashVerification-1425205997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5298772e-e751-47ef-976a-a13a10febf7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:59:39 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-afca2bce-13b0-4bbe-bb71-f250843987c9 tempest-TestImageHashVerification-1425205997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5298772e-e751-47ef-976a-a13a10febf7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:59:39 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-afca2bce-13b0-4bbe-bb71-f250843987c9 tempest-TestImageHashVerification-1425205997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4e6b9b2-8360-49cd-8620-277efa9b396e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:59:39 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-afca2bce-13b0-4bbe-bb71-f250843987c9 tempest-TestImageHashVerification-1425205997 None] Volume 666db0ac-0571-4cb4-af2d-d083e4c2bc9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-666db0ac-0571-4cb4-af2d-d083e4c2bc9d', 'volume_size': 1} Sep 08 06:59:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-afca2bce-13b0-4bbe-bb71-f250843987c9 tempest-TestImageHashVerification-1425205997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:59:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-afca2bce-13b0-4bbe-bb71-f250843987c9 tempest-TestImageHashVerification-1425205997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:59:39 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-afca2bce-13b0-4bbe-bb71-f250843987c9 tempest-TestImageHashVerification-1425205997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T04:59:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-658056426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=666db0ac-0571-4cb4-af2d-d083e4c2bc9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98e556f71b1f42c7848fef649eadd514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T04:59:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T04:59:40Z,use_quota=True,user_id='7c548e24786640fb8f61efcc5b94e6ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 06:59:39 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-afca2bce-13b0-4bbe-bb71-f250843987c9 tempest-TestImageHashVerification-1425205997 None] Creating volume 666db0ac-0571-4cb4-af2d-d083e4c2bc9d {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 06:59:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-afca2bce-13b0-4bbe-bb71-f250843987c9 tempest-TestImageHashVerification-1425205997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:59:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-afca2bce-13b0-4bbe-bb71-f250843987c9 tempest-TestImageHashVerification-1425205997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:59:39 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-afca2bce-13b0-4bbe-bb71-f250843987c9 tempest-TestImageHashVerification-1425205997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 06:59:39 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-afca2bce-13b0-4bbe-bb71-f250843987c9 tempest-TestImageHashVerification-1425205997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 06:59:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-afca2bce-13b0-4bbe-bb71-f250843987c9 tempest-TestImageHashVerification-1425205997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:59:39 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-afca2bce-13b0-4bbe-bb71-f250843987c9 tempest-TestImageHashVerification-1425205997 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 06:59:39 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-afca2bce-13b0-4bbe-bb71-f250843987c9 tempest-TestImageHashVerification-1425205997 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 06:59:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-afca2bce-13b0-4bbe-bb71-f250843987c9 tempest-TestImageHashVerification-1425205997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-666db0ac-0571-4cb4-af2d-d083e4c2bc9d 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:59:39 devstack sudo[121521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-666db0ac-0571-4cb4-af2d-d083e4c2bc9d 1073741824 Sep 08 06:59:39 devstack sudo[121521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:59:40 devstack sudo[121521]: pam_unix(sudo:session): session closed for user root Sep 08 06:59:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-afca2bce-13b0-4bbe-bb71-f250843987c9 tempest-TestImageHashVerification-1425205997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-666db0ac-0571-4cb4-af2d-d083e4c2bc9d 1073741824" returned: 0 in 0.418s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:59:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-afca2bce-13b0-4bbe-bb71-f250843987c9 tempest-TestImageHashVerification-1425205997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-666db0ac-0571-4cb4-af2d-d083e4c2bc9d {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:59:40 devstack sudo[121542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-666db0ac-0571-4cb4-af2d-d083e4c2bc9d Sep 08 06:59:40 devstack sudo[121542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:59:40 devstack sudo[121542]: pam_unix(sudo:session): session closed for user root Sep 08 06:59:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-afca2bce-13b0-4bbe-bb71-f250843987c9 tempest-TestImageHashVerification-1425205997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-666db0ac-0571-4cb4-af2d-d083e4c2bc9d" returned: 0 in 0.238s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:59:40 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-afca2bce-13b0-4bbe-bb71-f250843987c9 tempest-TestImageHashVerification-1425205997 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 06:59:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-afca2bce-13b0-4bbe-bb71-f250843987c9 tempest-TestImageHashVerification-1425205997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 06:59:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-afca2bce-13b0-4bbe-bb71-f250843987c9 tempest-TestImageHashVerification-1425205997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4e6b9b2-8360-49cd-8620-277efa9b396e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-666db0ac-0571-4cb4-af2d-d083e4c2bc9d', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:59:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-afca2bce-13b0-4bbe-bb71-f250843987c9 tempest-TestImageHashVerification-1425205997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec0cf45a-7354-4fca-adcd-00b2479293f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 06:59:40 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-afca2bce-13b0-4bbe-bb71-f250843987c9 tempest-TestImageHashVerification-1425205997 None] Volume volume-666db0ac-0571-4cb4-af2d-d083e4c2bc9d (666db0ac-0571-4cb4-af2d-d083e4c2bc9d): created successfully Sep 08 06:59:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-afca2bce-13b0-4bbe-bb71-f250843987c9 tempest-TestImageHashVerification-1425205997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec0cf45a-7354-4fca-adcd-00b2479293f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 06:59:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-afca2bce-13b0-4bbe-bb71-f250843987c9 tempest-TestImageHashVerification-1425205997 None] Flow 'volume_create_manager' (f5925b2a-c8a4-476e-b47d-cfbcdb8c09f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 06:59:40 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-afca2bce-13b0-4bbe-bb71-f250843987c9 tempest-TestImageHashVerification-1425205997 None] Created volume successfully. Sep 08 06:59:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-01efd27b-de7c-4906-b61f-767ec35e8eb0 tempest-TestImageHashVerification-1425205997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 06:59:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-01efd27b-de7c-4906-b61f-767ec35e8eb0 tempest-TestImageHashVerification-1425205997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 06:59:41 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e28ca3-c03c-4912-8d4c-73bd9d58b8cf]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:59:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-01efd27b-de7c-4906-b61f-767ec35e8eb0 tempest-TestImageHashVerification-1425205997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-666db0ac-0571-4cb4-af2d-d083e4c2bc9d {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:59:41 devstack sudo[121584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-666db0ac-0571-4cb4-af2d-d083e4c2bc9d Sep 08 06:59:41 devstack sudo[121584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:59:41 devstack sudo[121584]: pam_unix(sudo:session): session closed for user root Sep 08 06:59:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-01efd27b-de7c-4906-b61f-767ec35e8eb0 tempest-TestImageHashVerification-1425205997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-666db0ac-0571-4cb4-af2d-d083e4c2bc9d" returned: 0 in 0.347s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:59:42 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46b383c-275e-4f8d-b80b-69feba999f95]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:59:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-01efd27b-de7c-4906-b61f-767ec35e8eb0 tempest-TestImageHashVerification-1425205997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-666db0ac-0571-4cb4-af2d-d083e4c2bc9d {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:59:42 devstack sudo[121601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-666db0ac-0571-4cb4-af2d-d083e4c2bc9d Sep 08 06:59:42 devstack sudo[121601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:59:42 devstack sudo[121601]: pam_unix(sudo:session): session closed for user root Sep 08 06:59:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-01efd27b-de7c-4906-b61f-767ec35e8eb0 tempest-TestImageHashVerification-1425205997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-666db0ac-0571-4cb4-af2d-d083e4c2bc9d" returned: 0 in 0.346s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:59:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-01efd27b-de7c-4906-b61f-767ec35e8eb0 tempest-TestImageHashVerification-1425205997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-666db0ac-0571-4cb4-af2d-d083e4c2bc9d /opt/stack/data/cinder/conversion/666db0ac-0571-4cb4-af2d-d083e4c2bc9d.temp_image.b0226d05-b3f2-4371-b141-2716c4c7ec17ydnth2ao.img {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:59:42 devstack sudo[121615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-666db0ac-0571-4cb4-af2d-d083e4c2bc9d /opt/stack/data/cinder/conversion/666db0ac-0571-4cb4-af2d-d083e4c2bc9d.temp_image.b0226d05-b3f2-4371-b141-2716c4c7ec17ydnth2ao.img Sep 08 06:59:42 devstack sudo[121615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:59:46 devstack sudo[121615]: pam_unix(sudo:session): session closed for user root Sep 08 06:59:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-01efd27b-de7c-4906-b61f-767ec35e8eb0 tempest-TestImageHashVerification-1425205997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-666db0ac-0571-4cb4-af2d-d083e4c2bc9d /opt/stack/data/cinder/conversion/666db0ac-0571-4cb4-af2d-d083e4c2bc9d.temp_image.b0226d05-b3f2-4371-b141-2716c4c7ec17ydnth2ao.img" returned: 0 in 3.999s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:59:46 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0c87ec-5e37-4bad-98e2-d432b78b8787]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 06:59:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-01efd27b-de7c-4906-b61f-767ec35e8eb0 tempest-TestImageHashVerification-1425205997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-666db0ac-0571-4cb4-af2d-d083e4c2bc9d {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 06:59:46 devstack sudo[121748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-666db0ac-0571-4cb4-af2d-d083e4c2bc9d Sep 08 06:59:46 devstack sudo[121748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 06:59:46 devstack sudo[121748]: pam_unix(sudo:session): session closed for user root Sep 08 06:59:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-01efd27b-de7c-4906-b61f-767ec35e8eb0 tempest-TestImageHashVerification-1425205997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-666db0ac-0571-4cb4-af2d-d083e4c2bc9d" returned: 0 in 0.524s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 06:59:46 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-01efd27b-de7c-4906-b61f-767ec35e8eb0 tempest-TestImageHashVerification-1425205997 None] Image conversion details: src /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-666db0ac-0571-4cb4-af2d-d083e4c2bc9d, size 1024.00 MB, duration 4.00 sec, destination /opt/stack/data/cinder/conversion/666db0ac-0571-4cb4-af2d-d083e4c2bc9d.temp_image.b0226d05-b3f2-4371-b141-2716c4c7ec17ydnth2ao.img {{(pid=87507) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 06:59:46 devstack cinder-volume[87507]: INFO cinder.image.image_utils [None req-01efd27b-de7c-4906-b61f-767ec35e8eb0 tempest-TestImageHashVerification-1425205997 None] Converted 1024.00 MB image at 256.01 MB/s Sep 08 06:59:46 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-01efd27b-de7c-4906-b61f-767ec35e8eb0 tempest-TestImageHashVerification-1425205997 None] b0226d05-b3f2-4371-b141-2716c4c7ec17 was raw, no need to convert to raw {{(pid=87507) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 08 06:59:56 devstack cinder-volume[87507]: DEBUG dbcounter [-] [87507] Writing DB stats cinder:SELECT=25,cinder:INSERT=12,cinder:UPDATE=45,cinder:DELETE=3 {{(pid=87507) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 06:59:56 devstack cinder-volume[87507]: DEBUG dbcounter [-] [87507] Writing DB stats cinder:INSERT=7,cinder:UPDATE=36,cinder:SELECT=26,cinder:DELETE=4 {{(pid=87507) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:00:05 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-01efd27b-de7c-4906-b61f-767ec35e8eb0 tempest-TestImageHashVerification-1425205997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 23.743s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:00:05 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-01efd27b-de7c-4906-b61f-767ec35e8eb0 tempest-TestImageHashVerification-1425205997 None] Uploaded volume to glance image-id: b0226d05-b3f2-4371-b141-2716c4c7ec17. {{(pid=87507) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 08 07:00:05 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-01efd27b-de7c-4906-b61f-767ec35e8eb0 tempest-TestImageHashVerification-1425205997 None] Copy volume to image completed successfully. Sep 08 07:00:06 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-ef2d0de8-2770-4f7b-b0ba-067a62658c46 tempest-TestImageHashVerification-1425205997 None] Acquiring lock "cinder-666db0ac-0571-4cb4-af2d-d083e4c2bc9d-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:00:06 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-ef2d0de8-2770-4f7b-b0ba-067a62658c46 tempest-TestImageHashVerification-1425205997 None] Lock "cinder-666db0ac-0571-4cb4-af2d-d083e4c2bc9d-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:00:06 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-ef2d0de8-2770-4f7b-b0ba-067a62658c46 tempest-TestImageHashVerification-1425205997 None] Acquiring lock "cinder-quobyte-666db0ac-0571-4cb4-af2d-d083e4c2bc9d" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:00:06 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-ef2d0de8-2770-4f7b-b0ba-067a62658c46 tempest-TestImageHashVerification-1425205997 None] Lock "cinder-quobyte-666db0ac-0571-4cb4-af2d-d083e4c2bc9d" acquired by "delete_volume" :: waited 0.012s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:00:06 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[314deec1-0069-4a13-8776-e812d627828a]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:00:06 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ef2d0de8-2770-4f7b-b0ba-067a62658c46 tempest-TestImageHashVerification-1425205997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-666db0ac-0571-4cb4-af2d-d083e4c2bc9d {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:00:06 devstack sudo[122346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-666db0ac-0571-4cb4-af2d-d083e4c2bc9d Sep 08 07:00:06 devstack sudo[122346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:00:06 devstack sudo[122346]: pam_unix(sudo:session): session closed for user root Sep 08 07:00:06 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ef2d0de8-2770-4f7b-b0ba-067a62658c46 tempest-TestImageHashVerification-1425205997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-666db0ac-0571-4cb4-af2d-d083e4c2bc9d" returned: 0 in 0.355s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:00:06 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ef2d0de8-2770-4f7b-b0ba-067a62658c46 tempest-TestImageHashVerification-1425205997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-666db0ac-0571-4cb4-af2d-d083e4c2bc9d {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:00:06 devstack sudo[122360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-666db0ac-0571-4cb4-af2d-d083e4c2bc9d Sep 08 07:00:06 devstack sudo[122360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:00:06 devstack sudo[122360]: pam_unix(sudo:session): session closed for user root Sep 08 07:00:06 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ef2d0de8-2770-4f7b-b0ba-067a62658c46 tempest-TestImageHashVerification-1425205997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-666db0ac-0571-4cb4-af2d-d083e4c2bc9d" returned: 0 in 0.243s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:00:06 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-ef2d0de8-2770-4f7b-b0ba-067a62658c46 tempest-TestImageHashVerification-1425205997 None] Lock "cinder-quobyte-666db0ac-0571-4cb4-af2d-d083e4c2bc9d" released by "delete_volume" :: held 0.639s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:00:06 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-ef2d0de8-2770-4f7b-b0ba-067a62658c46 tempest-TestImageHashVerification-1425205997 None] Created reservations ['b82f3310-04d5-4162-a75c-f346b6b38ba2', 'ae1ceb32-ea6d-4170-9f64-34533492065b', '2743cc16-a5dc-4235-a438-3ec787bba9d1', '28d96583-23e6-4caf-b16e-0003200b466d'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:00:06 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-ef2d0de8-2770-4f7b-b0ba-067a62658c46 tempest-TestImageHashVerification-1425205997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:00:06 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-ef2d0de8-2770-4f7b-b0ba-067a62658c46 tempest-TestImageHashVerification-1425205997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:00:06 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-ef2d0de8-2770-4f7b-b0ba-067a62658c46 tempest-TestImageHashVerification-1425205997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:00:06 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-ef2d0de8-2770-4f7b-b0ba-067a62658c46 tempest-TestImageHashVerification-1425205997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:00:06 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-ef2d0de8-2770-4f7b-b0ba-067a62658c46 tempest-TestImageHashVerification-1425205997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:00:06 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ef2d0de8-2770-4f7b-b0ba-067a62658c46 tempest-TestImageHashVerification-1425205997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:00:06 devstack sudo[122375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 07:00:06 devstack sudo[122375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:00:07 devstack sudo[122375]: pam_unix(sudo:session): session closed for user root Sep 08 07:00:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ef2d0de8-2770-4f7b-b0ba-067a62658c46 tempest-TestImageHashVerification-1425205997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.233s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:00:07 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-ef2d0de8-2770-4f7b-b0ba-067a62658c46 tempest-TestImageHashVerification-1425205997 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:00:07 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-ef2d0de8-2770-4f7b-b0ba-067a62658c46 tempest-TestImageHashVerification-1425205997 None] Deleted volume successfully. Sep 08 07:00:07 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-ef2d0de8-2770-4f7b-b0ba-067a62658c46 tempest-TestImageHashVerification-1425205997 None] Lock "cinder-666db0ac-0571-4cb4-af2d-d083e4c2bc9d-delete_volume" released by "delete_volume" :: held 1.061s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:00:16 devstack cinder-volume[87507]: DEBUG dbcounter [-] [87507] Writing DB stats cinder:SELECT=6,cinder:UPDATE=9,cinder:INSERT=2 {{(pid=87507) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:00:17 devstack cinder-volume[87507]: DEBUG dbcounter [-] [87507] Writing DB stats cinder:UPDATE=8,cinder:SELECT=5,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87507) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:00:20 devstack cinder-volume[87507]: DEBUG oslo_service.periodic_task [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87507) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 07:00:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:00:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:00:20 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:00:20 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:00:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:00:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:00:20 devstack sudo[122783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 07:00:20 devstack sudo[122783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:00:20 devstack sudo[122783]: pam_unix(sudo:session): session closed for user root Sep 08 07:00:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.296s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:00:20 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:00:20 devstack cinder-volume[87507]: DEBUG oslo_service.periodic_task [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Running periodic task VolumeManager._thread_info {{(pid=87507) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 07:00:20 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] thread count: 29 {{(pid=87507) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 07:00:20 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] thread info: [<_MainThread(MainThread, started 127913129345152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87507) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 07:00:35 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-000c44e9-90de-418f-8bb1-b1b744f06868 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:00:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-000c44e9-90de-418f-8bb1-b1b744f06868 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Flow 'volume_create_manager' (55322547-0fad-45a1-90a5-77c83d7a56d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:00:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-000c44e9-90de-418f-8bb1-b1b744f06868 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cd3cbb7-3ee0-4890-a344-2ef1290a9dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:00:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-000c44e9-90de-418f-8bb1-b1b744f06868 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cd3cbb7-3ee0-4890-a344-2ef1290a9dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:00:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-202541454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9c040d9-3a29-42b2-a174-2066511a5906,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baab805d38054a76a4bb7852be614089',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:00:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:00:36Z,use_quota=True,user_id='a81715c9892b4e4ab3998421bff18099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:00:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-000c44e9-90de-418f-8bb1-b1b744f06868 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eecb8226-b0dc-4719-83da-aa4a180248f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:00:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-000c44e9-90de-418f-8bb1-b1b744f06868 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eecb8226-b0dc-4719-83da-aa4a180248f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:00:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-000c44e9-90de-418f-8bb1-b1b744f06868 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b960205-ab1e-46da-bad5-ac6d5e1c7a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:00:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-000c44e9-90de-418f-8bb1-b1b744f06868 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b960205-ab1e-46da-bad5-ac6d5e1c7a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9c040d9-3a29-42b2-a174-2066511a5906', 'volume_name': 'volume-b9c040d9-3a29-42b2-a174-2066511a5906', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:00:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-000c44e9-90de-418f-8bb1-b1b744f06868 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (298c7570-9089-4ac6-9216-81afdff19959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:00:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-000c44e9-90de-418f-8bb1-b1b744f06868 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (298c7570-9089-4ac6-9216-81afdff19959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:00:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-000c44e9-90de-418f-8bb1-b1b744f06868 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25ccd5e5-5cff-4e82-9aba-a004517d6be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:00:35 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-000c44e9-90de-418f-8bb1-b1b744f06868 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Volume b9c040d9-3a29-42b2-a174-2066511a5906: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9c040d9-3a29-42b2-a174-2066511a5906', 'volume_size': 1} Sep 08 07:00:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-000c44e9-90de-418f-8bb1-b1b744f06868 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:00:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-000c44e9-90de-418f-8bb1-b1b744f06868 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:00:35 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-000c44e9-90de-418f-8bb1-b1b744f06868 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:00:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-202541454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9c040d9-3a29-42b2-a174-2066511a5906,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baab805d38054a76a4bb7852be614089',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:00:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:00:36Z,use_quota=True,user_id='a81715c9892b4e4ab3998421bff18099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:00:35 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-000c44e9-90de-418f-8bb1-b1b744f06868 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Creating volume b9c040d9-3a29-42b2-a174-2066511a5906 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:00:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-000c44e9-90de-418f-8bb1-b1b744f06868 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:00:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-000c44e9-90de-418f-8bb1-b1b744f06868 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:00:35 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-000c44e9-90de-418f-8bb1-b1b744f06868 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:00:35 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-000c44e9-90de-418f-8bb1-b1b744f06868 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:00:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-000c44e9-90de-418f-8bb1-b1b744f06868 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:00:35 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-000c44e9-90de-418f-8bb1-b1b744f06868 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:00:35 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-000c44e9-90de-418f-8bb1-b1b744f06868 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 07:00:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-000c44e9-90de-418f-8bb1-b1b744f06868 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b9c040d9-3a29-42b2-a174-2066511a5906 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:00:35 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d52ab3d-0bf5-453e-af19-10ce9b4728c0 tempest-VolumeDependencyTests-192281610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:00:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7d52ab3d-0bf5-453e-af19-10ce9b4728c0 tempest-VolumeDependencyTests-192281610 None] Flow 'volume_create_manager' (e77226b9-af7c-4dd3-9e37-d2b050eb8fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:00:35 devstack sudo[123338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b9c040d9-3a29-42b2-a174-2066511a5906 1073741824 Sep 08 07:00:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7d52ab3d-0bf5-453e-af19-10ce9b4728c0 tempest-VolumeDependencyTests-192281610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c172c7a5-f07d-4749-988c-74fd376ff05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:00:35 devstack sudo[123338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:00:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7d52ab3d-0bf5-453e-af19-10ce9b4728c0 tempest-VolumeDependencyTests-192281610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c172c7a5-f07d-4749-988c-74fd376ff05a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:00:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1210070371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9101be79-7548-40b1-8ea8-99c9a687fb3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83091f6f94b54375a77d194170732807',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:00:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:00:36Z,use_quota=True,user_id='8ccdbd3a2d2b43b7b92df3142b128016',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:00:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7d52ab3d-0bf5-453e-af19-10ce9b4728c0 tempest-VolumeDependencyTests-192281610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19b150a9-f964-4a6f-a3f9-4a60aeca516c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:00:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7d52ab3d-0bf5-453e-af19-10ce9b4728c0 tempest-VolumeDependencyTests-192281610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19b150a9-f964-4a6f-a3f9-4a60aeca516c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:00:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7d52ab3d-0bf5-453e-af19-10ce9b4728c0 tempest-VolumeDependencyTests-192281610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68a304f8-e6ca-4b78-9421-8b8a1359c33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:00:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7d52ab3d-0bf5-453e-af19-10ce9b4728c0 tempest-VolumeDependencyTests-192281610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68a304f8-e6ca-4b78-9421-8b8a1359c33e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9101be79-7548-40b1-8ea8-99c9a687fb3d', 'volume_name': 'volume-9101be79-7548-40b1-8ea8-99c9a687fb3d', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:00:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7d52ab3d-0bf5-453e-af19-10ce9b4728c0 tempest-VolumeDependencyTests-192281610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dacfb043-da61-45e6-b566-4065d424e2d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:00:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7d52ab3d-0bf5-453e-af19-10ce9b4728c0 tempest-VolumeDependencyTests-192281610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dacfb043-da61-45e6-b566-4065d424e2d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:00:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7d52ab3d-0bf5-453e-af19-10ce9b4728c0 tempest-VolumeDependencyTests-192281610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66b43546-c128-490c-a73c-75b8593a21e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:00:35 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-7d52ab3d-0bf5-453e-af19-10ce9b4728c0 tempest-VolumeDependencyTests-192281610 None] Volume 9101be79-7548-40b1-8ea8-99c9a687fb3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9101be79-7548-40b1-8ea8-99c9a687fb3d', 'volume_size': 1} Sep 08 07:00:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-7d52ab3d-0bf5-453e-af19-10ce9b4728c0 tempest-VolumeDependencyTests-192281610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:00:36 devstack sudo[123338]: pam_unix(sudo:session): session closed for user root Sep 08 07:00:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-000c44e9-90de-418f-8bb1-b1b744f06868 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b9c040d9-3a29-42b2-a174-2066511a5906 1073741824" returned: 0 in 0.556s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:00:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-000c44e9-90de-418f-8bb1-b1b744f06868 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b9c040d9-3a29-42b2-a174-2066511a5906 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:00:36 devstack sudo[123362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b9c040d9-3a29-42b2-a174-2066511a5906 Sep 08 07:00:36 devstack sudo[123362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:00:36 devstack sudo[123362]: pam_unix(sudo:session): session closed for user root Sep 08 07:00:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-000c44e9-90de-418f-8bb1-b1b744f06868 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b9c040d9-3a29-42b2-a174-2066511a5906" returned: 0 in 0.284s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:00:36 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-000c44e9-90de-418f-8bb1-b1b744f06868 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:00:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-000c44e9-90de-418f-8bb1-b1b744f06868 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:00:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-7d52ab3d-0bf5-453e-af19-10ce9b4728c0 tempest-VolumeDependencyTests-192281610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.784s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:00:36 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-7d52ab3d-0bf5-453e-af19-10ce9b4728c0 tempest-VolumeDependencyTests-192281610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:00:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1210070371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9101be79-7548-40b1-8ea8-99c9a687fb3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83091f6f94b54375a77d194170732807',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:00:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:00:36Z,use_quota=True,user_id='8ccdbd3a2d2b43b7b92df3142b128016',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:00:36 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-7d52ab3d-0bf5-453e-af19-10ce9b4728c0 tempest-VolumeDependencyTests-192281610 None] Creating volume 9101be79-7548-40b1-8ea8-99c9a687fb3d {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:00:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-7d52ab3d-0bf5-453e-af19-10ce9b4728c0 tempest-VolumeDependencyTests-192281610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:00:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-7d52ab3d-0bf5-453e-af19-10ce9b4728c0 tempest-VolumeDependencyTests-192281610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:00:36 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-7d52ab3d-0bf5-453e-af19-10ce9b4728c0 tempest-VolumeDependencyTests-192281610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:00:36 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-7d52ab3d-0bf5-453e-af19-10ce9b4728c0 tempest-VolumeDependencyTests-192281610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:00:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-7d52ab3d-0bf5-453e-af19-10ce9b4728c0 tempest-VolumeDependencyTests-192281610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:00:36 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-7d52ab3d-0bf5-453e-af19-10ce9b4728c0 tempest-VolumeDependencyTests-192281610 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:00:36 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-7d52ab3d-0bf5-453e-af19-10ce9b4728c0 tempest-VolumeDependencyTests-192281610 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 07:00:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7d52ab3d-0bf5-453e-af19-10ce9b4728c0 tempest-VolumeDependencyTests-192281610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9101be79-7548-40b1-8ea8-99c9a687fb3d 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:00:36 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-000c44e9-90de-418f-8bb1-b1b744f06868 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25ccd5e5-5cff-4e82-9aba-a004517d6be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9c040d9-3a29-42b2-a174-2066511a5906', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:00:36 devstack sudo[123374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9101be79-7548-40b1-8ea8-99c9a687fb3d 1073741824 Sep 08 07:00:36 devstack sudo[123374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:00:36 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-000c44e9-90de-418f-8bb1-b1b744f06868 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d7337bd-8dbb-4185-b7bc-5e281844bb23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:00:36 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-000c44e9-90de-418f-8bb1-b1b744f06868 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Volume volume-b9c040d9-3a29-42b2-a174-2066511a5906 (b9c040d9-3a29-42b2-a174-2066511a5906): created successfully Sep 08 07:00:36 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-000c44e9-90de-418f-8bb1-b1b744f06868 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d7337bd-8dbb-4185-b7bc-5e281844bb23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:00:36 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-000c44e9-90de-418f-8bb1-b1b744f06868 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Flow 'volume_create_manager' (55322547-0fad-45a1-90a5-77c83d7a56d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:00:36 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-000c44e9-90de-418f-8bb1-b1b744f06868 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Created volume successfully. Sep 08 07:00:37 devstack sudo[123374]: pam_unix(sudo:session): session closed for user root Sep 08 07:00:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7d52ab3d-0bf5-453e-af19-10ce9b4728c0 tempest-VolumeDependencyTests-192281610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9101be79-7548-40b1-8ea8-99c9a687fb3d 1073741824" returned: 0 in 0.515s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:00:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7d52ab3d-0bf5-453e-af19-10ce9b4728c0 tempest-VolumeDependencyTests-192281610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9101be79-7548-40b1-8ea8-99c9a687fb3d {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:00:37 devstack sudo[123395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9101be79-7548-40b1-8ea8-99c9a687fb3d Sep 08 07:00:37 devstack sudo[123395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:00:37 devstack sudo[123395]: pam_unix(sudo:session): session closed for user root Sep 08 07:00:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7d52ab3d-0bf5-453e-af19-10ce9b4728c0 tempest-VolumeDependencyTests-192281610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9101be79-7548-40b1-8ea8-99c9a687fb3d" returned: 0 in 0.382s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:00:37 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-7d52ab3d-0bf5-453e-af19-10ce9b4728c0 tempest-VolumeDependencyTests-192281610 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:00:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-7d52ab3d-0bf5-453e-af19-10ce9b4728c0 tempest-VolumeDependencyTests-192281610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:00:37 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7d52ab3d-0bf5-453e-af19-10ce9b4728c0 tempest-VolumeDependencyTests-192281610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66b43546-c128-490c-a73c-75b8593a21e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9101be79-7548-40b1-8ea8-99c9a687fb3d', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:00:37 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7d52ab3d-0bf5-453e-af19-10ce9b4728c0 tempest-VolumeDependencyTests-192281610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6c4cf23-294f-4f11-a759-3fc95ab9eb64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:00:37 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-7d52ab3d-0bf5-453e-af19-10ce9b4728c0 tempest-VolumeDependencyTests-192281610 None] Volume volume-9101be79-7548-40b1-8ea8-99c9a687fb3d (9101be79-7548-40b1-8ea8-99c9a687fb3d): created successfully Sep 08 07:00:37 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7d52ab3d-0bf5-453e-af19-10ce9b4728c0 tempest-VolumeDependencyTests-192281610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6c4cf23-294f-4f11-a759-3fc95ab9eb64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:00:37 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7d52ab3d-0bf5-453e-af19-10ce9b4728c0 tempest-VolumeDependencyTests-192281610 None] Flow 'volume_create_manager' (e77226b9-af7c-4dd3-9e37-d2b050eb8fdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:00:37 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-7d52ab3d-0bf5-453e-af19-10ce9b4728c0 tempest-VolumeDependencyTests-192281610 None] Created volume successfully. Sep 08 07:00:38 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-50a69862-e1cf-47a5-ae69-f16e183acbfd tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:00:38 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-50a69862-e1cf-47a5-ae69-f16e183acbfd tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Flow 'volume_create_manager' (0d16881c-52ee-4543-8727-5ca67bd2153b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:00:38 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-50a69862-e1cf-47a5-ae69-f16e183acbfd tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abb5ef23-8f8a-416f-a7ba-6727c74e689e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:00:38 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-50a69862-e1cf-47a5-ae69-f16e183acbfd tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abb5ef23-8f8a-416f-a7ba-6727c74e689e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:00:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-799799072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20dac492-1385-44b0-8489-7535f9021e1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baab805d38054a76a4bb7852be614089',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:00:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:00:38Z,use_quota=True,user_id='a81715c9892b4e4ab3998421bff18099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:00:38 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-50a69862-e1cf-47a5-ae69-f16e183acbfd tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d74d14f-6ea0-4b44-a64f-8cf923983ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:00:38 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-50a69862-e1cf-47a5-ae69-f16e183acbfd tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d74d14f-6ea0-4b44-a64f-8cf923983ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:00:38 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-50a69862-e1cf-47a5-ae69-f16e183acbfd tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1516872-b28e-4c2e-8dab-f6af613e431d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:00:38 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-50a69862-e1cf-47a5-ae69-f16e183acbfd tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1516872-b28e-4c2e-8dab-f6af613e431d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20dac492-1385-44b0-8489-7535f9021e1d', 'volume_name': 'volume-20dac492-1385-44b0-8489-7535f9021e1d', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:00:38 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-50a69862-e1cf-47a5-ae69-f16e183acbfd tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2455de57-0546-4d2c-be04-1f2029fcb200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:00:38 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-50a69862-e1cf-47a5-ae69-f16e183acbfd tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2455de57-0546-4d2c-be04-1f2029fcb200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:00:38 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-50a69862-e1cf-47a5-ae69-f16e183acbfd tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0783e598-e36d-44ac-a91b-87801cce76ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:00:38 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-50a69862-e1cf-47a5-ae69-f16e183acbfd tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Volume 20dac492-1385-44b0-8489-7535f9021e1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20dac492-1385-44b0-8489-7535f9021e1d', 'volume_size': 1} Sep 08 07:00:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-50a69862-e1cf-47a5-ae69-f16e183acbfd tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:00:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-50a69862-e1cf-47a5-ae69-f16e183acbfd tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:00:38 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-50a69862-e1cf-47a5-ae69-f16e183acbfd tempest-CreateVolumesFromSourceVolumeTest-178388027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:00:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-799799072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20dac492-1385-44b0-8489-7535f9021e1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baab805d38054a76a4bb7852be614089',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:00:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:00:38Z,use_quota=True,user_id='a81715c9892b4e4ab3998421bff18099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:00:38 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-50a69862-e1cf-47a5-ae69-f16e183acbfd tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Creating volume 20dac492-1385-44b0-8489-7535f9021e1d {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:00:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-50a69862-e1cf-47a5-ae69-f16e183acbfd tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:00:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-50a69862-e1cf-47a5-ae69-f16e183acbfd tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:00:38 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-50a69862-e1cf-47a5-ae69-f16e183acbfd tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:00:38 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-50a69862-e1cf-47a5-ae69-f16e183acbfd tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:00:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-50a69862-e1cf-47a5-ae69-f16e183acbfd tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:00:38 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-50a69862-e1cf-47a5-ae69-f16e183acbfd tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:00:38 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-50a69862-e1cf-47a5-ae69-f16e183acbfd tempest-CreateVolumesFromSourceVolumeTest-178388027 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 07:00:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-50a69862-e1cf-47a5-ae69-f16e183acbfd tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-20dac492-1385-44b0-8489-7535f9021e1d 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:00:38 devstack sudo[123425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-20dac492-1385-44b0-8489-7535f9021e1d 1073741824 Sep 08 07:00:38 devstack sudo[123425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:00:38 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-caff0cfb-83e1-424f-a6b2-702642ca3bb6 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:00:38 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-caff0cfb-83e1-424f-a6b2-702642ca3bb6 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Flow 'volume_create_manager' (641d5835-c713-4e55-9398-97c449c900b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:00:38 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-caff0cfb-83e1-424f-a6b2-702642ca3bb6 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d76aea0-16aa-4812-a2f7-49bde6d9176e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:00:38 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-caff0cfb-83e1-424f-a6b2-702642ca3bb6 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d76aea0-16aa-4812-a2f7-49bde6d9176e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:00:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1521985997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edc43663-0947-4b11-b4a8-fb33f19b5934,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baab805d38054a76a4bb7852be614089',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:00:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:00:39Z,use_quota=True,user_id='a81715c9892b4e4ab3998421bff18099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:00:38 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-caff0cfb-83e1-424f-a6b2-702642ca3bb6 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4793f2b3-d221-4677-ab88-901e0b6cd8ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:00:38 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-caff0cfb-83e1-424f-a6b2-702642ca3bb6 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4793f2b3-d221-4677-ab88-901e0b6cd8ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:00:38 devstack sudo[123425]: pam_unix(sudo:session): session closed for user root Sep 08 07:00:39 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-caff0cfb-83e1-424f-a6b2-702642ca3bb6 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bd3caff-235c-4539-a903-8d15738c1fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:00:39 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-caff0cfb-83e1-424f-a6b2-702642ca3bb6 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bd3caff-235c-4539-a903-8d15738c1fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edc43663-0947-4b11-b4a8-fb33f19b5934', 'volume_name': 'volume-edc43663-0947-4b11-b4a8-fb33f19b5934', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:00:39 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-caff0cfb-83e1-424f-a6b2-702642ca3bb6 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3026573c-6edc-46da-80ee-259f39d0db0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:00:39 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-caff0cfb-83e1-424f-a6b2-702642ca3bb6 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3026573c-6edc-46da-80ee-259f39d0db0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:00:39 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-caff0cfb-83e1-424f-a6b2-702642ca3bb6 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c8038ff-1592-4627-a6af-0b27d4a105ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:00:39 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-caff0cfb-83e1-424f-a6b2-702642ca3bb6 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Volume edc43663-0947-4b11-b4a8-fb33f19b5934: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edc43663-0947-4b11-b4a8-fb33f19b5934', 'volume_size': 1} Sep 08 07:00:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-caff0cfb-83e1-424f-a6b2-702642ca3bb6 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:00:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-50a69862-e1cf-47a5-ae69-f16e183acbfd tempest-CreateVolumesFromSourceVolumeTest-178388027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-20dac492-1385-44b0-8489-7535f9021e1d 1073741824" returned: 0 in 0.771s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:00:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-50a69862-e1cf-47a5-ae69-f16e183acbfd tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-20dac492-1385-44b0-8489-7535f9021e1d {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:00:39 devstack sudo[123458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-20dac492-1385-44b0-8489-7535f9021e1d Sep 08 07:00:39 devstack sudo[123458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:00:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-01d951da-d6d5-4de9-affe-71e006bb9d05 tempest-VolumeDependencyTests-192281610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:00:39 devstack sudo[123458]: pam_unix(sudo:session): session closed for user root Sep 08 07:00:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-50a69862-e1cf-47a5-ae69-f16e183acbfd tempest-CreateVolumesFromSourceVolumeTest-178388027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-20dac492-1385-44b0-8489-7535f9021e1d" returned: 0 in 0.326s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:00:39 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-50a69862-e1cf-47a5-ae69-f16e183acbfd tempest-CreateVolumesFromSourceVolumeTest-178388027 None] <== create_volume: return (1176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:00:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-50a69862-e1cf-47a5-ae69-f16e183acbfd tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:00:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-caff0cfb-83e1-424f-a6b2-702642ca3bb6 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.406s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:00:39 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-caff0cfb-83e1-424f-a6b2-702642ca3bb6 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:00:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1521985997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edc43663-0947-4b11-b4a8-fb33f19b5934,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baab805d38054a76a4bb7852be614089',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:00:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:00:39Z,use_quota=True,user_id='a81715c9892b4e4ab3998421bff18099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:00:39 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-caff0cfb-83e1-424f-a6b2-702642ca3bb6 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Creating volume edc43663-0947-4b11-b4a8-fb33f19b5934 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:00:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-caff0cfb-83e1-424f-a6b2-702642ca3bb6 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:00:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-caff0cfb-83e1-424f-a6b2-702642ca3bb6 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:00:39 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-caff0cfb-83e1-424f-a6b2-702642ca3bb6 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:00:39 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-caff0cfb-83e1-424f-a6b2-702642ca3bb6 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:00:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-caff0cfb-83e1-424f-a6b2-702642ca3bb6 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:00:39 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-caff0cfb-83e1-424f-a6b2-702642ca3bb6 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:00:39 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-caff0cfb-83e1-424f-a6b2-702642ca3bb6 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 07:00:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-caff0cfb-83e1-424f-a6b2-702642ca3bb6 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-edc43663-0947-4b11-b4a8-fb33f19b5934 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:00:39 devstack sudo[123471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-edc43663-0947-4b11-b4a8-fb33f19b5934 1073741824 Sep 08 07:00:39 devstack sudo[123471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:00:39 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-50a69862-e1cf-47a5-ae69-f16e183acbfd tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0783e598-e36d-44ac-a91b-87801cce76ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20dac492-1385-44b0-8489-7535f9021e1d', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:00:39 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-50a69862-e1cf-47a5-ae69-f16e183acbfd tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54b0bd4f-6d8d-4e0b-b9cb-bb8b0a8c522e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:00:39 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-50a69862-e1cf-47a5-ae69-f16e183acbfd tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Volume volume-20dac492-1385-44b0-8489-7535f9021e1d (20dac492-1385-44b0-8489-7535f9021e1d): created successfully Sep 08 07:00:39 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-50a69862-e1cf-47a5-ae69-f16e183acbfd tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54b0bd4f-6d8d-4e0b-b9cb-bb8b0a8c522e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:00:39 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-50a69862-e1cf-47a5-ae69-f16e183acbfd tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Flow 'volume_create_manager' (0d16881c-52ee-4543-8727-5ca67bd2153b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:00:39 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f1f748b-2ba2-4a89-abf8-df4b2a0174cc tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:00:39 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4f1f748b-2ba2-4a89-abf8-df4b2a0174cc tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Flow 'volume_create_manager' (e454f65a-0d90-4d92-8cab-5bda7b2d5feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:00:39 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4f1f748b-2ba2-4a89-abf8-df4b2a0174cc tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82560fa7-d373-4867-a949-dd20a9a70b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:00:39 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-50a69862-e1cf-47a5-ae69-f16e183acbfd tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Created volume successfully. Sep 08 07:00:39 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4f1f748b-2ba2-4a89-abf8-df4b2a0174cc tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82560fa7-d373-4867-a949-dd20a9a70b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:00:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-128280044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8225e67a-6f8b-464e-b2ee-0680b844a5be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baab805d38054a76a4bb7852be614089',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:00:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:00:39Z,use_quota=True,user_id='a81715c9892b4e4ab3998421bff18099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:00:39 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4f1f748b-2ba2-4a89-abf8-df4b2a0174cc tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81143344-3ce2-4c8a-be49-776e807561f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:00:39 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4f1f748b-2ba2-4a89-abf8-df4b2a0174cc tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81143344-3ce2-4c8a-be49-776e807561f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:00:39 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4f1f748b-2ba2-4a89-abf8-df4b2a0174cc tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (781ed434-08c6-4cd0-8a95-28c1caab69db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:00:39 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4f1f748b-2ba2-4a89-abf8-df4b2a0174cc tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (781ed434-08c6-4cd0-8a95-28c1caab69db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8225e67a-6f8b-464e-b2ee-0680b844a5be', 'volume_name': 'volume-8225e67a-6f8b-464e-b2ee-0680b844a5be', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:00:39 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4f1f748b-2ba2-4a89-abf8-df4b2a0174cc tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab5d601f-09bb-4c24-a0e4-342ace34a0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:00:39 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4f1f748b-2ba2-4a89-abf8-df4b2a0174cc tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab5d601f-09bb-4c24-a0e4-342ace34a0a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:00:39 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4f1f748b-2ba2-4a89-abf8-df4b2a0174cc tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1e18f25-9cf0-47c5-bf15-fb93f4c98ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:00:39 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-4f1f748b-2ba2-4a89-abf8-df4b2a0174cc tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Volume 8225e67a-6f8b-464e-b2ee-0680b844a5be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8225e67a-6f8b-464e-b2ee-0680b844a5be', 'volume_size': 1} Sep 08 07:00:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4f1f748b-2ba2-4a89-abf8-df4b2a0174cc tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:00:39 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d1e6cdb-4d0f-42f7-9b41-6e0eea5736ef tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:00:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9d1e6cdb-4d0f-42f7-9b41-6e0eea5736ef tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Flow 'volume_create_manager' (d0523b00-1ca2-42db-aa53-943c8a7ddee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:00:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9d1e6cdb-4d0f-42f7-9b41-6e0eea5736ef tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af951e1d-1c20-4301-83bd-762ed365e4a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:00:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9d1e6cdb-4d0f-42f7-9b41-6e0eea5736ef tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af951e1d-1c20-4301-83bd-762ed365e4a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:00:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1257157258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a3b1b8f-15d3-4987-8cbc-4e1a1e55fcb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baab805d38054a76a4bb7852be614089',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:00:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:00:40Z,use_quota=True,user_id='a81715c9892b4e4ab3998421bff18099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:00:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9d1e6cdb-4d0f-42f7-9b41-6e0eea5736ef tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7662e758-d1e0-4e3d-a73c-a314cee51bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:00:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9d1e6cdb-4d0f-42f7-9b41-6e0eea5736ef tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7662e758-d1e0-4e3d-a73c-a314cee51bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:00:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9d1e6cdb-4d0f-42f7-9b41-6e0eea5736ef tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac0d01a5-661a-42c0-933a-91b53de98b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:00:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9d1e6cdb-4d0f-42f7-9b41-6e0eea5736ef tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac0d01a5-661a-42c0-933a-91b53de98b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a3b1b8f-15d3-4987-8cbc-4e1a1e55fcb3', 'volume_name': 'volume-5a3b1b8f-15d3-4987-8cbc-4e1a1e55fcb3', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:00:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9d1e6cdb-4d0f-42f7-9b41-6e0eea5736ef tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e8ef398-551e-4ab8-b051-1c21b39699ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:00:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9d1e6cdb-4d0f-42f7-9b41-6e0eea5736ef tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e8ef398-551e-4ab8-b051-1c21b39699ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:00:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9d1e6cdb-4d0f-42f7-9b41-6e0eea5736ef tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34741db2-2de4-4a4c-8923-f11d281454d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:00:40 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-9d1e6cdb-4d0f-42f7-9b41-6e0eea5736ef tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Volume 5a3b1b8f-15d3-4987-8cbc-4e1a1e55fcb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a3b1b8f-15d3-4987-8cbc-4e1a1e55fcb3', 'volume_size': 1} Sep 08 07:00:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-9d1e6cdb-4d0f-42f7-9b41-6e0eea5736ef tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:00:40 devstack sudo[123471]: pam_unix(sudo:session): session closed for user root Sep 08 07:00:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-caff0cfb-83e1-424f-a6b2-702642ca3bb6 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-edc43663-0947-4b11-b4a8-fb33f19b5934 1073741824" returned: 0 in 0.652s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:00:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-caff0cfb-83e1-424f-a6b2-702642ca3bb6 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-edc43663-0947-4b11-b4a8-fb33f19b5934 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:00:40 devstack sudo[123498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-edc43663-0947-4b11-b4a8-fb33f19b5934 Sep 08 07:00:40 devstack sudo[123498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:00:40 devstack sudo[123498]: pam_unix(sudo:session): session closed for user root Sep 08 07:00:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-caff0cfb-83e1-424f-a6b2-702642ca3bb6 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-edc43663-0947-4b11-b4a8-fb33f19b5934" returned: 0 in 0.415s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:00:40 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-caff0cfb-83e1-424f-a6b2-702642ca3bb6 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:00:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-caff0cfb-83e1-424f-a6b2-702642ca3bb6 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:00:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-01d951da-d6d5-4de9-affe-71e006bb9d05 tempest-VolumeDependencyTests-192281610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.396s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:00:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-caff0cfb-83e1-424f-a6b2-702642ca3bb6 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c8038ff-1592-4627-a6af-0b27d4a105ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edc43663-0947-4b11-b4a8-fb33f19b5934', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:00:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-caff0cfb-83e1-424f-a6b2-702642ca3bb6 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff3a8c8a-c705-44b5-9dcd-df192e5407f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:00:40 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-01d951da-d6d5-4de9-affe-71e006bb9d05 tempest-VolumeDependencyTests-192281610 None] Creating offline snapshot ed0fa0a3-0be0-41ab-938f-2dcb80a3bfa8 of volume 9101be79-7548-40b1-8ea8-99c9a687fb3d {{(pid=87507) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 07:00:40 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-caff0cfb-83e1-424f-a6b2-702642ca3bb6 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Volume volume-edc43663-0947-4b11-b4a8-fb33f19b5934 (edc43663-0947-4b11-b4a8-fb33f19b5934): created successfully Sep 08 07:00:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-caff0cfb-83e1-424f-a6b2-702642ca3bb6 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff3a8c8a-c705-44b5-9dcd-df192e5407f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:00:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-caff0cfb-83e1-424f-a6b2-702642ca3bb6 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Flow 'volume_create_manager' (641d5835-c713-4e55-9398-97c449c900b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:00:40 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42a82c6-05f8-43f6-80f0-730e2d0c2d29]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:00:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-01d951da-d6d5-4de9-affe-71e006bb9d05 tempest-VolumeDependencyTests-192281610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9101be79-7548-40b1-8ea8-99c9a687fb3d {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:00:40 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-caff0cfb-83e1-424f-a6b2-702642ca3bb6 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Created volume successfully. Sep 08 07:00:40 devstack sudo[123516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9101be79-7548-40b1-8ea8-99c9a687fb3d Sep 08 07:00:40 devstack sudo[123516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:00:40 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e6d1776-fa4a-4c19-9368-b8b1c34e4e1f tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:00:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8e6d1776-fa4a-4c19-9368-b8b1c34e4e1f tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Flow 'volume_create_manager' (edab1ea0-eb3a-493d-b4f1-b396e4dbbca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:00:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8e6d1776-fa4a-4c19-9368-b8b1c34e4e1f tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95db17f3-aa87-4deb-8f9a-0eb777276051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:00:40 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:00:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Flow 'volume_create_manager' (11bd3f34-73dc-4dd9-96b7-cd7a5c9b159e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:00:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53223a8e-5657-4576-9967-69a8041ed744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:00:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8e6d1776-fa4a-4c19-9368-b8b1c34e4e1f tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95db17f3-aa87-4deb-8f9a-0eb777276051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:00:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1706344440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07987456-9247-4e3b-a1af-d745fcd5a2da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baab805d38054a76a4bb7852be614089',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:00:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:00:41Z,use_quota=True,user_id='a81715c9892b4e4ab3998421bff18099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:00:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8e6d1776-fa4a-4c19-9368-b8b1c34e4e1f tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed1c4e89-53b5-491a-8844-88949382ce46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:00:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8e6d1776-fa4a-4c19-9368-b8b1c34e4e1f tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed1c4e89-53b5-491a-8844-88949382ce46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:00:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8e6d1776-fa4a-4c19-9368-b8b1c34e4e1f tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e705bfa-0974-4048-90bc-5f2cd336628f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:00:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8e6d1776-fa4a-4c19-9368-b8b1c34e4e1f tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e705bfa-0974-4048-90bc-5f2cd336628f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07987456-9247-4e3b-a1af-d745fcd5a2da', 'volume_name': 'volume-07987456-9247-4e3b-a1af-d745fcd5a2da', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:00:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8e6d1776-fa4a-4c19-9368-b8b1c34e4e1f tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ceaaae8-d26e-45df-9d2f-7930c84e4b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:00:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8e6d1776-fa4a-4c19-9368-b8b1c34e4e1f tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ceaaae8-d26e-45df-9d2f-7930c84e4b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:00:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8e6d1776-fa4a-4c19-9368-b8b1c34e4e1f tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f11f2da5-9abf-4b50-b60c-41d1ec0e8dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:00:40 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-8e6d1776-fa4a-4c19-9368-b8b1c34e4e1f tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Volume 07987456-9247-4e3b-a1af-d745fcd5a2da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07987456-9247-4e3b-a1af-d745fcd5a2da', 'volume_size': 1} Sep 08 07:00:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8e6d1776-fa4a-4c19-9368-b8b1c34e4e1f tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:00:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53223a8e-5657-4576-9967-69a8041ed744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:00:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15dee744-78df-4fdc-8d0b-09fe1311f9e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55cd9d5e98c64ce190305628a27703d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:00:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:00:41Z,use_quota=True,user_id='be99c6f1d0554ce68b6684661ebdf139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f196a5c8-c157-408c-a92c-7d0b65e5a39c),volume_type_id=f196a5c8-c157-408c-a92c-7d0b65e5a39c)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:00:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cc7a31a-11f8-4269-80ed-6124bb6edb32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:00:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cc7a31a-11f8-4269-80ed-6124bb6edb32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:00:41 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b72aa78b-da2b-4fda-822f-a07a4e6d805c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:00:41 devstack cinder-volume[87507]: DEBUG cinder.image.glance [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Creating Keystone auth plugin from conf {{(pid=87507) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 08 07:00:41 devstack sudo[123516]: pam_unix(sudo:session): session closed for user root Sep 08 07:00:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-01d951da-d6d5-4de9-affe-71e006bb9d05 tempest-VolumeDependencyTests-192281610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9101be79-7548-40b1-8ea8-99c9a687fb3d" returned: 0 in 0.437s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:00:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-01d951da-d6d5-4de9-affe-71e006bb9d05 tempest-VolumeDependencyTests-192281610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9101be79-7548-40b1-8ea8-99c9a687fb3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9101be79-7548-40b1-8ea8-99c9a687fb3d.ed0fa0a3-0be0-41ab-938f-2dcb80a3bfa8 1G {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:00:41 devstack sudo[123534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9101be79-7548-40b1-8ea8-99c9a687fb3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9101be79-7548-40b1-8ea8-99c9a687fb3d.ed0fa0a3-0be0-41ab-938f-2dcb80a3bfa8 1G Sep 08 07:00:41 devstack sudo[123534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:00:41 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b72aa78b-da2b-4fda-822f-a07a4e6d805c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '15dee744-78df-4fdc-8d0b-09fe1311f9e8', 'volume_name': 'volume-15dee744-78df-4fdc-8d0b-09fe1311f9e8', 'volume_size': 1, 'image_id': '89526562-60d4-4a7a-9bce-3a137151469e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/89526562-60d4-4a7a-9bce-3a137151469e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6c5d88363ba04d53f968af48861b115d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '55cd9d5e98c64ce190305628a27703d7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9c918efa22d3b1fb8b6360db5ee6c896e441c0b2d826595842e2d9f2090264e193f57a32470f518729e39efef8afdfb9be235aac8a1f93365acce1b528e23f63', 'id': '89526562-60d4-4a7a-9bce-3a137151469e', 'created_at': datetime.datetime(2026, 9, 8, 5, 0, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 5, 0, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/89526562-60d4-4a7a-9bce-3a137151469e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:00:41 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc116fa4-096c-4bce-9c9e-eb68e33f043e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:00:41 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc116fa4-096c-4bce-9c9e-eb68e33f043e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:00:41 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (167c3f7d-708e-445a-9444-1c6ce673df7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:00:41 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Volume 15dee744-78df-4fdc-8d0b-09fe1311f9e8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-15dee744-78df-4fdc-8d0b-09fe1311f9e8', 'volume_size': 1, 'image_id': '89526562-60d4-4a7a-9bce-3a137151469e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/89526562-60d4-4a7a-9bce-3a137151469e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6c5d88363ba04d53f968af48861b115d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '55cd9d5e98c64ce190305628a27703d7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9c918efa22d3b1fb8b6360db5ee6c896e441c0b2d826595842e2d9f2090264e193f57a32470f518729e39efef8afdfb9be235aac8a1f93365acce1b528e23f63', 'id': '89526562-60d4-4a7a-9bce-3a137151469e', 'created_at': datetime.datetime(2026, 9, 8, 5, 0, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 5, 0, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/89526562-60d4-4a7a-9bce-3a137151469e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 08 07:00:41 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Trying to clone 15dee744-78df-4fdc-8d0b-09fe1311f9e8 from image 89526562-60d4-4a7a-9bce-3a137151469e at location (None, [{'url': 'file:///opt/stack/data/glance/images/89526562-60d4-4a7a-9bce-3a137151469e', 'metadata': {}}]). {{(pid=87507) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 08 07:00:41 devstack sudo[123534]: pam_unix(sudo:session): session closed for user root Sep 08 07:00:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-01d951da-d6d5-4de9-affe-71e006bb9d05 tempest-VolumeDependencyTests-192281610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9101be79-7548-40b1-8ea8-99c9a687fb3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9101be79-7548-40b1-8ea8-99c9a687fb3d.ed0fa0a3-0be0-41ab-938f-2dcb80a3bfa8 1G" returned: 0 in 0.530s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:00:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-01d951da-d6d5-4de9-affe-71e006bb9d05 tempest-VolumeDependencyTests-192281610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9101be79-7548-40b1-8ea8-99c9a687fb3d -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9101be79-7548-40b1-8ea8-99c9a687fb3d.ed0fa0a3-0be0-41ab-938f-2dcb80a3bfa8 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:00:41 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_89526562-60d4-4a7a-9bce-3a137151469e_w0pc67bndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87507) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 08 07:00:41 devstack cinder-volume[87507]: INFO cinder.image.image_utils [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Image download 0.00 MB at 0.00 MB/s Sep 08 07:00:41 devstack sudo[123558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9101be79-7548-40b1-8ea8-99c9a687fb3d -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9101be79-7548-40b1-8ea8-99c9a687fb3d.ed0fa0a3-0be0-41ab-938f-2dcb80a3bfa8 Sep 08 07:00:41 devstack sudo[123558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:00:41 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[54db1f8b-9aad-408b-b2b7-413969ed2cb6]: (4, 'raw') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:00:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_89526562-60d4-4a7a-9bce-3a137151469e_w0pc67bndevstack@QuobyteHD {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:00:41 devstack sudo[123562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_89526562-60d4-4a7a-9bce-3a137151469e_w0pc67bndevstack@QuobyteHD Sep 08 07:00:41 devstack sudo[123562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:00:41 devstack sudo[123558]: pam_unix(sudo:session): session closed for user root Sep 08 07:00:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-01d951da-d6d5-4de9-affe-71e006bb9d05 tempest-VolumeDependencyTests-192281610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9101be79-7548-40b1-8ea8-99c9a687fb3d -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9101be79-7548-40b1-8ea8-99c9a687fb3d.ed0fa0a3-0be0-41ab-938f-2dcb80a3bfa8" returned: 0 in 0.360s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:00:41 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-01d951da-d6d5-4de9-affe-71e006bb9d05 tempest-VolumeDependencyTests-192281610 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9101be79-7548-40b1-8ea8-99c9a687fb3d.ed0fa0a3-0be0-41ab-938f-2dcb80a3bfa8 is being set with open permissions: ugo+rw Sep 08 07:00:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-01d951da-d6d5-4de9-affe-71e006bb9d05 tempest-VolumeDependencyTests-192281610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9101be79-7548-40b1-8ea8-99c9a687fb3d.ed0fa0a3-0be0-41ab-938f-2dcb80a3bfa8 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:00:42 devstack sudo[123575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9101be79-7548-40b1-8ea8-99c9a687fb3d.ed0fa0a3-0be0-41ab-938f-2dcb80a3bfa8 Sep 08 07:00:42 devstack sudo[123575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:00:42 devstack sudo[123562]: pam_unix(sudo:session): session closed for user root Sep 08 07:00:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_89526562-60d4-4a7a-9bce-3a137151469e_w0pc67bndevstack@QuobyteHD" returned: 0 in 0.359s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:00:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89526562-60d4-4a7a-9bce-3a137151469e_w0pc67bndevstack@QuobyteHD {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:00:42 devstack sudo[123582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89526562-60d4-4a7a-9bce-3a137151469e_w0pc67bndevstack@QuobyteHD Sep 08 07:00:42 devstack sudo[123582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:00:42 devstack sudo[123575]: pam_unix(sudo:session): session closed for user root Sep 08 07:00:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-01d951da-d6d5-4de9-affe-71e006bb9d05 tempest-VolumeDependencyTests-192281610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9101be79-7548-40b1-8ea8-99c9a687fb3d.ed0fa0a3-0be0-41ab-938f-2dcb80a3bfa8" returned: 0 in 0.306s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:00:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-01d951da-d6d5-4de9-affe-71e006bb9d05 tempest-VolumeDependencyTests-192281610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9101be79-7548-40b1-8ea8-99c9a687fb3d.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:00:42 devstack sudo[123594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9101be79-7548-40b1-8ea8-99c9a687fb3d.info Sep 08 07:00:42 devstack sudo[123594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:00:42 devstack sudo[123582]: pam_unix(sudo:session): session closed for user root Sep 08 07:00:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89526562-60d4-4a7a-9bce-3a137151469e_w0pc67bndevstack@QuobyteHD" returned: 1 in 0.421s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:00:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89526562-60d4-4a7a-9bce-3a137151469e_w0pc67bndevstack@QuobyteHD' failed. Not Retrying. {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 07:00:42 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Temporary image 89526562-60d4-4a7a-9bce-3a137151469e is fetched for user be99c6f1d0554ce68b6684661ebdf139. {{(pid=87507) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 08 07:00:42 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f73b3a3-4471-42e5-b207-91353c470d86]: (4, 'raw') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:00:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_89526562-60d4-4a7a-9bce-3a137151469e_w0pc67bndevstack@QuobyteHD {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:00:42 devstack sudo[123594]: pam_unix(sudo:session): session closed for user root Sep 08 07:00:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-01d951da-d6d5-4de9-affe-71e006bb9d05 tempest-VolumeDependencyTests-192281610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9101be79-7548-40b1-8ea8-99c9a687fb3d.info" returned: 0 in 0.286s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:00:42 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-01d951da-d6d5-4de9-affe-71e006bb9d05 tempest-VolumeDependencyTests-192281610 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9101be79-7548-40b1-8ea8-99c9a687fb3d.info is being set with open permissions: ugo+rw Sep 08 07:00:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-01d951da-d6d5-4de9-affe-71e006bb9d05 tempest-VolumeDependencyTests-192281610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9101be79-7548-40b1-8ea8-99c9a687fb3d.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:00:42 devstack sudo[123609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9101be79-7548-40b1-8ea8-99c9a687fb3d.info Sep 08 07:00:42 devstack sudo[123609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:00:42 devstack sudo[123606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_89526562-60d4-4a7a-9bce-3a137151469e_w0pc67bndevstack@QuobyteHD Sep 08 07:00:42 devstack sudo[123606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:00:42 devstack sudo[123609]: pam_unix(sudo:session): session closed for user root Sep 08 07:00:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-01d951da-d6d5-4de9-affe-71e006bb9d05 tempest-VolumeDependencyTests-192281610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9101be79-7548-40b1-8ea8-99c9a687fb3d.info" returned: 0 in 0.275s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:00:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-01d951da-d6d5-4de9-affe-71e006bb9d05 tempest-VolumeDependencyTests-192281610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.336s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:00:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4f1f748b-2ba2-4a89-abf8-df4b2a0174cc tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.018s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:00:42 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-4f1f748b-2ba2-4a89-abf8-df4b2a0174cc tempest-CreateVolumesFromSourceVolumeTest-178388027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:00:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-128280044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8225e67a-6f8b-464e-b2ee-0680b844a5be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baab805d38054a76a4bb7852be614089',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:00:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:00:39Z,use_quota=True,user_id='a81715c9892b4e4ab3998421bff18099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:00:42 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-4f1f748b-2ba2-4a89-abf8-df4b2a0174cc tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Creating volume 8225e67a-6f8b-464e-b2ee-0680b844a5be {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:00:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4f1f748b-2ba2-4a89-abf8-df4b2a0174cc tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:00:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4f1f748b-2ba2-4a89-abf8-df4b2a0174cc tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:00:42 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-4f1f748b-2ba2-4a89-abf8-df4b2a0174cc tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:00:42 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-4f1f748b-2ba2-4a89-abf8-df4b2a0174cc tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:00:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4f1f748b-2ba2-4a89-abf8-df4b2a0174cc tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:00:42 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-4f1f748b-2ba2-4a89-abf8-df4b2a0174cc tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:00:42 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-4f1f748b-2ba2-4a89-abf8-df4b2a0174cc tempest-CreateVolumesFromSourceVolumeTest-178388027 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 07:00:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4f1f748b-2ba2-4a89-abf8-df4b2a0174cc tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8225e67a-6f8b-464e-b2ee-0680b844a5be 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:00:42 devstack sudo[123606]: pam_unix(sudo:session): session closed for user root Sep 08 07:00:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_89526562-60d4-4a7a-9bce-3a137151469e_w0pc67bndevstack@QuobyteHD" returned: 0 in 0.373s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:00:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89526562-60d4-4a7a-9bce-3a137151469e_w0pc67bndevstack@QuobyteHD {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:00:42 devstack sudo[123624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8225e67a-6f8b-464e-b2ee-0680b844a5be 1073741824 Sep 08 07:00:42 devstack sudo[123624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:00:42 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-01d951da-d6d5-4de9-affe-71e006bb9d05 tempest-VolumeDependencyTests-192281610 None] Create snapshot completed successfully Sep 08 07:00:43 devstack sudo[123627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89526562-60d4-4a7a-9bce-3a137151469e_w0pc67bndevstack@QuobyteHD Sep 08 07:00:43 devstack sudo[123627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:00:43 devstack sudo[123627]: pam_unix(sudo:session): session closed for user root Sep 08 07:00:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89526562-60d4-4a7a-9bce-3a137151469e_w0pc67bndevstack@QuobyteHD" returned: 1 in 0.351s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:00:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89526562-60d4-4a7a-9bce-3a137151469e_w0pc67bndevstack@QuobyteHD' failed. Not Retrying. {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 07:00:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:00:43 devstack sudo[123624]: pam_unix(sudo:session): session closed for user root Sep 08 07:00:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4f1f748b-2ba2-4a89-abf8-df4b2a0174cc tempest-CreateVolumesFromSourceVolumeTest-178388027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8225e67a-6f8b-464e-b2ee-0680b844a5be 1073741824" returned: 0 in 0.486s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:00:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4f1f748b-2ba2-4a89-abf8-df4b2a0174cc tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8225e67a-6f8b-464e-b2ee-0680b844a5be {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:00:43 devstack sudo[123651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8225e67a-6f8b-464e-b2ee-0680b844a5be Sep 08 07:00:43 devstack sudo[123651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:00:43 devstack sudo[123651]: pam_unix(sudo:session): session closed for user root Sep 08 07:00:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4f1f748b-2ba2-4a89-abf8-df4b2a0174cc tempest-CreateVolumesFromSourceVolumeTest-178388027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8225e67a-6f8b-464e-b2ee-0680b844a5be" returned: 0 in 0.278s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:00:43 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-4f1f748b-2ba2-4a89-abf8-df4b2a0174cc tempest-CreateVolumesFromSourceVolumeTest-178388027 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:00:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4f1f748b-2ba2-4a89-abf8-df4b2a0174cc tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:00:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-9d1e6cdb-4d0f-42f7-9b41-6e0eea5736ef tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.648s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:00:43 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-9d1e6cdb-4d0f-42f7-9b41-6e0eea5736ef tempest-CreateVolumesFromSourceVolumeTest-178388027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:00:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1257157258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a3b1b8f-15d3-4987-8cbc-4e1a1e55fcb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baab805d38054a76a4bb7852be614089',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:00:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:00:40Z,use_quota=True,user_id='a81715c9892b4e4ab3998421bff18099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:00:43 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-9d1e6cdb-4d0f-42f7-9b41-6e0eea5736ef tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Creating volume 5a3b1b8f-15d3-4987-8cbc-4e1a1e55fcb3 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:00:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-9d1e6cdb-4d0f-42f7-9b41-6e0eea5736ef tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:00:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-9d1e6cdb-4d0f-42f7-9b41-6e0eea5736ef tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:00:43 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-9d1e6cdb-4d0f-42f7-9b41-6e0eea5736ef tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:00:43 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-9d1e6cdb-4d0f-42f7-9b41-6e0eea5736ef tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:00:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-9d1e6cdb-4d0f-42f7-9b41-6e0eea5736ef tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:00:43 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-9d1e6cdb-4d0f-42f7-9b41-6e0eea5736ef tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:00:43 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-9d1e6cdb-4d0f-42f7-9b41-6e0eea5736ef tempest-CreateVolumesFromSourceVolumeTest-178388027 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 07:00:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9d1e6cdb-4d0f-42f7-9b41-6e0eea5736ef tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5a3b1b8f-15d3-4987-8cbc-4e1a1e55fcb3 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:00:43 devstack sudo[123663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5a3b1b8f-15d3-4987-8cbc-4e1a1e55fcb3 1073741824 Sep 08 07:00:43 devstack sudo[123663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:00:43 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4f1f748b-2ba2-4a89-abf8-df4b2a0174cc tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1e18f25-9cf0-47c5-bf15-fb93f4c98ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8225e67a-6f8b-464e-b2ee-0680b844a5be', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:00:43 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4f1f748b-2ba2-4a89-abf8-df4b2a0174cc tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50c9039e-3883-4016-a907-51d8d0365259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:00:43 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-4f1f748b-2ba2-4a89-abf8-df4b2a0174cc tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Volume volume-8225e67a-6f8b-464e-b2ee-0680b844a5be (8225e67a-6f8b-464e-b2ee-0680b844a5be): created successfully Sep 08 07:00:43 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4f1f748b-2ba2-4a89-abf8-df4b2a0174cc tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50c9039e-3883-4016-a907-51d8d0365259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:00:43 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4f1f748b-2ba2-4a89-abf8-df4b2a0174cc tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Flow 'volume_create_manager' (e454f65a-0d90-4d92-8cab-5bda7b2d5feb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:00:43 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-4f1f748b-2ba2-4a89-abf8-df4b2a0174cc tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Created volume successfully. Sep 08 07:00:44 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fe448d2-5195-4e06-a23e-fcec7efb1086 tempest-VolumeDependencyTests-192281610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:00:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5fe448d2-5195-4e06-a23e-fcec7efb1086 tempest-VolumeDependencyTests-192281610 None] Flow 'volume_create_manager' (234f5018-2637-4860-9b7c-b50d082b1a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:00:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5fe448d2-5195-4e06-a23e-fcec7efb1086 tempest-VolumeDependencyTests-192281610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b154072e-e1b9-4649-8fce-3e95771d846f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:00:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5fe448d2-5195-4e06-a23e-fcec7efb1086 tempest-VolumeDependencyTests-192281610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b154072e-e1b9-4649-8fce-3e95771d846f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:00:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-660023380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9bf7735-1211-4024-a4d3-ca3f5491cf3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83091f6f94b54375a77d194170732807',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:00:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ed0fa0a3-0be0-41ab-938f-2dcb80a3bfa8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:00:44Z,use_quota=True,user_id='8ccdbd3a2d2b43b7b92df3142b128016',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:00:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5fe448d2-5195-4e06-a23e-fcec7efb1086 tempest-VolumeDependencyTests-192281610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c316b5dd-69bf-4b42-88ed-d2e27f036b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:00:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5fe448d2-5195-4e06-a23e-fcec7efb1086 tempest-VolumeDependencyTests-192281610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c316b5dd-69bf-4b42-88ed-d2e27f036b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:00:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5fe448d2-5195-4e06-a23e-fcec7efb1086 tempest-VolumeDependencyTests-192281610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daaf56ab-092e-4912-9a63-b5723041c3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:00:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5fe448d2-5195-4e06-a23e-fcec7efb1086 tempest-VolumeDependencyTests-192281610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daaf56ab-092e-4912-9a63-b5723041c3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a9bf7735-1211-4024-a4d3-ca3f5491cf3c', 'volume_name': 'volume-a9bf7735-1211-4024-a4d3-ca3f5491cf3c', 'volume_size': 1, 'snapshot_id': 'ed0fa0a3-0be0-41ab-938f-2dcb80a3bfa8'}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:00:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5fe448d2-5195-4e06-a23e-fcec7efb1086 tempest-VolumeDependencyTests-192281610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86406f6e-dfe0-404f-90b6-41ba1b18898b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:00:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5fe448d2-5195-4e06-a23e-fcec7efb1086 tempest-VolumeDependencyTests-192281610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86406f6e-dfe0-404f-90b6-41ba1b18898b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:00:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5fe448d2-5195-4e06-a23e-fcec7efb1086 tempest-VolumeDependencyTests-192281610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a8785f8-8274-4a8f-8878-ff98524a9673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:00:44 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-5fe448d2-5195-4e06-a23e-fcec7efb1086 tempest-VolumeDependencyTests-192281610 None] Volume a9bf7735-1211-4024-a4d3-ca3f5491cf3c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a9bf7735-1211-4024-a4d3-ca3f5491cf3c', 'volume_size': 1, 'snapshot_id': 'ed0fa0a3-0be0-41ab-938f-2dcb80a3bfa8'} Sep 08 07:00:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-5fe448d2-5195-4e06-a23e-fcec7efb1086 tempest-VolumeDependencyTests-192281610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:00:44 devstack sudo[123663]: pam_unix(sudo:session): session closed for user root Sep 08 07:00:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9d1e6cdb-4d0f-42f7-9b41-6e0eea5736ef tempest-CreateVolumesFromSourceVolumeTest-178388027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5a3b1b8f-15d3-4987-8cbc-4e1a1e55fcb3 1073741824" returned: 0 in 0.625s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:00:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9d1e6cdb-4d0f-42f7-9b41-6e0eea5736ef tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5a3b1b8f-15d3-4987-8cbc-4e1a1e55fcb3 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:00:44 devstack sudo[123687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5a3b1b8f-15d3-4987-8cbc-4e1a1e55fcb3 Sep 08 07:00:44 devstack sudo[123687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:00:44 devstack sudo[123687]: pam_unix(sudo:session): session closed for user root Sep 08 07:00:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9d1e6cdb-4d0f-42f7-9b41-6e0eea5736ef tempest-CreateVolumesFromSourceVolumeTest-178388027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5a3b1b8f-15d3-4987-8cbc-4e1a1e55fcb3" returned: 0 in 0.281s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:00:44 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-9d1e6cdb-4d0f-42f7-9b41-6e0eea5736ef tempest-CreateVolumesFromSourceVolumeTest-178388027 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:00:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-9d1e6cdb-4d0f-42f7-9b41-6e0eea5736ef tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:00:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8e6d1776-fa4a-4c19-9368-b8b1c34e4e1f tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.713s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:00:44 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8e6d1776-fa4a-4c19-9368-b8b1c34e4e1f tempest-CreateVolumesFromSourceVolumeTest-178388027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:00:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1706344440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07987456-9247-4e3b-a1af-d745fcd5a2da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baab805d38054a76a4bb7852be614089',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:00:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:00:41Z,use_quota=True,user_id='a81715c9892b4e4ab3998421bff18099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:00:44 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-8e6d1776-fa4a-4c19-9368-b8b1c34e4e1f tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Creating volume 07987456-9247-4e3b-a1af-d745fcd5a2da {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:00:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8e6d1776-fa4a-4c19-9368-b8b1c34e4e1f tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:00:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8e6d1776-fa4a-4c19-9368-b8b1c34e4e1f tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:00:44 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8e6d1776-fa4a-4c19-9368-b8b1c34e4e1f tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:00:44 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8e6d1776-fa4a-4c19-9368-b8b1c34e4e1f tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:00:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8e6d1776-fa4a-4c19-9368-b8b1c34e4e1f tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:00:44 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8e6d1776-fa4a-4c19-9368-b8b1c34e4e1f tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:00:44 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-8e6d1776-fa4a-4c19-9368-b8b1c34e4e1f tempest-CreateVolumesFromSourceVolumeTest-178388027 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 07:00:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8e6d1776-fa4a-4c19-9368-b8b1c34e4e1f tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-07987456-9247-4e3b-a1af-d745fcd5a2da 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:00:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9d1e6cdb-4d0f-42f7-9b41-6e0eea5736ef tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34741db2-2de4-4a4c-8923-f11d281454d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a3b1b8f-15d3-4987-8cbc-4e1a1e55fcb3', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:00:44 devstack sudo[123699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-07987456-9247-4e3b-a1af-d745fcd5a2da 1073741824 Sep 08 07:00:44 devstack sudo[123699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:00:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9d1e6cdb-4d0f-42f7-9b41-6e0eea5736ef tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79790863-2c58-4556-ae6c-d93d1baaa24d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:00:44 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-9d1e6cdb-4d0f-42f7-9b41-6e0eea5736ef tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Volume volume-5a3b1b8f-15d3-4987-8cbc-4e1a1e55fcb3 (5a3b1b8f-15d3-4987-8cbc-4e1a1e55fcb3): created successfully Sep 08 07:00:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9d1e6cdb-4d0f-42f7-9b41-6e0eea5736ef tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79790863-2c58-4556-ae6c-d93d1baaa24d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:00:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9d1e6cdb-4d0f-42f7-9b41-6e0eea5736ef tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Flow 'volume_create_manager' (d0523b00-1ca2-42db-aa53-943c8a7ddee2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:00:44 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-9d1e6cdb-4d0f-42f7-9b41-6e0eea5736ef tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Created volume successfully. Sep 08 07:00:45 devstack sudo[123699]: pam_unix(sudo:session): session closed for user root Sep 08 07:00:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8e6d1776-fa4a-4c19-9368-b8b1c34e4e1f tempest-CreateVolumesFromSourceVolumeTest-178388027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-07987456-9247-4e3b-a1af-d745fcd5a2da 1073741824" returned: 0 in 0.516s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:00:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8e6d1776-fa4a-4c19-9368-b8b1c34e4e1f tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-07987456-9247-4e3b-a1af-d745fcd5a2da {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:00:45 devstack sudo[123722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-07987456-9247-4e3b-a1af-d745fcd5a2da Sep 08 07:00:45 devstack sudo[123722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:00:45 devstack sudo[123722]: pam_unix(sudo:session): session closed for user root Sep 08 07:00:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8e6d1776-fa4a-4c19-9368-b8b1c34e4e1f tempest-CreateVolumesFromSourceVolumeTest-178388027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-07987456-9247-4e3b-a1af-d745fcd5a2da" returned: 0 in 0.254s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:00:45 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8e6d1776-fa4a-4c19-9368-b8b1c34e4e1f tempest-CreateVolumesFromSourceVolumeTest-178388027 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:00:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8e6d1776-fa4a-4c19-9368-b8b1c34e4e1f tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:00:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.200s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:00:45 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:00:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15dee744-78df-4fdc-8d0b-09fe1311f9e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55cd9d5e98c64ce190305628a27703d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:00:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:00:41Z,use_quota=True,user_id='be99c6f1d0554ce68b6684661ebdf139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f196a5c8-c157-408c-a92c-7d0b65e5a39c),volume_type_id=f196a5c8-c157-408c-a92c-7d0b65e5a39c)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:00:45 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Creating volume 15dee744-78df-4fdc-8d0b-09fe1311f9e8 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:00:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:00:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:00:45 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:00:45 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:00:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:00:45 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:00:45 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 07:00:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-15dee744-78df-4fdc-8d0b-09fe1311f9e8 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:00:45 devstack sudo[123732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-15dee744-78df-4fdc-8d0b-09fe1311f9e8 1073741824 Sep 08 07:00:45 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8e6d1776-fa4a-4c19-9368-b8b1c34e4e1f tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f11f2da5-9abf-4b50-b60c-41d1ec0e8dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07987456-9247-4e3b-a1af-d745fcd5a2da', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:00:45 devstack sudo[123732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:00:45 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8e6d1776-fa4a-4c19-9368-b8b1c34e4e1f tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bd3703c-f17d-4be4-a22c-559b4c9bee45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:00:45 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-8e6d1776-fa4a-4c19-9368-b8b1c34e4e1f tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Volume volume-07987456-9247-4e3b-a1af-d745fcd5a2da (07987456-9247-4e3b-a1af-d745fcd5a2da): created successfully Sep 08 07:00:45 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8e6d1776-fa4a-4c19-9368-b8b1c34e4e1f tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bd3703c-f17d-4be4-a22c-559b4c9bee45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:00:45 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8e6d1776-fa4a-4c19-9368-b8b1c34e4e1f tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Flow 'volume_create_manager' (edab1ea0-eb3a-493d-b4f1-b396e4dbbca4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:00:45 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-8e6d1776-fa4a-4c19-9368-b8b1c34e4e1f tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Created volume successfully. Sep 08 07:00:46 devstack sudo[123732]: pam_unix(sudo:session): session closed for user root Sep 08 07:00:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-15dee744-78df-4fdc-8d0b-09fe1311f9e8 1073741824" returned: 0 in 0.588s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:00:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-15dee744-78df-4fdc-8d0b-09fe1311f9e8 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:00:46 devstack sudo[123756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-15dee744-78df-4fdc-8d0b-09fe1311f9e8 Sep 08 07:00:46 devstack sudo[123756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:00:46 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-e9f915d6-43db-4303-a5da-49451033ca6d tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Acquiring lock "cinder-07987456-9247-4e3b-a1af-d745fcd5a2da-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:00:46 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-e9f915d6-43db-4303-a5da-49451033ca6d tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Lock "cinder-07987456-9247-4e3b-a1af-d745fcd5a2da-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:00:46 devstack sudo[123756]: pam_unix(sudo:session): session closed for user root Sep 08 07:00:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-15dee744-78df-4fdc-8d0b-09fe1311f9e8" returned: 0 in 0.331s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:00:46 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:00:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:00:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-5fe448d2-5195-4e06-a23e-fcec7efb1086 tempest-VolumeDependencyTests-192281610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.128s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:00:46 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-5fe448d2-5195-4e06-a23e-fcec7efb1086 tempest-VolumeDependencyTests-192281610 None] Acquiring lock "cinder-quobyte-ed0fa0a3-0be0-41ab-938f-2dcb80a3bfa8-a9bf7735-1211-4024-a4d3-ca3f5491cf3c" by "_create_volume_from_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:00:46 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-5fe448d2-5195-4e06-a23e-fcec7efb1086 tempest-VolumeDependencyTests-192281610 None] Lock "cinder-quobyte-ed0fa0a3-0be0-41ab-938f-2dcb80a3bfa8-a9bf7735-1211-4024-a4d3-ca3f5491cf3c" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:00:46 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-5fe448d2-5195-4e06-a23e-fcec7efb1086 tempest-VolumeDependencyTests-192281610 None] Creating volume a9bf7735-1211-4024-a4d3-ca3f5491cf3c from snapshot ed0fa0a3-0be0-41ab-938f-2dcb80a3bfa8 {{(pid=87507) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 08 07:00:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-5fe448d2-5195-4e06-a23e-fcec7efb1086 tempest-VolumeDependencyTests-192281610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:00:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-5fe448d2-5195-4e06-a23e-fcec7efb1086 tempest-VolumeDependencyTests-192281610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:00:46 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-5fe448d2-5195-4e06-a23e-fcec7efb1086 tempest-VolumeDependencyTests-192281610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:00:46 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-5fe448d2-5195-4e06-a23e-fcec7efb1086 tempest-VolumeDependencyTests-192281610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:00:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-5fe448d2-5195-4e06-a23e-fcec7efb1086 tempest-VolumeDependencyTests-192281610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:00:46 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-5fe448d2-5195-4e06-a23e-fcec7efb1086 tempest-VolumeDependencyTests-192281610 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:00:46 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-5fe448d2-5195-4e06-a23e-fcec7efb1086 tempest-VolumeDependencyTests-192281610 None] Acquiring lock "cinder-quobyte-a9bf7735-1211-4024-a4d3-ca3f5491cf3c" by "_copy_volume_from_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:00:46 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-5fe448d2-5195-4e06-a23e-fcec7efb1086 tempest-VolumeDependencyTests-192281610 None] Lock "cinder-quobyte-a9bf7735-1211-4024-a4d3-ca3f5491cf3c" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:00:46 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-5fe448d2-5195-4e06-a23e-fcec7efb1086 tempest-VolumeDependencyTests-192281610 None] snapshot: ed0fa0a3-0be0-41ab-938f-2dcb80a3bfa8, volume: a9bf7735-1211-4024-a4d3-ca3f5491cf3c, {{(pid=87507) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 08 07:00:46 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-e9f915d6-43db-4303-a5da-49451033ca6d tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Acquiring lock "cinder-quobyte-07987456-9247-4e3b-a1af-d745fcd5a2da" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:00:46 devstack cinder-volume[87507]: DEBUG cinder.volume.volume_utils [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Attempting download of 89526562-60d4-4a7a-9bce-3a137151469e ((None, [{'url': 'file:///opt/stack/data/glance/images/89526562-60d4-4a7a-9bce-3a137151469e', 'metadata': {}}])) to volume 15dee744-78df-4fdc-8d0b-09fe1311f9e8. {{(pid=87507) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 08 07:00:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-5fe448d2-5195-4e06-a23e-fcec7efb1086 tempest-VolumeDependencyTests-192281610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:00:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-5fe448d2-5195-4e06-a23e-fcec7efb1086 tempest-VolumeDependencyTests-192281610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:00:46 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-5fe448d2-5195-4e06-a23e-fcec7efb1086 tempest-VolumeDependencyTests-192281610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:00:46 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-5fe448d2-5195-4e06-a23e-fcec7efb1086 tempest-VolumeDependencyTests-192281610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:00:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-5fe448d2-5195-4e06-a23e-fcec7efb1086 tempest-VolumeDependencyTests-192281610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:00:46 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-e9f915d6-43db-4303-a5da-49451033ca6d tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Lock "cinder-quobyte-07987456-9247-4e3b-a1af-d745fcd5a2da" acquired by "delete_volume" :: waited 0.067s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:00:46 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c58868-8045-49af-8301-4d935af90af9]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:00:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5fe448d2-5195-4e06-a23e-fcec7efb1086 tempest-VolumeDependencyTests-192281610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9101be79-7548-40b1-8ea8-99c9a687fb3d.ed0fa0a3-0be0-41ab-938f-2dcb80a3bfa8 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:00:46 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed9a861-14b1-4837-88ac-fef6db4b87d5]: (4, 'raw') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:00:46 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd947c63-295c-4998-be6f-c991caa816aa]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:00:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_89526562-60d4-4a7a-9bce-3a137151469e_qbad3_e6 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:00:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e9f915d6-43db-4303-a5da-49451033ca6d tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-07987456-9247-4e3b-a1af-d745fcd5a2da {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:00:46 devstack sudo[123774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9101be79-7548-40b1-8ea8-99c9a687fb3d.ed0fa0a3-0be0-41ab-938f-2dcb80a3bfa8 Sep 08 07:00:46 devstack sudo[123774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:00:46 devstack sudo[123777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_89526562-60d4-4a7a-9bce-3a137151469e_qbad3_e6 Sep 08 07:00:46 devstack sudo[123777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:00:46 devstack sudo[123779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-07987456-9247-4e3b-a1af-d745fcd5a2da Sep 08 07:00:46 devstack sudo[123779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:00:47 devstack sudo[123774]: pam_unix(sudo:session): session closed for user root Sep 08 07:00:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5fe448d2-5195-4e06-a23e-fcec7efb1086 tempest-VolumeDependencyTests-192281610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9101be79-7548-40b1-8ea8-99c9a687fb3d.ed0fa0a3-0be0-41ab-938f-2dcb80a3bfa8" returned: 0 in 0.455s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:00:47 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-5fe448d2-5195-4e06-a23e-fcec7efb1086 tempest-VolumeDependencyTests-192281610 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9101be79-7548-40b1-8ea8-99c9a687fb3d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:00:47 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f01af8c-8a77-408b-8ff0-6de023f95539]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:00:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5fe448d2-5195-4e06-a23e-fcec7efb1086 tempest-VolumeDependencyTests-192281610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9101be79-7548-40b1-8ea8-99c9a687fb3d {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:00:47 devstack sudo[123779]: pam_unix(sudo:session): session closed for user root Sep 08 07:00:47 devstack sudo[123777]: pam_unix(sudo:session): session closed for user root Sep 08 07:00:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e9f915d6-43db-4303-a5da-49451033ca6d tempest-CreateVolumesFromSourceVolumeTest-178388027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-07987456-9247-4e3b-a1af-d745fcd5a2da" returned: 0 in 0.512s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:00:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e9f915d6-43db-4303-a5da-49451033ca6d tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-07987456-9247-4e3b-a1af-d745fcd5a2da {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:00:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_89526562-60d4-4a7a-9bce-3a137151469e_qbad3_e6" returned: 0 in 0.542s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:00:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_89526562-60d4-4a7a-9bce-3a137151469e_qbad3_e6 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:00:47 devstack sudo[123808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-07987456-9247-4e3b-a1af-d745fcd5a2da Sep 08 07:00:47 devstack sudo[123808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:00:47 devstack sudo[123803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9101be79-7548-40b1-8ea8-99c9a687fb3d Sep 08 07:00:47 devstack sudo[123803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:00:47 devstack sudo[123809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_89526562-60d4-4a7a-9bce-3a137151469e_qbad3_e6 Sep 08 07:00:47 devstack sudo[123809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:00:47 devstack sudo[123808]: pam_unix(sudo:session): session closed for user root Sep 08 07:00:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e9f915d6-43db-4303-a5da-49451033ca6d tempest-CreateVolumesFromSourceVolumeTest-178388027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-07987456-9247-4e3b-a1af-d745fcd5a2da" returned: 0 in 0.379s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:00:47 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-e9f915d6-43db-4303-a5da-49451033ca6d tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Lock "cinder-quobyte-07987456-9247-4e3b-a1af-d745fcd5a2da" released by "delete_volume" :: held 0.954s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:00:47 devstack sudo[123803]: pam_unix(sudo:session): session closed for user root Sep 08 07:00:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5fe448d2-5195-4e06-a23e-fcec7efb1086 tempest-VolumeDependencyTests-192281610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9101be79-7548-40b1-8ea8-99c9a687fb3d" returned: 0 in 0.481s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:00:47 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-5fe448d2-5195-4e06-a23e-fcec7efb1086 tempest-VolumeDependencyTests-192281610 None] will copy from snapshot at /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9101be79-7548-40b1-8ea8-99c9a687fb3d {{(pid=87507) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 08 07:00:47 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-5fe448d2-5195-4e06-a23e-fcec7efb1086 tempest-VolumeDependencyTests-192281610 None] Creating direct copy from snapshot {{(pid=87507) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 08 07:00:47 devstack cinder-volume[87507]: DEBUG cinder.utils [None req-5fe448d2-5195-4e06-a23e-fcec7efb1086 tempest-VolumeDependencyTests-192281610 None] Path /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a9bf7735-1211-4024-a4d3-ca3f5491cf3c not found in is_blk_device check {{(pid=87507) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 08 07:00:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5fe448d2-5195-4e06-a23e-fcec7efb1086 tempest-VolumeDependencyTests-192281610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9101be79-7548-40b1-8ea8-99c9a687fb3d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a9bf7735-1211-4024-a4d3-ca3f5491cf3c {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:00:47 devstack sudo[123829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9101be79-7548-40b1-8ea8-99c9a687fb3d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a9bf7735-1211-4024-a4d3-ca3f5491cf3c Sep 08 07:00:47 devstack sudo[123829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:00:47 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-e9f915d6-43db-4303-a5da-49451033ca6d tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Created reservations ['a885a9f7-2209-4623-9e50-b45c7c4253e7', '567e695c-401c-483f-bd41-56da162ac866', '5c72a40a-7a1d-432b-a889-df5b5a0f7614', '212c154b-0b65-4fa7-96ba-923664d4331c'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:00:47 devstack sudo[123809]: pam_unix(sudo:session): session closed for user root Sep 08 07:00:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_89526562-60d4-4a7a-9bce-3a137151469e_qbad3_e6" returned: 1 in 0.496s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:00:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_89526562-60d4-4a7a-9bce-3a137151469e_qbad3_e6' failed. Not Retrying. {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 07:00:47 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ccc9e20-85c6-4557-9a69-eef029839540]: (4, 'raw') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:00:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_89526562-60d4-4a7a-9bce-3a137151469e_w0pc67bndevstack@QuobyteHD {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:00:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-e9f915d6-43db-4303-a5da-49451033ca6d tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:00:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-e9f915d6-43db-4303-a5da-49451033ca6d tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:00:47 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-e9f915d6-43db-4303-a5da-49451033ca6d tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:00:47 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-e9f915d6-43db-4303-a5da-49451033ca6d tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:00:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-e9f915d6-43db-4303-a5da-49451033ca6d tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:00:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e9f915d6-43db-4303-a5da-49451033ca6d tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:00:47 devstack sudo[123840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 07:00:47 devstack sudo[123840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:00:47 devstack sudo[123836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_89526562-60d4-4a7a-9bce-3a137151469e_w0pc67bndevstack@QuobyteHD Sep 08 07:00:47 devstack sudo[123836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:00:48 devstack sudo[123836]: pam_unix(sudo:session): session closed for user root Sep 08 07:00:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_89526562-60d4-4a7a-9bce-3a137151469e_w0pc67bndevstack@QuobyteHD" returned: 0 in 0.443s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:00:48 devstack sudo[123840]: pam_unix(sudo:session): session closed for user root Sep 08 07:00:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89526562-60d4-4a7a-9bce-3a137151469e_w0pc67bndevstack@QuobyteHD {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:00:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e9f915d6-43db-4303-a5da-49451033ca6d tempest-CreateVolumesFromSourceVolumeTest-178388027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.391s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:00:48 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-e9f915d6-43db-4303-a5da-49451033ca6d tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:00:48 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-e9f915d6-43db-4303-a5da-49451033ca6d tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Deleted volume successfully. Sep 08 07:00:48 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-e9f915d6-43db-4303-a5da-49451033ca6d tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Lock "cinder-07987456-9247-4e3b-a1af-d745fcd5a2da-delete_volume" released by "delete_volume" :: held 1.894s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:00:48 devstack sudo[123867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89526562-60d4-4a7a-9bce-3a137151469e_w0pc67bndevstack@QuobyteHD Sep 08 07:00:48 devstack sudo[123867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:00:48 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-d36e022b-edc5-4dbb-8caa-73e70e8eb4e8 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Acquiring lock "cinder-5a3b1b8f-15d3-4987-8cbc-4e1a1e55fcb3-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:00:48 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-d36e022b-edc5-4dbb-8caa-73e70e8eb4e8 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Lock "cinder-5a3b1b8f-15d3-4987-8cbc-4e1a1e55fcb3-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:00:48 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-d36e022b-edc5-4dbb-8caa-73e70e8eb4e8 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Acquiring lock "cinder-quobyte-5a3b1b8f-15d3-4987-8cbc-4e1a1e55fcb3" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:00:48 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-d36e022b-edc5-4dbb-8caa-73e70e8eb4e8 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Lock "cinder-quobyte-5a3b1b8f-15d3-4987-8cbc-4e1a1e55fcb3" acquired by "delete_volume" :: waited 0.037s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:00:49 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f53cdc-519b-44d0-abc6-b83d750f4e8f]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:00:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-d36e022b-edc5-4dbb-8caa-73e70e8eb4e8 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5a3b1b8f-15d3-4987-8cbc-4e1a1e55fcb3 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:00:49 devstack sudo[123867]: pam_unix(sudo:session): session closed for user root Sep 08 07:00:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89526562-60d4-4a7a-9bce-3a137151469e_w0pc67bndevstack@QuobyteHD" returned: 1 in 1.214s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:00:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89526562-60d4-4a7a-9bce-3a137151469e_w0pc67bndevstack@QuobyteHD' failed. Not Retrying. {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 07:00:49 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] 89526562-60d4-4a7a-9bce-3a137151469e was raw, converting to qcow2 {{(pid=87507) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 08 07:00:49 devstack sudo[123896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5a3b1b8f-15d3-4987-8cbc-4e1a1e55fcb3 Sep 08 07:00:49 devstack sudo[123896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:00:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_89526562-60d4-4a7a-9bce-3a137151469e_w0pc67bndevstack@QuobyteHD /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-15dee744-78df-4fdc-8d0b-09fe1311f9e8 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:00:49 devstack sudo[123911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_89526562-60d4-4a7a-9bce-3a137151469e_w0pc67bndevstack@QuobyteHD /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-15dee744-78df-4fdc-8d0b-09fe1311f9e8 Sep 08 07:00:49 devstack sudo[123911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:00:50 devstack sudo[123896]: pam_unix(sudo:session): session closed for user root Sep 08 07:00:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-d36e022b-edc5-4dbb-8caa-73e70e8eb4e8 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5a3b1b8f-15d3-4987-8cbc-4e1a1e55fcb3" returned: 0 in 0.999s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:00:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-d36e022b-edc5-4dbb-8caa-73e70e8eb4e8 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5a3b1b8f-15d3-4987-8cbc-4e1a1e55fcb3 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:00:50 devstack sudo[123935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5a3b1b8f-15d3-4987-8cbc-4e1a1e55fcb3 Sep 08 07:00:50 devstack sudo[123935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:00:50 devstack sudo[123935]: pam_unix(sudo:session): session closed for user root Sep 08 07:00:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-d36e022b-edc5-4dbb-8caa-73e70e8eb4e8 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5a3b1b8f-15d3-4987-8cbc-4e1a1e55fcb3" returned: 0 in 0.667s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:00:50 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-d36e022b-edc5-4dbb-8caa-73e70e8eb4e8 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Lock "cinder-quobyte-5a3b1b8f-15d3-4987-8cbc-4e1a1e55fcb3" released by "delete_volume" :: held 1.811s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:00:50 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-d36e022b-edc5-4dbb-8caa-73e70e8eb4e8 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Created reservations ['c2b9883a-23a0-43f4-90e6-ac7d7ea71947', '16ac2744-8d5a-4cc7-9697-58f3f7c313c9', '662df73b-d0be-434a-8fd3-b69612a81f34', '18619e29-f360-455c-9445-0aa2b0cc687d'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:00:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-d36e022b-edc5-4dbb-8caa-73e70e8eb4e8 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:00:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-d36e022b-edc5-4dbb-8caa-73e70e8eb4e8 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:00:51 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-d36e022b-edc5-4dbb-8caa-73e70e8eb4e8 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:00:51 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-d36e022b-edc5-4dbb-8caa-73e70e8eb4e8 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:00:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-d36e022b-edc5-4dbb-8caa-73e70e8eb4e8 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:00:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-d36e022b-edc5-4dbb-8caa-73e70e8eb4e8 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:00:51 devstack sudo[123911]: pam_unix(sudo:session): session closed for user root Sep 08 07:00:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_89526562-60d4-4a7a-9bce-3a137151469e_w0pc67bndevstack@QuobyteHD /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-15dee744-78df-4fdc-8d0b-09fe1311f9e8" returned: 0 in 1.748s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:00:51 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_89526562-60d4-4a7a-9bce-3a137151469e_w0pc67bndevstack@QuobyteHD, size 0.00 MB, duration 1.75 sec, destination /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-15dee744-78df-4fdc-8d0b-09fe1311f9e8 {{(pid=87507) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 07:00:51 devstack cinder-volume[87507]: INFO cinder.image.image_utils [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Converted 0.00 MB image at 0.00 MB/s Sep 08 07:00:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-15dee744-78df-4fdc-8d0b-09fe1311f9e8 1G {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:00:51 devstack sudo[123973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 07:00:51 devstack sudo[123973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:00:51 devstack sudo[123977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-15dee744-78df-4fdc-8d0b-09fe1311f9e8 1G Sep 08 07:00:51 devstack sudo[123977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:00:51 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-8c5f5b2c-d8af-418f-85f5-9ce613575599 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Acquiring lock "cinder-8225e67a-6f8b-464e-b2ee-0680b844a5be-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:00:51 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-8c5f5b2c-d8af-418f-85f5-9ce613575599 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Lock "cinder-8225e67a-6f8b-464e-b2ee-0680b844a5be-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:00:51 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-8c5f5b2c-d8af-418f-85f5-9ce613575599 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Acquiring lock "cinder-quobyte-8225e67a-6f8b-464e-b2ee-0680b844a5be" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:00:51 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-8c5f5b2c-d8af-418f-85f5-9ce613575599 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Lock "cinder-quobyte-8225e67a-6f8b-464e-b2ee-0680b844a5be" acquired by "delete_volume" :: waited 0.075s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:00:51 devstack sudo[123973]: pam_unix(sudo:session): session closed for user root Sep 08 07:00:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-d36e022b-edc5-4dbb-8caa-73e70e8eb4e8 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.744s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:00:51 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-d36e022b-edc5-4dbb-8caa-73e70e8eb4e8 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:00:51 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-d36e022b-edc5-4dbb-8caa-73e70e8eb4e8 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Deleted volume successfully. Sep 08 07:00:51 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[76bd09ba-c4df-4765-b53a-e63994862d35]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:00:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8c5f5b2c-d8af-418f-85f5-9ce613575599 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8225e67a-6f8b-464e-b2ee-0680b844a5be {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:00:52 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-d36e022b-edc5-4dbb-8caa-73e70e8eb4e8 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Lock "cinder-5a3b1b8f-15d3-4987-8cbc-4e1a1e55fcb3-delete_volume" released by "delete_volume" :: held 3.147s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:00:52 devstack sudo[123977]: pam_unix(sudo:session): session closed for user root Sep 08 07:00:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-15dee744-78df-4fdc-8d0b-09fe1311f9e8 1G" returned: 0 in 1.098s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:00:52 devstack cinder-volume[87507]: DEBUG cinder.volume.volume_utils [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Downloaded image 89526562-60d4-4a7a-9bce-3a137151469e ((None, [{'url': 'file:///opt/stack/data/glance/images/89526562-60d4-4a7a-9bce-3a137151469e', 'metadata': {}}])) to volume 15dee744-78df-4fdc-8d0b-09fe1311f9e8 successfully. {{(pid=87507) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 08 07:00:52 devstack sudo[124003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8225e67a-6f8b-464e-b2ee-0680b844a5be Sep 08 07:00:52 devstack sudo[124003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:00:52 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Temporary image 89526562-60d4-4a7a-9bce-3a137151469e for user be99c6f1d0554ce68b6684661ebdf139 is deleted. {{(pid=87507) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 08 07:00:52 devstack cinder-volume[87507]: DEBUG cinder.volume.volume_utils [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Marking volume 15dee744-78df-4fdc-8d0b-09fe1311f9e8 as bootable. {{(pid=87507) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 08 07:00:52 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Copying metadata from image 89526562-60d4-4a7a-9bce-3a137151469e to 15dee744-78df-4fdc-8d0b-09fe1311f9e8. {{(pid=87507) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 08 07:00:52 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Creating volume glance metadata for volume 15dee744-78df-4fdc-8d0b-09fe1311f9e8 backed by image 89526562-60d4-4a7a-9bce-3a137151469e with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '89526562-60d4-4a7a-9bce-3a137151469e', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '6c5d88363ba04d53f968af48861b115d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87507) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 08 07:00:52 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (167c3f7d-708e-445a-9444-1c6ce673df7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15dee744-78df-4fdc-8d0b-09fe1311f9e8', 'volume_size': 1, 'image_id': '89526562-60d4-4a7a-9bce-3a137151469e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/89526562-60d4-4a7a-9bce-3a137151469e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6c5d88363ba04d53f968af48861b115d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '55cd9d5e98c64ce190305628a27703d7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9c918efa22d3b1fb8b6360db5ee6c896e441c0b2d826595842e2d9f2090264e193f57a32470f518729e39efef8afdfb9be235aac8a1f93365acce1b528e23f63', 'id': '89526562-60d4-4a7a-9bce-3a137151469e', 'created_at': datetime.datetime(2026, 9, 8, 5, 0, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 5, 0, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/89526562-60d4-4a7a-9bce-3a137151469e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:00:52 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b76fcbc-d132-466d-b43f-8c5d5b025d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:00:52 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Volume volume-15dee744-78df-4fdc-8d0b-09fe1311f9e8 (15dee744-78df-4fdc-8d0b-09fe1311f9e8): created successfully Sep 08 07:00:52 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b76fcbc-d132-466d-b43f-8c5d5b025d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:00:52 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Flow 'volume_create_manager' (11bd3f34-73dc-4dd9-96b7-cd7a5c9b159e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:00:52 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-5a3d4856-ce0a-4c8b-86e5-bb91e7981b74 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Created volume successfully. Sep 08 07:00:52 devstack sudo[124003]: pam_unix(sudo:session): session closed for user root Sep 08 07:00:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8c5f5b2c-d8af-418f-85f5-9ce613575599 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8225e67a-6f8b-464e-b2ee-0680b844a5be" returned: 0 in 1.075s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:00:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8c5f5b2c-d8af-418f-85f5-9ce613575599 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8225e67a-6f8b-464e-b2ee-0680b844a5be {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:00:53 devstack sudo[124044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8225e67a-6f8b-464e-b2ee-0680b844a5be Sep 08 07:00:53 devstack sudo[124044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:00:53 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-911f20aa-d676-4e54-8ec7-eb43c5276092 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Acquiring lock "cinder-15dee744-78df-4fdc-8d0b-09fe1311f9e8-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:00:53 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-911f20aa-d676-4e54-8ec7-eb43c5276092 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Lock "cinder-15dee744-78df-4fdc-8d0b-09fe1311f9e8-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:00:53 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-911f20aa-d676-4e54-8ec7-eb43c5276092 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Acquiring lock "cinder-quobyte-15dee744-78df-4fdc-8d0b-09fe1311f9e8" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:00:53 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-911f20aa-d676-4e54-8ec7-eb43c5276092 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Lock "cinder-quobyte-15dee744-78df-4fdc-8d0b-09fe1311f9e8" acquired by "delete_volume" :: waited 0.040s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:00:53 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33f5ec8-1d62-4d6a-a0ef-8ecbe1e634a0]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:00:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-911f20aa-d676-4e54-8ec7-eb43c5276092 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-15dee744-78df-4fdc-8d0b-09fe1311f9e8 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:00:53 devstack sudo[124060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-15dee744-78df-4fdc-8d0b-09fe1311f9e8 Sep 08 07:00:53 devstack sudo[124060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:00:53 devstack sudo[124044]: pam_unix(sudo:session): session closed for user root Sep 08 07:00:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8c5f5b2c-d8af-418f-85f5-9ce613575599 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-8225e67a-6f8b-464e-b2ee-0680b844a5be" returned: 0 in 0.871s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:00:53 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-8c5f5b2c-d8af-418f-85f5-9ce613575599 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Lock "cinder-quobyte-8225e67a-6f8b-464e-b2ee-0680b844a5be" released by "delete_volume" :: held 2.104s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:00:54 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-8c5f5b2c-d8af-418f-85f5-9ce613575599 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Created reservations ['6b9009e5-4d22-4971-94fd-7a616466b784', '8ce83cd6-9a0b-46fb-9a4f-2d8c0449abac', '423080ff-91f6-414b-87a2-79b50a6afc42', 'baca29fb-9d7a-41d9-87bc-189fe78cf60f'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:00:54 devstack sudo[123829]: pam_unix(sudo:session): session closed for user root Sep 08 07:00:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5fe448d2-5195-4e06-a23e-fcec7efb1086 tempest-VolumeDependencyTests-192281610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9101be79-7548-40b1-8ea8-99c9a687fb3d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a9bf7735-1211-4024-a4d3-ca3f5491cf3c" returned: 0 in 6.561s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:00:54 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-5fe448d2-5195-4e06-a23e-fcec7efb1086 tempest-VolumeDependencyTests-192281610 None] Image conversion details: src /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9101be79-7548-40b1-8ea8-99c9a687fb3d, size 1024.00 MB, duration 6.56 sec, destination /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a9bf7735-1211-4024-a4d3-ca3f5491cf3c {{(pid=87507) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 07:00:54 devstack cinder-volume[87507]: INFO cinder.image.image_utils [None req-5fe448d2-5195-4e06-a23e-fcec7efb1086 tempest-VolumeDependencyTests-192281610 None] Converted 1024.00 MB image at 156.06 MB/s Sep 08 07:00:54 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-5fe448d2-5195-4e06-a23e-fcec7efb1086 tempest-VolumeDependencyTests-192281610 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a9bf7735-1211-4024-a4d3-ca3f5491cf3c is being set with open permissions: ugo+rw Sep 08 07:00:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5fe448d2-5195-4e06-a23e-fcec7efb1086 tempest-VolumeDependencyTests-192281610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a9bf7735-1211-4024-a4d3-ca3f5491cf3c {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:00:54 devstack sudo[124082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a9bf7735-1211-4024-a4d3-ca3f5491cf3c Sep 08 07:00:54 devstack sudo[124082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:00:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8c5f5b2c-d8af-418f-85f5-9ce613575599 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:00:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8c5f5b2c-d8af-418f-85f5-9ce613575599 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:00:54 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8c5f5b2c-d8af-418f-85f5-9ce613575599 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:00:54 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8c5f5b2c-d8af-418f-85f5-9ce613575599 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:00:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8c5f5b2c-d8af-418f-85f5-9ce613575599 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:00:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8c5f5b2c-d8af-418f-85f5-9ce613575599 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:00:54 devstack sudo[124090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 07:00:54 devstack sudo[124090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:00:54 devstack sudo[124060]: pam_unix(sudo:session): session closed for user root Sep 08 07:00:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-911f20aa-d676-4e54-8ec7-eb43c5276092 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-15dee744-78df-4fdc-8d0b-09fe1311f9e8" returned: 0 in 0.821s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:00:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-911f20aa-d676-4e54-8ec7-eb43c5276092 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-15dee744-78df-4fdc-8d0b-09fe1311f9e8 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:00:54 devstack sudo[124095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-15dee744-78df-4fdc-8d0b-09fe1311f9e8 Sep 08 07:00:54 devstack sudo[124095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:00:54 devstack sudo[124082]: pam_unix(sudo:session): session closed for user root Sep 08 07:00:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5fe448d2-5195-4e06-a23e-fcec7efb1086 tempest-VolumeDependencyTests-192281610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a9bf7735-1211-4024-a4d3-ca3f5491cf3c" returned: 0 in 0.416s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:00:54 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-5fe448d2-5195-4e06-a23e-fcec7efb1086 tempest-VolumeDependencyTests-192281610 None] Lock "cinder-quobyte-a9bf7735-1211-4024-a4d3-ca3f5491cf3c" released by "_copy_volume_from_snapshot" :: held 8.053s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:00:54 devstack sudo[124090]: pam_unix(sudo:session): session closed for user root Sep 08 07:00:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8c5f5b2c-d8af-418f-85f5-9ce613575599 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.433s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:00:54 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-8c5f5b2c-d8af-418f-85f5-9ce613575599 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:00:54 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-5fe448d2-5195-4e06-a23e-fcec7efb1086 tempest-VolumeDependencyTests-192281610 None] Lock "cinder-quobyte-ed0fa0a3-0be0-41ab-938f-2dcb80a3bfa8-a9bf7735-1211-4024-a4d3-ca3f5491cf3c" released by "_create_volume_from_snapshot" :: held 8.171s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:00:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-5fe448d2-5195-4e06-a23e-fcec7efb1086 tempest-VolumeDependencyTests-192281610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.205s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:00:54 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-8c5f5b2c-d8af-418f-85f5-9ce613575599 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Deleted volume successfully. Sep 08 07:00:54 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5fe448d2-5195-4e06-a23e-fcec7efb1086 tempest-VolumeDependencyTests-192281610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a8785f8-8274-4a8f-8878-ff98524a9673) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9bf7735-1211-4024-a4d3-ca3f5491cf3c', 'volume_size': 1, 'snapshot_id': 'ed0fa0a3-0be0-41ab-938f-2dcb80a3bfa8'}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:00:54 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5fe448d2-5195-4e06-a23e-fcec7efb1086 tempest-VolumeDependencyTests-192281610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3720823-38db-4f6f-9297-086ddc826eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:00:54 devstack sudo[124095]: pam_unix(sudo:session): session closed for user root Sep 08 07:00:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-911f20aa-d676-4e54-8ec7-eb43c5276092 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-15dee744-78df-4fdc-8d0b-09fe1311f9e8" returned: 0 in 0.437s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:00:54 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-8c5f5b2c-d8af-418f-85f5-9ce613575599 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Lock "cinder-8225e67a-6f8b-464e-b2ee-0680b844a5be-delete_volume" released by "delete_volume" :: held 3.199s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:00:54 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-5fe448d2-5195-4e06-a23e-fcec7efb1086 tempest-VolumeDependencyTests-192281610 None] Volume volume-a9bf7735-1211-4024-a4d3-ca3f5491cf3c (a9bf7735-1211-4024-a4d3-ca3f5491cf3c): created successfully Sep 08 07:00:54 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5fe448d2-5195-4e06-a23e-fcec7efb1086 tempest-VolumeDependencyTests-192281610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3720823-38db-4f6f-9297-086ddc826eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:00:54 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5fe448d2-5195-4e06-a23e-fcec7efb1086 tempest-VolumeDependencyTests-192281610 None] Flow 'volume_create_manager' (234f5018-2637-4860-9b7c-b50d082b1a9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:00:54 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-911f20aa-d676-4e54-8ec7-eb43c5276092 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Lock "cinder-quobyte-15dee744-78df-4fdc-8d0b-09fe1311f9e8" released by "delete_volume" :: held 1.368s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:00:54 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-5fe448d2-5195-4e06-a23e-fcec7efb1086 tempest-VolumeDependencyTests-192281610 None] Created volume successfully. Sep 08 07:00:54 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-911f20aa-d676-4e54-8ec7-eb43c5276092 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Created reservations ['46443771-ab10-456d-a173-96bc5b536ec1', 'f26e16fa-b49c-4195-b7e7-3076ae4ebf6c', '9ee157b7-9206-47b1-9387-16ca9b88ed57', '5abd859f-360f-42c3-b5fb-d51a85eabec4'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:00:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-911f20aa-d676-4e54-8ec7-eb43c5276092 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:00:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-911f20aa-d676-4e54-8ec7-eb43c5276092 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:00:54 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-911f20aa-d676-4e54-8ec7-eb43c5276092 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:00:54 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-911f20aa-d676-4e54-8ec7-eb43c5276092 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:00:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-911f20aa-d676-4e54-8ec7-eb43c5276092 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:00:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-911f20aa-d676-4e54-8ec7-eb43c5276092 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:00:54 devstack sudo[124118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 07:00:54 devstack sudo[124118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:00:55 devstack sudo[124118]: pam_unix(sudo:session): session closed for user root Sep 08 07:00:55 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-6ae6be7d-4217-45a5-8a65-42297025e333 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Acquiring lock "cinder-edc43663-0947-4b11-b4a8-fb33f19b5934-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:00:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-911f20aa-d676-4e54-8ec7-eb43c5276092 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.346s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:00:55 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-911f20aa-d676-4e54-8ec7-eb43c5276092 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:00:55 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-6ae6be7d-4217-45a5-8a65-42297025e333 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Lock "cinder-edc43663-0947-4b11-b4a8-fb33f19b5934-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:00:55 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-911f20aa-d676-4e54-8ec7-eb43c5276092 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Deleted volume successfully. Sep 08 07:00:55 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-911f20aa-d676-4e54-8ec7-eb43c5276092 tempest-VolumeAndVolumeTypeFromImageTest-1155910917 None] Lock "cinder-15dee744-78df-4fdc-8d0b-09fe1311f9e8-delete_volume" released by "delete_volume" :: held 2.093s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:00:55 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-6ae6be7d-4217-45a5-8a65-42297025e333 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Acquiring lock "cinder-quobyte-edc43663-0947-4b11-b4a8-fb33f19b5934" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:00:55 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-6ae6be7d-4217-45a5-8a65-42297025e333 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Lock "cinder-quobyte-edc43663-0947-4b11-b4a8-fb33f19b5934" acquired by "delete_volume" :: waited 0.024s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:00:55 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64d536a-a805-4601-95b9-96ad957529db]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:00:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6ae6be7d-4217-45a5-8a65-42297025e333 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-edc43663-0947-4b11-b4a8-fb33f19b5934 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:00:55 devstack sudo[124137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-edc43663-0947-4b11-b4a8-fb33f19b5934 Sep 08 07:00:55 devstack sudo[124137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:00:55 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-1b96bfb3-c1ce-44e3-83dc-fe58422614a2 tempest-VolumeDependencyTests-192281610 None] Acquiring lock "cinder-ed0fa0a3-0be0-41ab-938f-2dcb80a3bfa8-delete_snapshot" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:00:55 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-1b96bfb3-c1ce-44e3-83dc-fe58422614a2 tempest-VolumeDependencyTests-192281610 None] Lock "cinder-ed0fa0a3-0be0-41ab-938f-2dcb80a3bfa8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:00:55 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-1b96bfb3-c1ce-44e3-83dc-fe58422614a2 tempest-VolumeDependencyTests-192281610 None] Acquiring lock "cinder-quobyte-9101be79-7548-40b1-8ea8-99c9a687fb3d" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:00:55 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-1b96bfb3-c1ce-44e3-83dc-fe58422614a2 tempest-VolumeDependencyTests-192281610 None] Lock "cinder-quobyte-9101be79-7548-40b1-8ea8-99c9a687fb3d" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:00:55 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-1b96bfb3-c1ce-44e3-83dc-fe58422614a2 tempest-VolumeDependencyTests-192281610 None] Acquiring lock "cinder-quobyte-ed0fa0a3-0be0-41ab-938f-2dcb80a3bfa8" by "_delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:00:55 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-1b96bfb3-c1ce-44e3-83dc-fe58422614a2 tempest-VolumeDependencyTests-192281610 None] Lock "cinder-quobyte-ed0fa0a3-0be0-41ab-938f-2dcb80a3bfa8" acquired by "_delete_snapshot" :: waited 0.054s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:00:55 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-1b96bfb3-c1ce-44e3-83dc-fe58422614a2 tempest-VolumeDependencyTests-192281610 None] Deleting offline snapshot ed0fa0a3-0be0-41ab-938f-2dcb80a3bfa8 of volume 9101be79-7548-40b1-8ea8-99c9a687fb3d {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 07:00:55 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-1b96bfb3-c1ce-44e3-83dc-fe58422614a2 tempest-VolumeDependencyTests-192281610 None] snapshot_file for this snap is: volume-9101be79-7548-40b1-8ea8-99c9a687fb3d.ed0fa0a3-0be0-41ab-938f-2dcb80a3bfa8 {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 07:00:55 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ccdf364-4a00-4d0f-b6b8-ea2c2e3b070d]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:00:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1b96bfb3-c1ce-44e3-83dc-fe58422614a2 tempest-VolumeDependencyTests-192281610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9101be79-7548-40b1-8ea8-99c9a687fb3d.ed0fa0a3-0be0-41ab-938f-2dcb80a3bfa8 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:00:55 devstack sudo[124137]: pam_unix(sudo:session): session closed for user root Sep 08 07:00:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6ae6be7d-4217-45a5-8a65-42297025e333 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-edc43663-0947-4b11-b4a8-fb33f19b5934" returned: 0 in 0.479s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:00:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6ae6be7d-4217-45a5-8a65-42297025e333 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-edc43663-0947-4b11-b4a8-fb33f19b5934 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:00:55 devstack sudo[124159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-edc43663-0947-4b11-b4a8-fb33f19b5934 Sep 08 07:00:55 devstack sudo[124159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:00:56 devstack sudo[124153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9101be79-7548-40b1-8ea8-99c9a687fb3d.ed0fa0a3-0be0-41ab-938f-2dcb80a3bfa8 Sep 08 07:00:56 devstack sudo[124153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:00:56 devstack sudo[124159]: pam_unix(sudo:session): session closed for user root Sep 08 07:00:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6ae6be7d-4217-45a5-8a65-42297025e333 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-edc43663-0947-4b11-b4a8-fb33f19b5934" returned: 0 in 0.296s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:00:56 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-6ae6be7d-4217-45a5-8a65-42297025e333 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Lock "cinder-quobyte-edc43663-0947-4b11-b4a8-fb33f19b5934" released by "delete_volume" :: held 0.855s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:00:56 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-6ae6be7d-4217-45a5-8a65-42297025e333 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Created reservations ['86b89cc7-a9b3-458e-bdbd-909be7a6f495', '1d3b6125-f877-47bb-9c4b-4a199fab9ce3', '86134224-ecc3-4085-854f-9c8283f45c1b', 'c643a395-19cf-4773-94d7-7439a95a10a7'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:00:56 devstack sudo[124153]: pam_unix(sudo:session): session closed for user root Sep 08 07:00:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1b96bfb3-c1ce-44e3-83dc-fe58422614a2 tempest-VolumeDependencyTests-192281610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9101be79-7548-40b1-8ea8-99c9a687fb3d.ed0fa0a3-0be0-41ab-938f-2dcb80a3bfa8" returned: 0 in 0.589s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:00:56 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-1b96bfb3-c1ce-44e3-83dc-fe58422614a2 tempest-VolumeDependencyTests-192281610 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9101be79-7548-40b1-8ea8-99c9a687fb3d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:00:56 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[52cda00b-d0a0-4e6c-9bcc-9fc2fd00cae9]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:00:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1b96bfb3-c1ce-44e3-83dc-fe58422614a2 tempest-VolumeDependencyTests-192281610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9101be79-7548-40b1-8ea8-99c9a687fb3d {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:00:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-6ae6be7d-4217-45a5-8a65-42297025e333 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:00:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-6ae6be7d-4217-45a5-8a65-42297025e333 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:00:56 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-6ae6be7d-4217-45a5-8a65-42297025e333 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:00:56 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-6ae6be7d-4217-45a5-8a65-42297025e333 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:00:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-6ae6be7d-4217-45a5-8a65-42297025e333 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:00:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6ae6be7d-4217-45a5-8a65-42297025e333 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:00:56 devstack sudo[124186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 07:00:56 devstack sudo[124186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:00:56 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-de263657-bc76-4808-9111-7cac4e86359b tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Acquiring lock "cinder-20dac492-1385-44b0-8489-7535f9021e1d-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:00:56 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-de263657-bc76-4808-9111-7cac4e86359b tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Lock "cinder-20dac492-1385-44b0-8489-7535f9021e1d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:00:56 devstack sudo[124182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9101be79-7548-40b1-8ea8-99c9a687fb3d Sep 08 07:00:56 devstack sudo[124182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:00:56 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-de263657-bc76-4808-9111-7cac4e86359b tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Acquiring lock "cinder-quobyte-20dac492-1385-44b0-8489-7535f9021e1d" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:00:56 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-de263657-bc76-4808-9111-7cac4e86359b tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Lock "cinder-quobyte-20dac492-1385-44b0-8489-7535f9021e1d" acquired by "delete_volume" :: waited 0.024s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:00:56 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa671b2-11ba-4cfe-a38c-bbc6067b5c35]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:00:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-de263657-bc76-4808-9111-7cac4e86359b tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-20dac492-1385-44b0-8489-7535f9021e1d {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:00:56 devstack sudo[124195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-20dac492-1385-44b0-8489-7535f9021e1d Sep 08 07:00:56 devstack sudo[124195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:00:57 devstack sudo[124186]: pam_unix(sudo:session): session closed for user root Sep 08 07:00:57 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6ae6be7d-4217-45a5-8a65-42297025e333 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.500s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:00:57 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-6ae6be7d-4217-45a5-8a65-42297025e333 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:00:57 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-6ae6be7d-4217-45a5-8a65-42297025e333 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Deleted volume successfully. Sep 08 07:00:57 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-6ae6be7d-4217-45a5-8a65-42297025e333 tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Lock "cinder-edc43663-0947-4b11-b4a8-fb33f19b5934-delete_volume" released by "delete_volume" :: held 1.803s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:00:57 devstack sudo[124182]: pam_unix(sudo:session): session closed for user root Sep 08 07:00:57 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1b96bfb3-c1ce-44e3-83dc-fe58422614a2 tempest-VolumeDependencyTests-192281610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9101be79-7548-40b1-8ea8-99c9a687fb3d" returned: 0 in 0.810s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:00:57 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1b96bfb3-c1ce-44e3-83dc-fe58422614a2 tempest-VolumeDependencyTests-192281610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9101be79-7548-40b1-8ea8-99c9a687fb3d.ed0fa0a3-0be0-41ab-938f-2dcb80a3bfa8 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:00:57 devstack sudo[124195]: pam_unix(sudo:session): session closed for user root Sep 08 07:00:57 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-de263657-bc76-4808-9111-7cac4e86359b tempest-CreateVolumesFromSourceVolumeTest-178388027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-20dac492-1385-44b0-8489-7535f9021e1d" returned: 0 in 0.508s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:00:57 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-de263657-bc76-4808-9111-7cac4e86359b tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-20dac492-1385-44b0-8489-7535f9021e1d {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:00:57 devstack sudo[124219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9101be79-7548-40b1-8ea8-99c9a687fb3d.ed0fa0a3-0be0-41ab-938f-2dcb80a3bfa8 Sep 08 07:00:57 devstack sudo[124219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:00:57 devstack sudo[124220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-20dac492-1385-44b0-8489-7535f9021e1d Sep 08 07:00:57 devstack sudo[124220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:00:57 devstack sudo[124220]: pam_unix(sudo:session): session closed for user root Sep 08 07:00:57 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-de263657-bc76-4808-9111-7cac4e86359b tempest-CreateVolumesFromSourceVolumeTest-178388027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-20dac492-1385-44b0-8489-7535f9021e1d" returned: 0 in 0.321s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:00:57 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-de263657-bc76-4808-9111-7cac4e86359b tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Lock "cinder-quobyte-20dac492-1385-44b0-8489-7535f9021e1d" released by "delete_volume" :: held 0.913s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:00:57 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-de263657-bc76-4808-9111-7cac4e86359b tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Created reservations ['a4320944-0d36-43cd-a35a-5f891b3d606e', '46d84545-0937-483f-a9c5-3b821acd22cf', '5e11a63a-ee2e-41dd-9c70-6250e0e34454', '191cffe4-f17b-4655-abfa-3a507c137df9'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:00:57 devstack sudo[124219]: pam_unix(sudo:session): session closed for user root Sep 08 07:00:57 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1b96bfb3-c1ce-44e3-83dc-fe58422614a2 tempest-VolumeDependencyTests-192281610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9101be79-7548-40b1-8ea8-99c9a687fb3d.ed0fa0a3-0be0-41ab-938f-2dcb80a3bfa8" returned: 0 in 0.546s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:00:57 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1b96bfb3-c1ce-44e3-83dc-fe58422614a2 tempest-VolumeDependencyTests-192281610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9101be79-7548-40b1-8ea8-99c9a687fb3d.ed0fa0a3-0be0-41ab-938f-2dcb80a3bfa8 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:00:57 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-de263657-bc76-4808-9111-7cac4e86359b tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:00:57 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-de263657-bc76-4808-9111-7cac4e86359b tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:00:57 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-de263657-bc76-4808-9111-7cac4e86359b tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:00:57 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-de263657-bc76-4808-9111-7cac4e86359b tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:00:57 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-de263657-bc76-4808-9111-7cac4e86359b tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:00:57 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-de263657-bc76-4808-9111-7cac4e86359b tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:00:57 devstack sudo[124245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9101be79-7548-40b1-8ea8-99c9a687fb3d.ed0fa0a3-0be0-41ab-938f-2dcb80a3bfa8 Sep 08 07:00:57 devstack sudo[124245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:00:57 devstack sudo[124248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 07:00:57 devstack sudo[124248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:00:58 devstack sudo[124245]: pam_unix(sudo:session): session closed for user root Sep 08 07:00:58 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1b96bfb3-c1ce-44e3-83dc-fe58422614a2 tempest-VolumeDependencyTests-192281610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9101be79-7548-40b1-8ea8-99c9a687fb3d.ed0fa0a3-0be0-41ab-938f-2dcb80a3bfa8" returned: 0 in 0.349s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:00:58 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-1b96bfb3-c1ce-44e3-83dc-fe58422614a2 tempest-VolumeDependencyTests-192281610 None] Lock "cinder-quobyte-ed0fa0a3-0be0-41ab-938f-2dcb80a3bfa8" released by "_delete_snapshot" :: held 2.463s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:00:58 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-1b96bfb3-c1ce-44e3-83dc-fe58422614a2 tempest-VolumeDependencyTests-192281610 None] Lock "cinder-quobyte-9101be79-7548-40b1-8ea8-99c9a687fb3d" released by "delete_snapshot" :: held 2.536s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:00:58 devstack sudo[124248]: pam_unix(sudo:session): session closed for user root Sep 08 07:00:58 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-de263657-bc76-4808-9111-7cac4e86359b tempest-CreateVolumesFromSourceVolumeTest-178388027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.407s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:00:58 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-de263657-bc76-4808-9111-7cac4e86359b tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:00:58 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-de263657-bc76-4808-9111-7cac4e86359b tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Deleted volume successfully. Sep 08 07:00:58 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-de263657-bc76-4808-9111-7cac4e86359b tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Lock "cinder-20dac492-1385-44b0-8489-7535f9021e1d-delete_volume" released by "delete_volume" :: held 1.718s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:00:58 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-1b96bfb3-c1ce-44e3-83dc-fe58422614a2 tempest-VolumeDependencyTests-192281610 None] Created reservations ['73ff0686-6712-49ea-ad15-51ba361ff4de', '98df4c77-8261-43fc-963c-17d767a57b7e', '0952dcd6-60ae-4bc6-b5bc-8bfd03f425e0', '1ab8fb18-75c0-4a7b-8044-40898f0f2314'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:00:58 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-1b96bfb3-c1ce-44e3-83dc-fe58422614a2 tempest-VolumeDependencyTests-192281610 None] Delete snapshot completed successfully. Sep 08 07:00:58 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-1b96bfb3-c1ce-44e3-83dc-fe58422614a2 tempest-VolumeDependencyTests-192281610 None] Lock "cinder-ed0fa0a3-0be0-41ab-938f-2dcb80a3bfa8-delete_snapshot" released by "delete_snapshot" :: held 2.789s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:00:58 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-9a7e3c4e-7842-436f-996f-386da672122d tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Acquiring lock "cinder-b9c040d9-3a29-42b2-a174-2066511a5906-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:00:58 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-9a7e3c4e-7842-436f-996f-386da672122d tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Lock "cinder-b9c040d9-3a29-42b2-a174-2066511a5906-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:00:58 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-521c2a7e-999c-49a0-be88-ed7aa9cea4fc tempest-VolumeDependencyTests-192281610 None] Acquiring lock "cinder-9101be79-7548-40b1-8ea8-99c9a687fb3d-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:00:59 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-521c2a7e-999c-49a0-be88-ed7aa9cea4fc tempest-VolumeDependencyTests-192281610 None] Lock "cinder-9101be79-7548-40b1-8ea8-99c9a687fb3d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:00:59 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-9a7e3c4e-7842-436f-996f-386da672122d tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Acquiring lock "cinder-quobyte-b9c040d9-3a29-42b2-a174-2066511a5906" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:00:59 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-521c2a7e-999c-49a0-be88-ed7aa9cea4fc tempest-VolumeDependencyTests-192281610 None] Acquiring lock "cinder-quobyte-9101be79-7548-40b1-8ea8-99c9a687fb3d" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:00:59 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-9a7e3c4e-7842-436f-996f-386da672122d tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Lock "cinder-quobyte-b9c040d9-3a29-42b2-a174-2066511a5906" acquired by "delete_volume" :: waited 0.033s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:00:59 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-521c2a7e-999c-49a0-be88-ed7aa9cea4fc tempest-VolumeDependencyTests-192281610 None] Lock "cinder-quobyte-9101be79-7548-40b1-8ea8-99c9a687fb3d" acquired by "delete_volume" :: waited 0.026s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:00:59 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad101fd1-6dcf-4822-884e-5891c2660299]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:00:59 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9a7e3c4e-7842-436f-996f-386da672122d tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b9c040d9-3a29-42b2-a174-2066511a5906 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:00:59 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3c2c4a-f2eb-4518-a9be-e0b156b986ca]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:00:59 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-521c2a7e-999c-49a0-be88-ed7aa9cea4fc tempest-VolumeDependencyTests-192281610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9101be79-7548-40b1-8ea8-99c9a687fb3d {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:00:59 devstack sudo[124294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b9c040d9-3a29-42b2-a174-2066511a5906 Sep 08 07:00:59 devstack sudo[124294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:00:59 devstack sudo[124295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9101be79-7548-40b1-8ea8-99c9a687fb3d Sep 08 07:00:59 devstack sudo[124295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:00:59 devstack sudo[124295]: pam_unix(sudo:session): session closed for user root Sep 08 07:00:59 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-521c2a7e-999c-49a0-be88-ed7aa9cea4fc tempest-VolumeDependencyTests-192281610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9101be79-7548-40b1-8ea8-99c9a687fb3d" returned: 0 in 0.434s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:00:59 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-521c2a7e-999c-49a0-be88-ed7aa9cea4fc tempest-VolumeDependencyTests-192281610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9101be79-7548-40b1-8ea8-99c9a687fb3d {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:00:59 devstack sudo[124313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9101be79-7548-40b1-8ea8-99c9a687fb3d Sep 08 07:00:59 devstack sudo[124313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:00:59 devstack sudo[124294]: pam_unix(sudo:session): session closed for user root Sep 08 07:00:59 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9a7e3c4e-7842-436f-996f-386da672122d tempest-CreateVolumesFromSourceVolumeTest-178388027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b9c040d9-3a29-42b2-a174-2066511a5906" returned: 0 in 0.612s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:00:59 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9a7e3c4e-7842-436f-996f-386da672122d tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b9c040d9-3a29-42b2-a174-2066511a5906 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:00:59 devstack sudo[124324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b9c040d9-3a29-42b2-a174-2066511a5906 Sep 08 07:00:59 devstack sudo[124324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:00:59 devstack sudo[124313]: pam_unix(sudo:session): session closed for user root Sep 08 07:00:59 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-521c2a7e-999c-49a0-be88-ed7aa9cea4fc tempest-VolumeDependencyTests-192281610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9101be79-7548-40b1-8ea8-99c9a687fb3d" returned: 0 in 0.316s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:00:59 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-521c2a7e-999c-49a0-be88-ed7aa9cea4fc tempest-VolumeDependencyTests-192281610 None] Lock "cinder-quobyte-9101be79-7548-40b1-8ea8-99c9a687fb3d" released by "delete_volume" :: held 0.841s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:01:00 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-521c2a7e-999c-49a0-be88-ed7aa9cea4fc tempest-VolumeDependencyTests-192281610 None] Created reservations ['14a917bc-c695-4817-828b-3616745d823c', '32c2fd98-fc9e-4bb1-bc9c-541dd57635b1', '9eab3413-e561-43aa-9f0a-bdb64febe8ec', 'e04d62f6-27c0-434d-8d91-fcf894f20559'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:01:00 devstack sudo[124324]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9a7e3c4e-7842-436f-996f-386da672122d tempest-CreateVolumesFromSourceVolumeTest-178388027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-b9c040d9-3a29-42b2-a174-2066511a5906" returned: 0 in 0.357s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-521c2a7e-999c-49a0-be88-ed7aa9cea4fc tempest-VolumeDependencyTests-192281610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-521c2a7e-999c-49a0-be88-ed7aa9cea4fc tempest-VolumeDependencyTests-192281610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:00 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-521c2a7e-999c-49a0-be88-ed7aa9cea4fc tempest-VolumeDependencyTests-192281610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:01:00 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-521c2a7e-999c-49a0-be88-ed7aa9cea4fc tempest-VolumeDependencyTests-192281610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:01:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-521c2a7e-999c-49a0-be88-ed7aa9cea4fc tempest-VolumeDependencyTests-192281610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-521c2a7e-999c-49a0-be88-ed7aa9cea4fc tempest-VolumeDependencyTests-192281610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:00 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-9a7e3c4e-7842-436f-996f-386da672122d tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Lock "cinder-quobyte-b9c040d9-3a29-42b2-a174-2066511a5906" released by "delete_volume" :: held 1.091s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:01:00 devstack sudo[124339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 07:01:00 devstack sudo[124339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:00 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-9a7e3c4e-7842-436f-996f-386da672122d tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Created reservations ['98c2c0ba-edcf-49bf-b79b-2abe362735f7', '04c98678-e7c6-4acb-9280-f4a87dee0882', '6b54c432-2b62-4998-9f45-0c8e4def4bb6', '14fea313-040e-4746-ba85-b5047026c702'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:01:00 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-05782588-26ec-4436-800b-086b010b3d29 tempest-VolumeDependencyTests-192281610 None] Acquiring lock "cinder-a9bf7735-1211-4024-a4d3-ca3f5491cf3c-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:01:00 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-05782588-26ec-4436-800b-086b010b3d29 tempest-VolumeDependencyTests-192281610 None] Lock "cinder-a9bf7735-1211-4024-a4d3-ca3f5491cf3c-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:01:00 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-05782588-26ec-4436-800b-086b010b3d29 tempest-VolumeDependencyTests-192281610 None] Acquiring lock "cinder-quobyte-a9bf7735-1211-4024-a4d3-ca3f5491cf3c" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:01:00 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-05782588-26ec-4436-800b-086b010b3d29 tempest-VolumeDependencyTests-192281610 None] Lock "cinder-quobyte-a9bf7735-1211-4024-a4d3-ca3f5491cf3c" acquired by "delete_volume" :: waited 0.032s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:01:00 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e6090c-441e-486e-9e4b-180659f942b5]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:01:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-05782588-26ec-4436-800b-086b010b3d29 tempest-VolumeDependencyTests-192281610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a9bf7735-1211-4024-a4d3-ca3f5491cf3c {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-9a7e3c4e-7842-436f-996f-386da672122d tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-9a7e3c4e-7842-436f-996f-386da672122d tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:00 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-9a7e3c4e-7842-436f-996f-386da672122d tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:01:00 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-9a7e3c4e-7842-436f-996f-386da672122d tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:01:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-9a7e3c4e-7842-436f-996f-386da672122d tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9a7e3c4e-7842-436f-996f-386da672122d tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:00 devstack sudo[124353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 07:01:00 devstack sudo[124353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:00 devstack sudo[124339]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-521c2a7e-999c-49a0-be88-ed7aa9cea4fc tempest-VolumeDependencyTests-192281610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.410s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:00 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-521c2a7e-999c-49a0-be88-ed7aa9cea4fc tempest-VolumeDependencyTests-192281610 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:01:00 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-521c2a7e-999c-49a0-be88-ed7aa9cea4fc tempest-VolumeDependencyTests-192281610 None] Deleted volume successfully. Sep 08 07:01:00 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-521c2a7e-999c-49a0-be88-ed7aa9cea4fc tempest-VolumeDependencyTests-192281610 None] Lock "cinder-9101be79-7548-40b1-8ea8-99c9a687fb3d-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:01:00 devstack sudo[124350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a9bf7735-1211-4024-a4d3-ca3f5491cf3c Sep 08 07:01:00 devstack sudo[124350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:00 devstack sudo[124353]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9a7e3c4e-7842-436f-996f-386da672122d tempest-CreateVolumesFromSourceVolumeTest-178388027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.352s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:00 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-9a7e3c4e-7842-436f-996f-386da672122d tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:01:00 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-9a7e3c4e-7842-436f-996f-386da672122d tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Deleted volume successfully. Sep 08 07:01:00 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-9a7e3c4e-7842-436f-996f-386da672122d tempest-CreateVolumesFromSourceVolumeTest-178388027 None] Lock "cinder-b9c040d9-3a29-42b2-a174-2066511a5906-delete_volume" released by "delete_volume" :: held 1.897s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:01:01 devstack sudo[124350]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-05782588-26ec-4436-800b-086b010b3d29 tempest-VolumeDependencyTests-192281610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a9bf7735-1211-4024-a4d3-ca3f5491cf3c" returned: 0 in 0.601s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-05782588-26ec-4436-800b-086b010b3d29 tempest-VolumeDependencyTests-192281610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a9bf7735-1211-4024-a4d3-ca3f5491cf3c {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:01 devstack sudo[124375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a9bf7735-1211-4024-a4d3-ca3f5491cf3c Sep 08 07:01:01 devstack sudo[124375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:01 devstack sudo[124375]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-05782588-26ec-4436-800b-086b010b3d29 tempest-VolumeDependencyTests-192281610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a9bf7735-1211-4024-a4d3-ca3f5491cf3c" returned: 0 in 0.308s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:01 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-05782588-26ec-4436-800b-086b010b3d29 tempest-VolumeDependencyTests-192281610 None] Lock "cinder-quobyte-a9bf7735-1211-4024-a4d3-ca3f5491cf3c" released by "delete_volume" :: held 0.965s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:01:01 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-05782588-26ec-4436-800b-086b010b3d29 tempest-VolumeDependencyTests-192281610 None] Created reservations ['d98c94ec-aaba-4bb3-aa43-1e86d4205ff1', '2adf6e27-5b5e-4939-ab36-41ef841e2378', '5e31fb50-0063-4a89-815c-3fcf88f69683', '2ff8c312-f792-4a38-afe9-492e250b9d5f'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:01:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-05782588-26ec-4436-800b-086b010b3d29 tempest-VolumeDependencyTests-192281610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-05782588-26ec-4436-800b-086b010b3d29 tempest-VolumeDependencyTests-192281610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:01 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-05782588-26ec-4436-800b-086b010b3d29 tempest-VolumeDependencyTests-192281610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:01:01 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-05782588-26ec-4436-800b-086b010b3d29 tempest-VolumeDependencyTests-192281610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:01:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-05782588-26ec-4436-800b-086b010b3d29 tempest-VolumeDependencyTests-192281610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-05782588-26ec-4436-800b-086b010b3d29 tempest-VolumeDependencyTests-192281610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:01 devstack sudo[124393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 07:01:01 devstack sudo[124393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:01 devstack sudo[124393]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-05782588-26ec-4436-800b-086b010b3d29 tempest-VolumeDependencyTests-192281610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.308s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:01 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-05782588-26ec-4436-800b-086b010b3d29 tempest-VolumeDependencyTests-192281610 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:01:01 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-05782588-26ec-4436-800b-086b010b3d29 tempest-VolumeDependencyTests-192281610 None] Deleted volume successfully. Sep 08 07:01:01 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-05782588-26ec-4436-800b-086b010b3d29 tempest-VolumeDependencyTests-192281610 None] Lock "cinder-a9bf7735-1211-4024-a4d3-ca3f5491cf3c-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:01:02 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-54be3125-1eb8-4a59-89ef-a6025cb32dfd tempest-CreateVolumesFromImageTest-753610252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:01:02 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-54be3125-1eb8-4a59-89ef-a6025cb32dfd tempest-CreateVolumesFromImageTest-753610252 None] Flow 'volume_create_manager' (16f50990-1643-4815-b6de-108707e65b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:01:02 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-54be3125-1eb8-4a59-89ef-a6025cb32dfd tempest-CreateVolumesFromImageTest-753610252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ee02216-f3df-45f5-9a32-5d8e03a02238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:02 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-54be3125-1eb8-4a59-89ef-a6025cb32dfd tempest-CreateVolumesFromImageTest-753610252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ee02216-f3df-45f5-9a32-5d8e03a02238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:01:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1732506890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fff8b38c-e17f-4058-9ebb-42644cecc306,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cfc5b7f438943b5a3fe5b54a954c30b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:01:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:01:02Z,use_quota=True,user_id='6e2a36d14e66409cba47098e22236b17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:02 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-54be3125-1eb8-4a59-89ef-a6025cb32dfd tempest-CreateVolumesFromImageTest-753610252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c231242-4722-43e6-8ab6-0c6abd37d202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:02 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-54be3125-1eb8-4a59-89ef-a6025cb32dfd tempest-CreateVolumesFromImageTest-753610252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c231242-4722-43e6-8ab6-0c6abd37d202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:02 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-54be3125-1eb8-4a59-89ef-a6025cb32dfd tempest-CreateVolumesFromImageTest-753610252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8470bbb4-9f48-411b-989d-73feadb6fa6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:02 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-54be3125-1eb8-4a59-89ef-a6025cb32dfd tempest-CreateVolumesFromImageTest-753610252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8470bbb4-9f48-411b-989d-73feadb6fa6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fff8b38c-e17f-4058-9ebb-42644cecc306', 'volume_name': 'volume-fff8b38c-e17f-4058-9ebb-42644cecc306', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:02 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-54be3125-1eb8-4a59-89ef-a6025cb32dfd tempest-CreateVolumesFromImageTest-753610252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4cd4357-f232-4fca-a1b3-d12acc0cd3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:02 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-54be3125-1eb8-4a59-89ef-a6025cb32dfd tempest-CreateVolumesFromImageTest-753610252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4cd4357-f232-4fca-a1b3-d12acc0cd3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:02 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-54be3125-1eb8-4a59-89ef-a6025cb32dfd tempest-CreateVolumesFromImageTest-753610252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41e3976f-c298-4721-a731-fa60f0292aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:02 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-54be3125-1eb8-4a59-89ef-a6025cb32dfd tempest-CreateVolumesFromImageTest-753610252 None] Volume fff8b38c-e17f-4058-9ebb-42644cecc306: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fff8b38c-e17f-4058-9ebb-42644cecc306', 'volume_size': 1} Sep 08 07:01:02 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-54be3125-1eb8-4a59-89ef-a6025cb32dfd tempest-CreateVolumesFromImageTest-753610252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:02 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-54be3125-1eb8-4a59-89ef-a6025cb32dfd tempest-CreateVolumesFromImageTest-753610252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:02 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-54be3125-1eb8-4a59-89ef-a6025cb32dfd tempest-CreateVolumesFromImageTest-753610252 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:01:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1732506890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fff8b38c-e17f-4058-9ebb-42644cecc306,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cfc5b7f438943b5a3fe5b54a954c30b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:01:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:01:02Z,use_quota=True,user_id='6e2a36d14e66409cba47098e22236b17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:01:02 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-54be3125-1eb8-4a59-89ef-a6025cb32dfd tempest-CreateVolumesFromImageTest-753610252 None] Creating volume fff8b38c-e17f-4058-9ebb-42644cecc306 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:01:02 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-54be3125-1eb8-4a59-89ef-a6025cb32dfd tempest-CreateVolumesFromImageTest-753610252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:02 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-54be3125-1eb8-4a59-89ef-a6025cb32dfd tempest-CreateVolumesFromImageTest-753610252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:02 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-54be3125-1eb8-4a59-89ef-a6025cb32dfd tempest-CreateVolumesFromImageTest-753610252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:01:02 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-54be3125-1eb8-4a59-89ef-a6025cb32dfd tempest-CreateVolumesFromImageTest-753610252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:01:02 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-54be3125-1eb8-4a59-89ef-a6025cb32dfd tempest-CreateVolumesFromImageTest-753610252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:02 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-54be3125-1eb8-4a59-89ef-a6025cb32dfd tempest-CreateVolumesFromImageTest-753610252 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:01:02 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-54be3125-1eb8-4a59-89ef-a6025cb32dfd tempest-CreateVolumesFromImageTest-753610252 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 07:01:02 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-54be3125-1eb8-4a59-89ef-a6025cb32dfd tempest-CreateVolumesFromImageTest-753610252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-fff8b38c-e17f-4058-9ebb-42644cecc306 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:02 devstack sudo[124420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-fff8b38c-e17f-4058-9ebb-42644cecc306 1073741824 Sep 08 07:01:02 devstack sudo[124420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:03 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9a73870-f492-4e76-a3d0-e1a47a57b624 tempest-CreateVolumesFromImageTest-753610252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:01:03 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b9a73870-f492-4e76-a3d0-e1a47a57b624 tempest-CreateVolumesFromImageTest-753610252 None] Flow 'volume_create_manager' (f87e986d-d57a-4580-a82b-dbffa82dc032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:01:03 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b9a73870-f492-4e76-a3d0-e1a47a57b624 tempest-CreateVolumesFromImageTest-753610252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (267cedce-97bb-4eac-8f55-a53655d07473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:03 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b9a73870-f492-4e76-a3d0-e1a47a57b624 tempest-CreateVolumesFromImageTest-753610252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (267cedce-97bb-4eac-8f55-a53655d07473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:01:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-768313862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1881e01a-8ed1-49e6-8e25-5396e472a91b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cfc5b7f438943b5a3fe5b54a954c30b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:01:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:01:03Z,use_quota=True,user_id='6e2a36d14e66409cba47098e22236b17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:03 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b9a73870-f492-4e76-a3d0-e1a47a57b624 tempest-CreateVolumesFromImageTest-753610252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea81f5c8-fa05-4e5f-a932-e94f1c880f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:03 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b9a73870-f492-4e76-a3d0-e1a47a57b624 tempest-CreateVolumesFromImageTest-753610252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea81f5c8-fa05-4e5f-a932-e94f1c880f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:03 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b9a73870-f492-4e76-a3d0-e1a47a57b624 tempest-CreateVolumesFromImageTest-753610252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a787b654-3045-4458-a0c7-55c3125faf10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:03 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b9a73870-f492-4e76-a3d0-e1a47a57b624 tempest-CreateVolumesFromImageTest-753610252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a787b654-3045-4458-a0c7-55c3125faf10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1881e01a-8ed1-49e6-8e25-5396e472a91b', 'volume_name': 'volume-1881e01a-8ed1-49e6-8e25-5396e472a91b', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:03 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b9a73870-f492-4e76-a3d0-e1a47a57b624 tempest-CreateVolumesFromImageTest-753610252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e8f238c-11e2-49de-9ee6-f859938c1c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:03 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b9a73870-f492-4e76-a3d0-e1a47a57b624 tempest-CreateVolumesFromImageTest-753610252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e8f238c-11e2-49de-9ee6-f859938c1c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:03 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b9a73870-f492-4e76-a3d0-e1a47a57b624 tempest-CreateVolumesFromImageTest-753610252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (724002d4-4399-45c4-b8ac-42997ab6ff30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:03 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-b9a73870-f492-4e76-a3d0-e1a47a57b624 tempest-CreateVolumesFromImageTest-753610252 None] Volume 1881e01a-8ed1-49e6-8e25-5396e472a91b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1881e01a-8ed1-49e6-8e25-5396e472a91b', 'volume_size': 1} Sep 08 07:01:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b9a73870-f492-4e76-a3d0-e1a47a57b624 tempest-CreateVolumesFromImageTest-753610252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:03 devstack sudo[124420]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-54be3125-1eb8-4a59-89ef-a6025cb32dfd tempest-CreateVolumesFromImageTest-753610252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-fff8b38c-e17f-4058-9ebb-42644cecc306 1073741824" returned: 0 in 1.058s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-54be3125-1eb8-4a59-89ef-a6025cb32dfd tempest-CreateVolumesFromImageTest-753610252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-fff8b38c-e17f-4058-9ebb-42644cecc306 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:03 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7e9bedb-86a2-499b-ad81-c2bafb046af4 tempest-CreateVolumesFromImageTest-753610252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:01:03 devstack sudo[124465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-fff8b38c-e17f-4058-9ebb-42644cecc306 Sep 08 07:01:03 devstack sudo[124465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:03 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-f7e9bedb-86a2-499b-ad81-c2bafb046af4 tempest-CreateVolumesFromImageTest-753610252 None] Flow 'volume_create_manager' (320a64cf-f680-4cb6-9c96-ec0904ac0a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:01:03 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-f7e9bedb-86a2-499b-ad81-c2bafb046af4 tempest-CreateVolumesFromImageTest-753610252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4082c41-f8e7-4693-85c2-b1f5b3e6f193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:03 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-f7e9bedb-86a2-499b-ad81-c2bafb046af4 tempest-CreateVolumesFromImageTest-753610252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4082c41-f8e7-4693-85c2-b1f5b3e6f193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:01:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-234009622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df51a777-cb8b-4063-8860-b54e97169bd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cfc5b7f438943b5a3fe5b54a954c30b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:01:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:01:03Z,use_quota=True,user_id='6e2a36d14e66409cba47098e22236b17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:03 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-f7e9bedb-86a2-499b-ad81-c2bafb046af4 tempest-CreateVolumesFromImageTest-753610252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (784fabc4-32e0-489c-a004-5c8feaaa8f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:03 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-f7e9bedb-86a2-499b-ad81-c2bafb046af4 tempest-CreateVolumesFromImageTest-753610252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (784fabc4-32e0-489c-a004-5c8feaaa8f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:03 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-f7e9bedb-86a2-499b-ad81-c2bafb046af4 tempest-CreateVolumesFromImageTest-753610252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97c733b3-1eec-4996-a625-2e5e9a8910f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:03 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-f7e9bedb-86a2-499b-ad81-c2bafb046af4 tempest-CreateVolumesFromImageTest-753610252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97c733b3-1eec-4996-a625-2e5e9a8910f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df51a777-cb8b-4063-8860-b54e97169bd6', 'volume_name': 'volume-df51a777-cb8b-4063-8860-b54e97169bd6', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:03 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-f7e9bedb-86a2-499b-ad81-c2bafb046af4 tempest-CreateVolumesFromImageTest-753610252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (609e9607-c60e-4866-b7fd-060322015e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:03 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-f7e9bedb-86a2-499b-ad81-c2bafb046af4 tempest-CreateVolumesFromImageTest-753610252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (609e9607-c60e-4866-b7fd-060322015e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:03 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-f7e9bedb-86a2-499b-ad81-c2bafb046af4 tempest-CreateVolumesFromImageTest-753610252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3294c3bf-1ab8-4757-ae5c-748a48d7f9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:03 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-f7e9bedb-86a2-499b-ad81-c2bafb046af4 tempest-CreateVolumesFromImageTest-753610252 None] Volume df51a777-cb8b-4063-8860-b54e97169bd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df51a777-cb8b-4063-8860-b54e97169bd6', 'volume_size': 1} Sep 08 07:01:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-f7e9bedb-86a2-499b-ad81-c2bafb046af4 tempest-CreateVolumesFromImageTest-753610252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:03 devstack sudo[124465]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-54be3125-1eb8-4a59-89ef-a6025cb32dfd tempest-CreateVolumesFromImageTest-753610252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-fff8b38c-e17f-4058-9ebb-42644cecc306" returned: 0 in 0.442s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:03 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-54be3125-1eb8-4a59-89ef-a6025cb32dfd tempest-CreateVolumesFromImageTest-753610252 None] <== create_volume: return (1649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:01:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-54be3125-1eb8-4a59-89ef-a6025cb32dfd tempest-CreateVolumesFromImageTest-753610252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.655s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b9a73870-f492-4e76-a3d0-e1a47a57b624 tempest-CreateVolumesFromImageTest-753610252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.835s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:03 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-b9a73870-f492-4e76-a3d0-e1a47a57b624 tempest-CreateVolumesFromImageTest-753610252 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:01:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-768313862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1881e01a-8ed1-49e6-8e25-5396e472a91b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cfc5b7f438943b5a3fe5b54a954c30b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:01:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:01:03Z,use_quota=True,user_id='6e2a36d14e66409cba47098e22236b17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:01:03 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-b9a73870-f492-4e76-a3d0-e1a47a57b624 tempest-CreateVolumesFromImageTest-753610252 None] Creating volume 1881e01a-8ed1-49e6-8e25-5396e472a91b {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:01:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b9a73870-f492-4e76-a3d0-e1a47a57b624 tempest-CreateVolumesFromImageTest-753610252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b9a73870-f492-4e76-a3d0-e1a47a57b624 tempest-CreateVolumesFromImageTest-753610252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:03 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-b9a73870-f492-4e76-a3d0-e1a47a57b624 tempest-CreateVolumesFromImageTest-753610252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:01:03 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-b9a73870-f492-4e76-a3d0-e1a47a57b624 tempest-CreateVolumesFromImageTest-753610252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:01:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b9a73870-f492-4e76-a3d0-e1a47a57b624 tempest-CreateVolumesFromImageTest-753610252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:03 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-b9a73870-f492-4e76-a3d0-e1a47a57b624 tempest-CreateVolumesFromImageTest-753610252 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:01:03 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-b9a73870-f492-4e76-a3d0-e1a47a57b624 tempest-CreateVolumesFromImageTest-753610252 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 07:01:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b9a73870-f492-4e76-a3d0-e1a47a57b624 tempest-CreateVolumesFromImageTest-753610252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1881e01a-8ed1-49e6-8e25-5396e472a91b 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:04 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-54be3125-1eb8-4a59-89ef-a6025cb32dfd tempest-CreateVolumesFromImageTest-753610252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41e3976f-c298-4721-a731-fa60f0292aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fff8b38c-e17f-4058-9ebb-42644cecc306', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:04 devstack sudo[124481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1881e01a-8ed1-49e6-8e25-5396e472a91b 1073741824 Sep 08 07:01:04 devstack sudo[124481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:04 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-54be3125-1eb8-4a59-89ef-a6025cb32dfd tempest-CreateVolumesFromImageTest-753610252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8abca534-24ea-46c4-9037-66b9b09924f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:04 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-54be3125-1eb8-4a59-89ef-a6025cb32dfd tempest-CreateVolumesFromImageTest-753610252 None] Volume volume-fff8b38c-e17f-4058-9ebb-42644cecc306 (fff8b38c-e17f-4058-9ebb-42644cecc306): created successfully Sep 08 07:01:04 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-54be3125-1eb8-4a59-89ef-a6025cb32dfd tempest-CreateVolumesFromImageTest-753610252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8abca534-24ea-46c4-9037-66b9b09924f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:04 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-54be3125-1eb8-4a59-89ef-a6025cb32dfd tempest-CreateVolumesFromImageTest-753610252 None] Flow 'volume_create_manager' (16f50990-1643-4815-b6de-108707e65b21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:01:04 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-54be3125-1eb8-4a59-89ef-a6025cb32dfd tempest-CreateVolumesFromImageTest-753610252 None] Created volume successfully. Sep 08 07:01:04 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-f58c6bd4-ab52-4830-9f03-f69f1f98d8df tempest-CreateVolumesFromImageTest-753610252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:01:04 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-f58c6bd4-ab52-4830-9f03-f69f1f98d8df tempest-CreateVolumesFromImageTest-753610252 None] Flow 'volume_create_manager' (94869bf8-925c-4167-b0b8-e6488da6858a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:01:04 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-f58c6bd4-ab52-4830-9f03-f69f1f98d8df tempest-CreateVolumesFromImageTest-753610252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f57e8b9-8d4b-4ffb-add6-4fed33fb36ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:04 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-f58c6bd4-ab52-4830-9f03-f69f1f98d8df tempest-CreateVolumesFromImageTest-753610252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f57e8b9-8d4b-4ffb-add6-4fed33fb36ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:01:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-4954434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ae98243-f4f2-4cc8-a3ee-99e5abc491e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cfc5b7f438943b5a3fe5b54a954c30b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:01:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:01:04Z,use_quota=True,user_id='6e2a36d14e66409cba47098e22236b17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:04 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-f58c6bd4-ab52-4830-9f03-f69f1f98d8df tempest-CreateVolumesFromImageTest-753610252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8447c659-d35d-44d1-90b4-1191fbb658d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:04 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-f58c6bd4-ab52-4830-9f03-f69f1f98d8df tempest-CreateVolumesFromImageTest-753610252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8447c659-d35d-44d1-90b4-1191fbb658d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:04 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-f58c6bd4-ab52-4830-9f03-f69f1f98d8df tempest-CreateVolumesFromImageTest-753610252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1b0af86-e4a9-4e68-8010-d75193ad3e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:04 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-f58c6bd4-ab52-4830-9f03-f69f1f98d8df tempest-CreateVolumesFromImageTest-753610252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1b0af86-e4a9-4e68-8010-d75193ad3e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ae98243-f4f2-4cc8-a3ee-99e5abc491e3', 'volume_name': 'volume-2ae98243-f4f2-4cc8-a3ee-99e5abc491e3', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:04 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-f58c6bd4-ab52-4830-9f03-f69f1f98d8df tempest-CreateVolumesFromImageTest-753610252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2a76757-6bdb-4f39-ade9-6ab9602533be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:04 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-f58c6bd4-ab52-4830-9f03-f69f1f98d8df tempest-CreateVolumesFromImageTest-753610252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2a76757-6bdb-4f39-ade9-6ab9602533be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:04 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-f58c6bd4-ab52-4830-9f03-f69f1f98d8df tempest-CreateVolumesFromImageTest-753610252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c86e8b4-62a4-488f-b414-54fa8245b8ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:04 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-f58c6bd4-ab52-4830-9f03-f69f1f98d8df tempest-CreateVolumesFromImageTest-753610252 None] Volume 2ae98243-f4f2-4cc8-a3ee-99e5abc491e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ae98243-f4f2-4cc8-a3ee-99e5abc491e3', 'volume_size': 1} Sep 08 07:01:04 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-f58c6bd4-ab52-4830-9f03-f69f1f98d8df tempest-CreateVolumesFromImageTest-753610252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:04 devstack sudo[124481]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:04 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b9a73870-f492-4e76-a3d0-e1a47a57b624 tempest-CreateVolumesFromImageTest-753610252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1881e01a-8ed1-49e6-8e25-5396e472a91b 1073741824" returned: 0 in 0.979s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:05 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b9a73870-f492-4e76-a3d0-e1a47a57b624 tempest-CreateVolumesFromImageTest-753610252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1881e01a-8ed1-49e6-8e25-5396e472a91b {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:05 devstack sudo[124518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1881e01a-8ed1-49e6-8e25-5396e472a91b Sep 08 07:01:05 devstack sudo[124518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:05 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d5e3172-3b33-4c19-8761-b47294df9306 tempest-CreateVolumesFromImageTest-753610252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:01:05 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1d5e3172-3b33-4c19-8761-b47294df9306 tempest-CreateVolumesFromImageTest-753610252 None] Flow 'volume_create_manager' (1e546b85-cf3c-4a85-8d71-09483a357f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:01:05 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1d5e3172-3b33-4c19-8761-b47294df9306 tempest-CreateVolumesFromImageTest-753610252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ff1bd25-f083-49de-9217-394cbb2248ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:05 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1d5e3172-3b33-4c19-8761-b47294df9306 tempest-CreateVolumesFromImageTest-753610252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ff1bd25-f083-49de-9217-394cbb2248ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:01:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1645083387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd63c929-50ba-4148-bdea-a2db74f76dac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cfc5b7f438943b5a3fe5b54a954c30b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:01:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:01:05Z,use_quota=True,user_id='6e2a36d14e66409cba47098e22236b17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:05 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1d5e3172-3b33-4c19-8761-b47294df9306 tempest-CreateVolumesFromImageTest-753610252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae6b6042-cbef-4b88-9e69-2cb8eef9593b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:05 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1d5e3172-3b33-4c19-8761-b47294df9306 tempest-CreateVolumesFromImageTest-753610252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae6b6042-cbef-4b88-9e69-2cb8eef9593b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:05 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1d5e3172-3b33-4c19-8761-b47294df9306 tempest-CreateVolumesFromImageTest-753610252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a31080e1-086e-42ff-849c-9261f6c26bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:05 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1d5e3172-3b33-4c19-8761-b47294df9306 tempest-CreateVolumesFromImageTest-753610252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a31080e1-086e-42ff-849c-9261f6c26bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd63c929-50ba-4148-bdea-a2db74f76dac', 'volume_name': 'volume-cd63c929-50ba-4148-bdea-a2db74f76dac', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:05 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1d5e3172-3b33-4c19-8761-b47294df9306 tempest-CreateVolumesFromImageTest-753610252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efdab4e8-05ef-4bcf-bf69-3e2c07becc40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:05 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1d5e3172-3b33-4c19-8761-b47294df9306 tempest-CreateVolumesFromImageTest-753610252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efdab4e8-05ef-4bcf-bf69-3e2c07becc40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:05 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1d5e3172-3b33-4c19-8761-b47294df9306 tempest-CreateVolumesFromImageTest-753610252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab4d1072-b516-4f18-b388-fdfc0969f70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:05 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-1d5e3172-3b33-4c19-8761-b47294df9306 tempest-CreateVolumesFromImageTest-753610252 None] Volume cd63c929-50ba-4148-bdea-a2db74f76dac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd63c929-50ba-4148-bdea-a2db74f76dac', 'volume_size': 1} Sep 08 07:01:05 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-1d5e3172-3b33-4c19-8761-b47294df9306 tempest-CreateVolumesFromImageTest-753610252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:05 devstack sudo[124518]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:05 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b9a73870-f492-4e76-a3d0-e1a47a57b624 tempest-CreateVolumesFromImageTest-753610252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1881e01a-8ed1-49e6-8e25-5396e472a91b" returned: 0 in 0.495s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:05 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-b9a73870-f492-4e76-a3d0-e1a47a57b624 tempest-CreateVolumesFromImageTest-753610252 None] <== create_volume: return (1537ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:01:05 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b9a73870-f492-4e76-a3d0-e1a47a57b624 tempest-CreateVolumesFromImageTest-753610252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.540s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:05 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-f7e9bedb-86a2-499b-ad81-c2bafb046af4 tempest-CreateVolumesFromImageTest-753610252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.843s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:05 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-f7e9bedb-86a2-499b-ad81-c2bafb046af4 tempest-CreateVolumesFromImageTest-753610252 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:01:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-234009622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df51a777-cb8b-4063-8860-b54e97169bd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cfc5b7f438943b5a3fe5b54a954c30b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:01:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:01:03Z,use_quota=True,user_id='6e2a36d14e66409cba47098e22236b17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:01:05 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-f7e9bedb-86a2-499b-ad81-c2bafb046af4 tempest-CreateVolumesFromImageTest-753610252 None] Creating volume df51a777-cb8b-4063-8860-b54e97169bd6 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:01:05 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-f7e9bedb-86a2-499b-ad81-c2bafb046af4 tempest-CreateVolumesFromImageTest-753610252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:05 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-f7e9bedb-86a2-499b-ad81-c2bafb046af4 tempest-CreateVolumesFromImageTest-753610252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:05 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-f7e9bedb-86a2-499b-ad81-c2bafb046af4 tempest-CreateVolumesFromImageTest-753610252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:01:05 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-f7e9bedb-86a2-499b-ad81-c2bafb046af4 tempest-CreateVolumesFromImageTest-753610252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:01:05 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-f7e9bedb-86a2-499b-ad81-c2bafb046af4 tempest-CreateVolumesFromImageTest-753610252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:05 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-f7e9bedb-86a2-499b-ad81-c2bafb046af4 tempest-CreateVolumesFromImageTest-753610252 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:01:05 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-f7e9bedb-86a2-499b-ad81-c2bafb046af4 tempest-CreateVolumesFromImageTest-753610252 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 07:01:05 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f7e9bedb-86a2-499b-ad81-c2bafb046af4 tempest-CreateVolumesFromImageTest-753610252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df51a777-cb8b-4063-8860-b54e97169bd6 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:05 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b9a73870-f492-4e76-a3d0-e1a47a57b624 tempest-CreateVolumesFromImageTest-753610252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (724002d4-4399-45c4-b8ac-42997ab6ff30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1881e01a-8ed1-49e6-8e25-5396e472a91b', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:05 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b9a73870-f492-4e76-a3d0-e1a47a57b624 tempest-CreateVolumesFromImageTest-753610252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92589e41-0cba-4466-80d7-59074c323bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:05 devstack sudo[124536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df51a777-cb8b-4063-8860-b54e97169bd6 1073741824 Sep 08 07:01:05 devstack sudo[124536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:05 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-b9a73870-f492-4e76-a3d0-e1a47a57b624 tempest-CreateVolumesFromImageTest-753610252 None] Volume volume-1881e01a-8ed1-49e6-8e25-5396e472a91b (1881e01a-8ed1-49e6-8e25-5396e472a91b): created successfully Sep 08 07:01:05 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b9a73870-f492-4e76-a3d0-e1a47a57b624 tempest-CreateVolumesFromImageTest-753610252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92589e41-0cba-4466-80d7-59074c323bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:05 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b9a73870-f492-4e76-a3d0-e1a47a57b624 tempest-CreateVolumesFromImageTest-753610252 None] Flow 'volume_create_manager' (f87e986d-d57a-4580-a82b-dbffa82dc032) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:01:05 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-b9a73870-f492-4e76-a3d0-e1a47a57b624 tempest-CreateVolumesFromImageTest-753610252 None] Created volume successfully. Sep 08 07:01:06 devstack sudo[124536]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:06 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f7e9bedb-86a2-499b-ad81-c2bafb046af4 tempest-CreateVolumesFromImageTest-753610252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df51a777-cb8b-4063-8860-b54e97169bd6 1073741824" returned: 0 in 0.615s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:06 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f7e9bedb-86a2-499b-ad81-c2bafb046af4 tempest-CreateVolumesFromImageTest-753610252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df51a777-cb8b-4063-8860-b54e97169bd6 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:06 devstack sudo[124561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df51a777-cb8b-4063-8860-b54e97169bd6 Sep 08 07:01:06 devstack sudo[124561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:06 devstack sudo[124561]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:06 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f7e9bedb-86a2-499b-ad81-c2bafb046af4 tempest-CreateVolumesFromImageTest-753610252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df51a777-cb8b-4063-8860-b54e97169bd6" returned: 0 in 0.315s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:06 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-f7e9bedb-86a2-499b-ad81-c2bafb046af4 tempest-CreateVolumesFromImageTest-753610252 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:01:06 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-f7e9bedb-86a2-499b-ad81-c2bafb046af4 tempest-CreateVolumesFromImageTest-753610252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:06 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-f58c6bd4-ab52-4830-9f03-f69f1f98d8df tempest-CreateVolumesFromImageTest-753610252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.974s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:06 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-f58c6bd4-ab52-4830-9f03-f69f1f98d8df tempest-CreateVolumesFromImageTest-753610252 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:01:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-4954434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ae98243-f4f2-4cc8-a3ee-99e5abc491e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cfc5b7f438943b5a3fe5b54a954c30b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:01:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:01:04Z,use_quota=True,user_id='6e2a36d14e66409cba47098e22236b17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:01:06 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-f58c6bd4-ab52-4830-9f03-f69f1f98d8df tempest-CreateVolumesFromImageTest-753610252 None] Creating volume 2ae98243-f4f2-4cc8-a3ee-99e5abc491e3 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:01:06 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-f58c6bd4-ab52-4830-9f03-f69f1f98d8df tempest-CreateVolumesFromImageTest-753610252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:06 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-f58c6bd4-ab52-4830-9f03-f69f1f98d8df tempest-CreateVolumesFromImageTest-753610252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:06 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-f58c6bd4-ab52-4830-9f03-f69f1f98d8df tempest-CreateVolumesFromImageTest-753610252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:01:06 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-f58c6bd4-ab52-4830-9f03-f69f1f98d8df tempest-CreateVolumesFromImageTest-753610252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:01:06 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-f58c6bd4-ab52-4830-9f03-f69f1f98d8df tempest-CreateVolumesFromImageTest-753610252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:06 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-f58c6bd4-ab52-4830-9f03-f69f1f98d8df tempest-CreateVolumesFromImageTest-753610252 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:01:06 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-f58c6bd4-ab52-4830-9f03-f69f1f98d8df tempest-CreateVolumesFromImageTest-753610252 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 07:01:06 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f58c6bd4-ab52-4830-9f03-f69f1f98d8df tempest-CreateVolumesFromImageTest-753610252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ae98243-f4f2-4cc8-a3ee-99e5abc491e3 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:06 devstack sudo[124576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ae98243-f4f2-4cc8-a3ee-99e5abc491e3 1073741824 Sep 08 07:01:06 devstack sudo[124576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:06 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-f7e9bedb-86a2-499b-ad81-c2bafb046af4 tempest-CreateVolumesFromImageTest-753610252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3294c3bf-1ab8-4757-ae5c-748a48d7f9ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df51a777-cb8b-4063-8860-b54e97169bd6', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:06 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-f7e9bedb-86a2-499b-ad81-c2bafb046af4 tempest-CreateVolumesFromImageTest-753610252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c409fb7-bc12-48ed-a4f6-d5856dccfa97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:06 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-f7e9bedb-86a2-499b-ad81-c2bafb046af4 tempest-CreateVolumesFromImageTest-753610252 None] Volume volume-df51a777-cb8b-4063-8860-b54e97169bd6 (df51a777-cb8b-4063-8860-b54e97169bd6): created successfully Sep 08 07:01:06 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-f7e9bedb-86a2-499b-ad81-c2bafb046af4 tempest-CreateVolumesFromImageTest-753610252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c409fb7-bc12-48ed-a4f6-d5856dccfa97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:06 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-f7e9bedb-86a2-499b-ad81-c2bafb046af4 tempest-CreateVolumesFromImageTest-753610252 None] Flow 'volume_create_manager' (320a64cf-f680-4cb6-9c96-ec0904ac0a5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:01:06 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-f7e9bedb-86a2-499b-ad81-c2bafb046af4 tempest-CreateVolumesFromImageTest-753610252 None] Created volume successfully. Sep 08 07:01:06 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6b13956a-0610-4374-ace0-6dfb2a09aba8 tempest-ProjectAdminTests-737181934 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5347785949707, 'free_capacity_gb': 1773.5347785949707, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87507) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 08 07:01:07 devstack sudo[124576]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f58c6bd4-ab52-4830-9f03-f69f1f98d8df tempest-CreateVolumesFromImageTest-753610252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ae98243-f4f2-4cc8-a3ee-99e5abc491e3 1073741824" returned: 0 in 0.703s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f58c6bd4-ab52-4830-9f03-f69f1f98d8df tempest-CreateVolumesFromImageTest-753610252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ae98243-f4f2-4cc8-a3ee-99e5abc491e3 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:07 devstack sudo[124605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ae98243-f4f2-4cc8-a3ee-99e5abc491e3 Sep 08 07:01:07 devstack sudo[124605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:07 devstack sudo[124605]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f58c6bd4-ab52-4830-9f03-f69f1f98d8df tempest-CreateVolumesFromImageTest-753610252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ae98243-f4f2-4cc8-a3ee-99e5abc491e3" returned: 0 in 0.461s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:07 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-f58c6bd4-ab52-4830-9f03-f69f1f98d8df tempest-CreateVolumesFromImageTest-753610252 None] <== create_volume: return (1250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:01:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-f58c6bd4-ab52-4830-9f03-f69f1f98d8df tempest-CreateVolumesFromImageTest-753610252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.256s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-1d5e3172-3b33-4c19-8761-b47294df9306 tempest-CreateVolumesFromImageTest-753610252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.369s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:07 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-1d5e3172-3b33-4c19-8761-b47294df9306 tempest-CreateVolumesFromImageTest-753610252 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:01:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1645083387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd63c929-50ba-4148-bdea-a2db74f76dac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cfc5b7f438943b5a3fe5b54a954c30b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:01:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:01:05Z,use_quota=True,user_id='6e2a36d14e66409cba47098e22236b17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:01:07 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-1d5e3172-3b33-4c19-8761-b47294df9306 tempest-CreateVolumesFromImageTest-753610252 None] Creating volume cd63c929-50ba-4148-bdea-a2db74f76dac {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:01:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-1d5e3172-3b33-4c19-8761-b47294df9306 tempest-CreateVolumesFromImageTest-753610252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-1d5e3172-3b33-4c19-8761-b47294df9306 tempest-CreateVolumesFromImageTest-753610252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:07 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-1d5e3172-3b33-4c19-8761-b47294df9306 tempest-CreateVolumesFromImageTest-753610252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:01:07 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-1d5e3172-3b33-4c19-8761-b47294df9306 tempest-CreateVolumesFromImageTest-753610252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:01:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-1d5e3172-3b33-4c19-8761-b47294df9306 tempest-CreateVolumesFromImageTest-753610252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:07 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-1d5e3172-3b33-4c19-8761-b47294df9306 tempest-CreateVolumesFromImageTest-753610252 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:01:07 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-1d5e3172-3b33-4c19-8761-b47294df9306 tempest-CreateVolumesFromImageTest-753610252 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 07:01:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1d5e3172-3b33-4c19-8761-b47294df9306 tempest-CreateVolumesFromImageTest-753610252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cd63c929-50ba-4148-bdea-a2db74f76dac 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-f58c6bd4-ab52-4830-9f03-f69f1f98d8df tempest-CreateVolumesFromImageTest-753610252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c86e8b4-62a4-488f-b414-54fa8245b8ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ae98243-f4f2-4cc8-a3ee-99e5abc491e3', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:07 devstack sudo[124621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cd63c929-50ba-4148-bdea-a2db74f76dac 1073741824 Sep 08 07:01:07 devstack sudo[124621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-f58c6bd4-ab52-4830-9f03-f69f1f98d8df tempest-CreateVolumesFromImageTest-753610252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b17b54f1-4afb-45c3-a73f-69b787d6b267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:07 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-f58c6bd4-ab52-4830-9f03-f69f1f98d8df tempest-CreateVolumesFromImageTest-753610252 None] Volume volume-2ae98243-f4f2-4cc8-a3ee-99e5abc491e3 (2ae98243-f4f2-4cc8-a3ee-99e5abc491e3): created successfully Sep 08 07:01:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-f58c6bd4-ab52-4830-9f03-f69f1f98d8df tempest-CreateVolumesFromImageTest-753610252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b17b54f1-4afb-45c3-a73f-69b787d6b267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-f58c6bd4-ab52-4830-9f03-f69f1f98d8df tempest-CreateVolumesFromImageTest-753610252 None] Flow 'volume_create_manager' (94869bf8-925c-4167-b0b8-e6488da6858a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:01:07 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-f58c6bd4-ab52-4830-9f03-f69f1f98d8df tempest-CreateVolumesFromImageTest-753610252 None] Created volume successfully. Sep 08 07:01:08 devstack sudo[124621]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:08 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1d5e3172-3b33-4c19-8761-b47294df9306 tempest-CreateVolumesFromImageTest-753610252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cd63c929-50ba-4148-bdea-a2db74f76dac 1073741824" returned: 0 in 0.707s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:08 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1d5e3172-3b33-4c19-8761-b47294df9306 tempest-CreateVolumesFromImageTest-753610252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cd63c929-50ba-4148-bdea-a2db74f76dac {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:08 devstack sudo[124651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cd63c929-50ba-4148-bdea-a2db74f76dac Sep 08 07:01:08 devstack sudo[124651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:08 devstack sudo[124651]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:08 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1d5e3172-3b33-4c19-8761-b47294df9306 tempest-CreateVolumesFromImageTest-753610252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cd63c929-50ba-4148-bdea-a2db74f76dac" returned: 0 in 0.389s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:08 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-1d5e3172-3b33-4c19-8761-b47294df9306 tempest-CreateVolumesFromImageTest-753610252 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:01:08 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-1d5e3172-3b33-4c19-8761-b47294df9306 tempest-CreateVolumesFromImageTest-753610252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:08 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1d5e3172-3b33-4c19-8761-b47294df9306 tempest-CreateVolumesFromImageTest-753610252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab4d1072-b516-4f18-b388-fdfc0969f70a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd63c929-50ba-4148-bdea-a2db74f76dac', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:08 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1d5e3172-3b33-4c19-8761-b47294df9306 tempest-CreateVolumesFromImageTest-753610252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bef1fb9-41e6-4205-a79d-ff3e26364188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:09 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-1d5e3172-3b33-4c19-8761-b47294df9306 tempest-CreateVolumesFromImageTest-753610252 None] Volume volume-cd63c929-50ba-4148-bdea-a2db74f76dac (cd63c929-50ba-4148-bdea-a2db74f76dac): created successfully Sep 08 07:01:09 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1d5e3172-3b33-4c19-8761-b47294df9306 tempest-CreateVolumesFromImageTest-753610252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bef1fb9-41e6-4205-a79d-ff3e26364188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:09 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1d5e3172-3b33-4c19-8761-b47294df9306 tempest-CreateVolumesFromImageTest-753610252 None] Flow 'volume_create_manager' (1e546b85-cf3c-4a85-8d71-09483a357f49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:01:09 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-1d5e3172-3b33-4c19-8761-b47294df9306 tempest-CreateVolumesFromImageTest-753610252 None] Created volume successfully. Sep 08 07:01:10 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-a030fcf8-1f38-417a-86eb-a62b42f836e8 tempest-CreateVolumesFromImageTest-753610252 None] Acquiring lock "cinder-cd63c929-50ba-4148-bdea-a2db74f76dac-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:01:10 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-a030fcf8-1f38-417a-86eb-a62b42f836e8 tempest-CreateVolumesFromImageTest-753610252 None] Lock "cinder-cd63c929-50ba-4148-bdea-a2db74f76dac-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:01:10 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-a030fcf8-1f38-417a-86eb-a62b42f836e8 tempest-CreateVolumesFromImageTest-753610252 None] Acquiring lock "cinder-quobyte-cd63c929-50ba-4148-bdea-a2db74f76dac" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:01:10 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-a030fcf8-1f38-417a-86eb-a62b42f836e8 tempest-CreateVolumesFromImageTest-753610252 None] Lock "cinder-quobyte-cd63c929-50ba-4148-bdea-a2db74f76dac" acquired by "delete_volume" :: waited 0.035s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:01:10 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[38977104-1d99-4f8f-b40a-4952bd17eaaf]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:01:10 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a030fcf8-1f38-417a-86eb-a62b42f836e8 tempest-CreateVolumesFromImageTest-753610252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cd63c929-50ba-4148-bdea-a2db74f76dac {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:10 devstack sudo[124707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cd63c929-50ba-4148-bdea-a2db74f76dac Sep 08 07:01:10 devstack sudo[124707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:10 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-af17d661-c581-4299-ab0a-bd4bda195b4c tempest-SnapshotDependencyTests-358211977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:01:10 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-af17d661-c581-4299-ab0a-bd4bda195b4c tempest-SnapshotDependencyTests-358211977 None] Flow 'volume_create_manager' (82dbe364-9e79-45fc-a5d4-a684fed0bac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:01:10 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-af17d661-c581-4299-ab0a-bd4bda195b4c tempest-SnapshotDependencyTests-358211977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ed76b19-0d6e-4066-a200-8f89d547c461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:10 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-af17d661-c581-4299-ab0a-bd4bda195b4c tempest-SnapshotDependencyTests-358211977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ed76b19-0d6e-4066-a200-8f89d547c461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:01:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-137765787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df0ab3e4-7154-4dd5-8131-e0cee86beb34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a0356b8c5674359b939db5aac531090',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:01:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:01:11Z,use_quota=True,user_id='484e8efd947245c6928211ac8edf811d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:10 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-af17d661-c581-4299-ab0a-bd4bda195b4c tempest-SnapshotDependencyTests-358211977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (828868ca-7c73-404c-b5af-32ce7bdfb51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:10 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-af17d661-c581-4299-ab0a-bd4bda195b4c tempest-SnapshotDependencyTests-358211977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (828868ca-7c73-404c-b5af-32ce7bdfb51d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:10 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-af17d661-c581-4299-ab0a-bd4bda195b4c tempest-SnapshotDependencyTests-358211977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df07f004-8109-473b-bbed-c1c2dc66abcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:10 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-af17d661-c581-4299-ab0a-bd4bda195b4c tempest-SnapshotDependencyTests-358211977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df07f004-8109-473b-bbed-c1c2dc66abcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df0ab3e4-7154-4dd5-8131-e0cee86beb34', 'volume_name': 'volume-df0ab3e4-7154-4dd5-8131-e0cee86beb34', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:10 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-af17d661-c581-4299-ab0a-bd4bda195b4c tempest-SnapshotDependencyTests-358211977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a51ee74-ae98-4eb9-816c-7f3a60a98a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:10 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-af17d661-c581-4299-ab0a-bd4bda195b4c tempest-SnapshotDependencyTests-358211977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a51ee74-ae98-4eb9-816c-7f3a60a98a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:10 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-af17d661-c581-4299-ab0a-bd4bda195b4c tempest-SnapshotDependencyTests-358211977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d2e9b94-9021-48ce-988f-ac9ab19953c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:10 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-af17d661-c581-4299-ab0a-bd4bda195b4c tempest-SnapshotDependencyTests-358211977 None] Volume df0ab3e4-7154-4dd5-8131-e0cee86beb34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df0ab3e4-7154-4dd5-8131-e0cee86beb34', 'volume_size': 1} Sep 08 07:01:10 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-af17d661-c581-4299-ab0a-bd4bda195b4c tempest-SnapshotDependencyTests-358211977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:10 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-af17d661-c581-4299-ab0a-bd4bda195b4c tempest-SnapshotDependencyTests-358211977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:10 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-af17d661-c581-4299-ab0a-bd4bda195b4c tempest-SnapshotDependencyTests-358211977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:01:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-137765787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df0ab3e4-7154-4dd5-8131-e0cee86beb34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a0356b8c5674359b939db5aac531090',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:01:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:01:11Z,use_quota=True,user_id='484e8efd947245c6928211ac8edf811d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:01:10 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-af17d661-c581-4299-ab0a-bd4bda195b4c tempest-SnapshotDependencyTests-358211977 None] Creating volume df0ab3e4-7154-4dd5-8131-e0cee86beb34 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:01:10 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-af17d661-c581-4299-ab0a-bd4bda195b4c tempest-SnapshotDependencyTests-358211977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:10 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-af17d661-c581-4299-ab0a-bd4bda195b4c tempest-SnapshotDependencyTests-358211977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:10 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-af17d661-c581-4299-ab0a-bd4bda195b4c tempest-SnapshotDependencyTests-358211977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:01:10 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-af17d661-c581-4299-ab0a-bd4bda195b4c tempest-SnapshotDependencyTests-358211977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:01:10 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-af17d661-c581-4299-ab0a-bd4bda195b4c tempest-SnapshotDependencyTests-358211977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:10 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-af17d661-c581-4299-ab0a-bd4bda195b4c tempest-SnapshotDependencyTests-358211977 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:01:10 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-af17d661-c581-4299-ab0a-bd4bda195b4c tempest-SnapshotDependencyTests-358211977 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 07:01:10 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-af17d661-c581-4299-ab0a-bd4bda195b4c tempest-SnapshotDependencyTests-358211977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df0ab3e4-7154-4dd5-8131-e0cee86beb34 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:10 devstack sudo[124727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df0ab3e4-7154-4dd5-8131-e0cee86beb34 1073741824 Sep 08 07:01:10 devstack sudo[124727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:10 devstack sudo[124707]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:10 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a030fcf8-1f38-417a-86eb-a62b42f836e8 tempest-CreateVolumesFromImageTest-753610252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cd63c929-50ba-4148-bdea-a2db74f76dac" returned: 0 in 0.596s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:10 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a030fcf8-1f38-417a-86eb-a62b42f836e8 tempest-CreateVolumesFromImageTest-753610252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cd63c929-50ba-4148-bdea-a2db74f76dac {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:10 devstack sudo[124733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cd63c929-50ba-4148-bdea-a2db74f76dac Sep 08 07:01:10 devstack sudo[124733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:11 devstack sudo[124733]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a030fcf8-1f38-417a-86eb-a62b42f836e8 tempest-CreateVolumesFromImageTest-753610252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-cd63c929-50ba-4148-bdea-a2db74f76dac" returned: 0 in 0.357s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:11 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-a030fcf8-1f38-417a-86eb-a62b42f836e8 tempest-CreateVolumesFromImageTest-753610252 None] Lock "cinder-quobyte-cd63c929-50ba-4148-bdea-a2db74f76dac" released by "delete_volume" :: held 1.036s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:01:11 devstack sudo[124727]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-af17d661-c581-4299-ab0a-bd4bda195b4c tempest-SnapshotDependencyTests-358211977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df0ab3e4-7154-4dd5-8131-e0cee86beb34 1073741824" returned: 0 in 0.533s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:11 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-a030fcf8-1f38-417a-86eb-a62b42f836e8 tempest-CreateVolumesFromImageTest-753610252 None] Created reservations ['83841bed-0816-45d3-b4b6-7f007bfe4103', 'b722cd62-6de7-49ff-b7ed-c89b9ab4fc78', '93c325aa-a645-469e-90de-e0eab8a3a66a', 'b8202a6d-916f-4469-9070-7de638c5ffea'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:01:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-af17d661-c581-4299-ab0a-bd4bda195b4c tempest-SnapshotDependencyTests-358211977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df0ab3e4-7154-4dd5-8131-e0cee86beb34 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:11 devstack sudo[124755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df0ab3e4-7154-4dd5-8131-e0cee86beb34 Sep 08 07:01:11 devstack sudo[124755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a030fcf8-1f38-417a-86eb-a62b42f836e8 tempest-CreateVolumesFromImageTest-753610252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a030fcf8-1f38-417a-86eb-a62b42f836e8 tempest-CreateVolumesFromImageTest-753610252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:11 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-a030fcf8-1f38-417a-86eb-a62b42f836e8 tempest-CreateVolumesFromImageTest-753610252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:01:11 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-a030fcf8-1f38-417a-86eb-a62b42f836e8 tempest-CreateVolumesFromImageTest-753610252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:01:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a030fcf8-1f38-417a-86eb-a62b42f836e8 tempest-CreateVolumesFromImageTest-753610252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a030fcf8-1f38-417a-86eb-a62b42f836e8 tempest-CreateVolumesFromImageTest-753610252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:11 devstack sudo[124760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 07:01:11 devstack sudo[124760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:11 devstack sudo[124755]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-af17d661-c581-4299-ab0a-bd4bda195b4c tempest-SnapshotDependencyTests-358211977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df0ab3e4-7154-4dd5-8131-e0cee86beb34" returned: 0 in 0.347s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:11 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-af17d661-c581-4299-ab0a-bd4bda195b4c tempest-SnapshotDependencyTests-358211977 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:01:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-af17d661-c581-4299-ab0a-bd4bda195b4c tempest-SnapshotDependencyTests-358211977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:11 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-af17d661-c581-4299-ab0a-bd4bda195b4c tempest-SnapshotDependencyTests-358211977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d2e9b94-9021-48ce-988f-ac9ab19953c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df0ab3e4-7154-4dd5-8131-e0cee86beb34', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:11 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-af17d661-c581-4299-ab0a-bd4bda195b4c tempest-SnapshotDependencyTests-358211977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (621b5187-d921-4584-83eb-b813fc0c542a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:11 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-af17d661-c581-4299-ab0a-bd4bda195b4c tempest-SnapshotDependencyTests-358211977 None] Volume volume-df0ab3e4-7154-4dd5-8131-e0cee86beb34 (df0ab3e4-7154-4dd5-8131-e0cee86beb34): created successfully Sep 08 07:01:11 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-af17d661-c581-4299-ab0a-bd4bda195b4c tempest-SnapshotDependencyTests-358211977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (621b5187-d921-4584-83eb-b813fc0c542a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:11 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-af17d661-c581-4299-ab0a-bd4bda195b4c tempest-SnapshotDependencyTests-358211977 None] Flow 'volume_create_manager' (82dbe364-9e79-45fc-a5d4-a684fed0bac4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:01:11 devstack sudo[124760]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a030fcf8-1f38-417a-86eb-a62b42f836e8 tempest-CreateVolumesFromImageTest-753610252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.340s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:11 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-a030fcf8-1f38-417a-86eb-a62b42f836e8 tempest-CreateVolumesFromImageTest-753610252 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:01:11 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-af17d661-c581-4299-ab0a-bd4bda195b4c tempest-SnapshotDependencyTests-358211977 None] Created volume successfully. Sep 08 07:01:11 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-a030fcf8-1f38-417a-86eb-a62b42f836e8 tempest-CreateVolumesFromImageTest-753610252 None] Deleted volume successfully. Sep 08 07:01:11 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-a030fcf8-1f38-417a-86eb-a62b42f836e8 tempest-CreateVolumesFromImageTest-753610252 None] Lock "cinder-cd63c929-50ba-4148-bdea-a2db74f76dac-delete_volume" released by "delete_volume" :: held 1.776s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:01:12 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-52d0cd25-b556-46b8-b2f8-fb89234e992f tempest-CreateVolumesFromImageTest-753610252 None] Acquiring lock "cinder-2ae98243-f4f2-4cc8-a3ee-99e5abc491e3-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:01:12 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-52d0cd25-b556-46b8-b2f8-fb89234e992f tempest-CreateVolumesFromImageTest-753610252 None] Lock "cinder-2ae98243-f4f2-4cc8-a3ee-99e5abc491e3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:01:12 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-52d0cd25-b556-46b8-b2f8-fb89234e992f tempest-CreateVolumesFromImageTest-753610252 None] Acquiring lock "cinder-quobyte-2ae98243-f4f2-4cc8-a3ee-99e5abc491e3" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:01:12 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-52d0cd25-b556-46b8-b2f8-fb89234e992f tempest-CreateVolumesFromImageTest-753610252 None] Lock "cinder-quobyte-2ae98243-f4f2-4cc8-a3ee-99e5abc491e3" acquired by "delete_volume" :: waited 0.015s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:01:12 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[536b8a68-3356-4055-b775-2da8a15de6b4]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:01:12 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-52d0cd25-b556-46b8-b2f8-fb89234e992f tempest-CreateVolumesFromImageTest-753610252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ae98243-f4f2-4cc8-a3ee-99e5abc491e3 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:12 devstack sudo[124794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ae98243-f4f2-4cc8-a3ee-99e5abc491e3 Sep 08 07:01:12 devstack sudo[124794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:13 devstack sudo[124794]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:13 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:01:13 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] Flow 'volume_create_manager' (d3dd4bcb-1bfe-403b-bf9b-9b0af29d55f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:01:13 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0338645d-f93e-4c82-85b3-af1f159f3384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-52d0cd25-b556-46b8-b2f8-fb89234e992f tempest-CreateVolumesFromImageTest-753610252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ae98243-f4f2-4cc8-a3ee-99e5abc491e3" returned: 0 in 0.537s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-52d0cd25-b556-46b8-b2f8-fb89234e992f tempest-CreateVolumesFromImageTest-753610252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ae98243-f4f2-4cc8-a3ee-99e5abc491e3 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:13 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0338645d-f93e-4c82-85b3-af1f159f3384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:01:13Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a74bd485-574d-4677-9f8d-0394221a334a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d40444772702431490af151ac07d497f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:01:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:01:13Z,use_quota=True,user_id='c2f936a77fb64ecdbd8bdc7e227e272b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:13 devstack sudo[124818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ae98243-f4f2-4cc8-a3ee-99e5abc491e3 Sep 08 07:01:13 devstack sudo[124818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:13 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ae1b300-c8e4-4989-8cd5-c6408e0cc528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:13 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ae1b300-c8e4-4989-8cd5-c6408e0cc528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:13 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48493a91-8bba-462c-84d9-b1d3ba911274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:13 devstack cinder-volume[87507]: DEBUG cinder.image.glance [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] Creating Keystone auth plugin from conf {{(pid=87507) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 08 07:01:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-780bd225-dc59-460b-a945-3e4b1467a64b tempest-SnapshotDependencyTests-358211977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-780bd225-dc59-460b-a945-3e4b1467a64b tempest-SnapshotDependencyTests-358211977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:13 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-780bd225-dc59-460b-a945-3e4b1467a64b tempest-SnapshotDependencyTests-358211977 None] Creating offline snapshot 102d1c44-88ab-4f67-ba9a-250b1e1043cf of volume df0ab3e4-7154-4dd5-8131-e0cee86beb34 {{(pid=87507) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 07:01:13 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79e67e9-9f3b-4c10-9ad4-bb590841ea48]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:01:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-780bd225-dc59-460b-a945-3e4b1467a64b tempest-SnapshotDependencyTests-358211977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df0ab3e4-7154-4dd5-8131-e0cee86beb34 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:13 devstack sudo[124818]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-52d0cd25-b556-46b8-b2f8-fb89234e992f tempest-CreateVolumesFromImageTest-753610252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2ae98243-f4f2-4cc8-a3ee-99e5abc491e3" returned: 0 in 0.339s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:13 devstack sudo[124826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df0ab3e4-7154-4dd5-8131-e0cee86beb34 Sep 08 07:01:13 devstack sudo[124826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:13 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-52d0cd25-b556-46b8-b2f8-fb89234e992f tempest-CreateVolumesFromImageTest-753610252 None] Lock "cinder-quobyte-2ae98243-f4f2-4cc8-a3ee-99e5abc491e3" released by "delete_volume" :: held 0.925s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:01:13 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-52d0cd25-b556-46b8-b2f8-fb89234e992f tempest-CreateVolumesFromImageTest-753610252 None] Created reservations ['01d8d466-371f-4bc4-9b0e-82f80f8c3be9', '72b04690-acb8-4b8e-817d-9e6769332cbf', '07e2da6e-6f0a-4013-b1d5-7622cc1e5707', '3ceb73a5-82fd-408a-8e2e-ffad93718d6d'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:01:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-52d0cd25-b556-46b8-b2f8-fb89234e992f tempest-CreateVolumesFromImageTest-753610252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-52d0cd25-b556-46b8-b2f8-fb89234e992f tempest-CreateVolumesFromImageTest-753610252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:13 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-52d0cd25-b556-46b8-b2f8-fb89234e992f tempest-CreateVolumesFromImageTest-753610252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:01:13 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-52d0cd25-b556-46b8-b2f8-fb89234e992f tempest-CreateVolumesFromImageTest-753610252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:01:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-52d0cd25-b556-46b8-b2f8-fb89234e992f tempest-CreateVolumesFromImageTest-753610252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-52d0cd25-b556-46b8-b2f8-fb89234e992f tempest-CreateVolumesFromImageTest-753610252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:13 devstack sudo[124838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 07:01:13 devstack sudo[124838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:13 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48493a91-8bba-462c-84d9-b1d3ba911274) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a74bd485-574d-4677-9f8d-0394221a334a', 'volume_name': 'volume-a74bd485-574d-4677-9f8d-0394221a334a', 'volume_size': 1, 'image_id': '03feaa47-e687-4024-ba1e-7bb938d2a1c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/03feaa47-e687-4024-ba1e-7bb938d2a1c1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '474b5254ddf668f6e6ea8462f5f98d56', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd40444772702431490af151ac07d497f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ce2f92437e70ca2b785f36f8410da64db401c70d599284a38b1f6627776c61b5747e856a5f58dd97cd277fb314310b7d96942a6dc1f82a5dedd543a170769e56', 'id': '03feaa47-e687-4024-ba1e-7bb938d2a1c1', 'created_at': datetime.datetime(2026, 9, 8, 5, 1, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 5, 1, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/03feaa47-e687-4024-ba1e-7bb938d2a1c1/file', 'properties': {}}, 'image_service': }' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:13 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca8da25b-5c83-4e37-ab78-b46438cc0d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:13 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca8da25b-5c83-4e37-ab78-b46438cc0d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:13 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fba67cb-2a73-4b9a-863c-217b41e18749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:13 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] Volume a74bd485-574d-4677-9f8d-0394221a334a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a74bd485-574d-4677-9f8d-0394221a334a', 'volume_size': 1, 'image_id': '03feaa47-e687-4024-ba1e-7bb938d2a1c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/03feaa47-e687-4024-ba1e-7bb938d2a1c1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '474b5254ddf668f6e6ea8462f5f98d56', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd40444772702431490af151ac07d497f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ce2f92437e70ca2b785f36f8410da64db401c70d599284a38b1f6627776c61b5747e856a5f58dd97cd277fb314310b7d96942a6dc1f82a5dedd543a170769e56', 'id': '03feaa47-e687-4024-ba1e-7bb938d2a1c1', 'created_at': datetime.datetime(2026, 9, 8, 5, 1, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 5, 1, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/03feaa47-e687-4024-ba1e-7bb938d2a1c1/file', 'properties': {}}, 'image_service': } Sep 08 07:01:13 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] Trying to clone a74bd485-574d-4677-9f8d-0394221a334a from image 03feaa47-e687-4024-ba1e-7bb938d2a1c1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/03feaa47-e687-4024-ba1e-7bb938d2a1c1', 'metadata': {}}]). {{(pid=87507) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 08 07:01:13 devstack sudo[124826]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-780bd225-dc59-460b-a945-3e4b1467a64b tempest-SnapshotDependencyTests-358211977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df0ab3e4-7154-4dd5-8131-e0cee86beb34" returned: 0 in 0.542s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-780bd225-dc59-460b-a945-3e4b1467a64b tempest-SnapshotDependencyTests-358211977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df0ab3e4-7154-4dd5-8131-e0cee86beb34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df0ab3e4-7154-4dd5-8131-e0cee86beb34.102d1c44-88ab-4f67-ba9a-250b1e1043cf 1G {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:13 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_03feaa47-e687-4024-ba1e-7bb938d2a1c1_424gt19cdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87507) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 08 07:01:13 devstack cinder-volume[87507]: INFO cinder.image.image_utils [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] Image download 0.00 MB at 0.00 MB/s Sep 08 07:01:13 devstack sudo[124850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df0ab3e4-7154-4dd5-8131-e0cee86beb34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df0ab3e4-7154-4dd5-8131-e0cee86beb34.102d1c44-88ab-4f67-ba9a-250b1e1043cf 1G Sep 08 07:01:13 devstack sudo[124850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:13 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[01554145-49a7-4982-9d29-2856e1bb47aa]: (4, 'raw') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:01:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_03feaa47-e687-4024-ba1e-7bb938d2a1c1_424gt19cdevstack@QuobyteHD {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:13 devstack sudo[124838]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-52d0cd25-b556-46b8-b2f8-fb89234e992f tempest-CreateVolumesFromImageTest-753610252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.322s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:13 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-52d0cd25-b556-46b8-b2f8-fb89234e992f tempest-CreateVolumesFromImageTest-753610252 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:01:13 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-52d0cd25-b556-46b8-b2f8-fb89234e992f tempest-CreateVolumesFromImageTest-753610252 None] Deleted volume successfully. Sep 08 07:01:14 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-52d0cd25-b556-46b8-b2f8-fb89234e992f tempest-CreateVolumesFromImageTest-753610252 None] Lock "cinder-2ae98243-f4f2-4cc8-a3ee-99e5abc491e3-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:01:14 devstack sudo[124856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_03feaa47-e687-4024-ba1e-7bb938d2a1c1_424gt19cdevstack@QuobyteHD Sep 08 07:01:14 devstack sudo[124856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:14 devstack sudo[124856]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_03feaa47-e687-4024-ba1e-7bb938d2a1c1_424gt19cdevstack@QuobyteHD" returned: 0 in 0.428s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_03feaa47-e687-4024-ba1e-7bb938d2a1c1_424gt19cdevstack@QuobyteHD {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:14 devstack sudo[124850]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-780bd225-dc59-460b-a945-3e4b1467a64b tempest-SnapshotDependencyTests-358211977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df0ab3e4-7154-4dd5-8131-e0cee86beb34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df0ab3e4-7154-4dd5-8131-e0cee86beb34.102d1c44-88ab-4f67-ba9a-250b1e1043cf 1G" returned: 0 in 0.530s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-780bd225-dc59-460b-a945-3e4b1467a64b tempest-SnapshotDependencyTests-358211977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df0ab3e4-7154-4dd5-8131-e0cee86beb34 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df0ab3e4-7154-4dd5-8131-e0cee86beb34.102d1c44-88ab-4f67-ba9a-250b1e1043cf {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:14 devstack sudo[124876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df0ab3e4-7154-4dd5-8131-e0cee86beb34 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df0ab3e4-7154-4dd5-8131-e0cee86beb34.102d1c44-88ab-4f67-ba9a-250b1e1043cf Sep 08 07:01:14 devstack sudo[124876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:14 devstack sudo[124875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_03feaa47-e687-4024-ba1e-7bb938d2a1c1_424gt19cdevstack@QuobyteHD Sep 08 07:01:14 devstack sudo[124875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:14 devstack sudo[124876]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-780bd225-dc59-460b-a945-3e4b1467a64b tempest-SnapshotDependencyTests-358211977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df0ab3e4-7154-4dd5-8131-e0cee86beb34 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df0ab3e4-7154-4dd5-8131-e0cee86beb34.102d1c44-88ab-4f67-ba9a-250b1e1043cf" returned: 0 in 0.348s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:14 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-780bd225-dc59-460b-a945-3e4b1467a64b tempest-SnapshotDependencyTests-358211977 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df0ab3e4-7154-4dd5-8131-e0cee86beb34.102d1c44-88ab-4f67-ba9a-250b1e1043cf is being set with open permissions: ugo+rw Sep 08 07:01:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-780bd225-dc59-460b-a945-3e4b1467a64b tempest-SnapshotDependencyTests-358211977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df0ab3e4-7154-4dd5-8131-e0cee86beb34.102d1c44-88ab-4f67-ba9a-250b1e1043cf {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:14 devstack sudo[124875]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:14 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-59a059cb-d371-452d-a5ca-6fbaa4af88a8 tempest-CreateVolumesFromImageTest-753610252 None] Acquiring lock "cinder-df51a777-cb8b-4063-8860-b54e97169bd6-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:01:14 devstack sudo[124897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df0ab3e4-7154-4dd5-8131-e0cee86beb34.102d1c44-88ab-4f67-ba9a-250b1e1043cf Sep 08 07:01:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_03feaa47-e687-4024-ba1e-7bb938d2a1c1_424gt19cdevstack@QuobyteHD" returned: 1 in 0.411s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_03feaa47-e687-4024-ba1e-7bb938d2a1c1_424gt19cdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 07:01:14 devstack sudo[124897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:14 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] Temporary image 03feaa47-e687-4024-ba1e-7bb938d2a1c1 is fetched for user c2f936a77fb64ecdbd8bdc7e227e272b. {{(pid=87507) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 08 07:01:14 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-59a059cb-d371-452d-a5ca-6fbaa4af88a8 tempest-CreateVolumesFromImageTest-753610252 None] Lock "cinder-df51a777-cb8b-4063-8860-b54e97169bd6-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:01:14 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-59a059cb-d371-452d-a5ca-6fbaa4af88a8 tempest-CreateVolumesFromImageTest-753610252 None] Acquiring lock "cinder-quobyte-df51a777-cb8b-4063-8860-b54e97169bd6" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:01:14 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-59a059cb-d371-452d-a5ca-6fbaa4af88a8 tempest-CreateVolumesFromImageTest-753610252 None] Lock "cinder-quobyte-df51a777-cb8b-4063-8860-b54e97169bd6" acquired by "delete_volume" :: waited 0.027s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:01:14 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73816ee-3107-4321-844e-3253454a2484]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:01:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-59a059cb-d371-452d-a5ca-6fbaa4af88a8 tempest-CreateVolumesFromImageTest-753610252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df51a777-cb8b-4063-8860-b54e97169bd6 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:14 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f7b92b-01cd-438f-961d-55da8004c669]: (4, 'raw') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:01:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_03feaa47-e687-4024-ba1e-7bb938d2a1c1_424gt19cdevstack@QuobyteHD {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:15 devstack sudo[124902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df51a777-cb8b-4063-8860-b54e97169bd6 Sep 08 07:01:15 devstack sudo[124902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:15 devstack sudo[124906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_03feaa47-e687-4024-ba1e-7bb938d2a1c1_424gt19cdevstack@QuobyteHD Sep 08 07:01:15 devstack sudo[124906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:15 devstack sudo[124897]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-780bd225-dc59-460b-a945-3e4b1467a64b tempest-SnapshotDependencyTests-358211977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df0ab3e4-7154-4dd5-8131-e0cee86beb34.102d1c44-88ab-4f67-ba9a-250b1e1043cf" returned: 0 in 0.406s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-780bd225-dc59-460b-a945-3e4b1467a64b tempest-SnapshotDependencyTests-358211977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df0ab3e4-7154-4dd5-8131-e0cee86beb34.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:15 devstack sudo[124916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df0ab3e4-7154-4dd5-8131-e0cee86beb34.info Sep 08 07:01:15 devstack sudo[124916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:15 devstack sudo[124906]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_03feaa47-e687-4024-ba1e-7bb938d2a1c1_424gt19cdevstack@QuobyteHD" returned: 0 in 0.474s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:15 devstack sudo[124902]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_03feaa47-e687-4024-ba1e-7bb938d2a1c1_424gt19cdevstack@QuobyteHD {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-59a059cb-d371-452d-a5ca-6fbaa4af88a8 tempest-CreateVolumesFromImageTest-753610252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df51a777-cb8b-4063-8860-b54e97169bd6" returned: 0 in 0.512s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-59a059cb-d371-452d-a5ca-6fbaa4af88a8 tempest-CreateVolumesFromImageTest-753610252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df51a777-cb8b-4063-8860-b54e97169bd6 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:15 devstack sudo[124933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df51a777-cb8b-4063-8860-b54e97169bd6 Sep 08 07:01:15 devstack sudo[124933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:15 devstack sudo[124916]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-780bd225-dc59-460b-a945-3e4b1467a64b tempest-SnapshotDependencyTests-358211977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df0ab3e4-7154-4dd5-8131-e0cee86beb34.info" returned: 0 in 0.336s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:15 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-780bd225-dc59-460b-a945-3e4b1467a64b tempest-SnapshotDependencyTests-358211977 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df0ab3e4-7154-4dd5-8131-e0cee86beb34.info is being set with open permissions: ugo+rw Sep 08 07:01:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-780bd225-dc59-460b-a945-3e4b1467a64b tempest-SnapshotDependencyTests-358211977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df0ab3e4-7154-4dd5-8131-e0cee86beb34.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:15 devstack sudo[124929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_03feaa47-e687-4024-ba1e-7bb938d2a1c1_424gt19cdevstack@QuobyteHD Sep 08 07:01:15 devstack sudo[124929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:15 devstack sudo[124939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df0ab3e4-7154-4dd5-8131-e0cee86beb34.info Sep 08 07:01:15 devstack sudo[124939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:15 devstack sudo[124933]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-59a059cb-d371-452d-a5ca-6fbaa4af88a8 tempest-CreateVolumesFromImageTest-753610252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df51a777-cb8b-4063-8860-b54e97169bd6" returned: 0 in 0.306s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:15 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-59a059cb-d371-452d-a5ca-6fbaa4af88a8 tempest-CreateVolumesFromImageTest-753610252 None] Lock "cinder-quobyte-df51a777-cb8b-4063-8860-b54e97169bd6" released by "delete_volume" :: held 0.892s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:01:15 devstack sudo[124939]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-780bd225-dc59-460b-a945-3e4b1467a64b tempest-SnapshotDependencyTests-358211977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df0ab3e4-7154-4dd5-8131-e0cee86beb34.info" returned: 0 in 0.312s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:15 devstack sudo[124929]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-780bd225-dc59-460b-a945-3e4b1467a64b tempest-SnapshotDependencyTests-358211977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.612s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:15 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-59a059cb-d371-452d-a5ca-6fbaa4af88a8 tempest-CreateVolumesFromImageTest-753610252 None] Created reservations ['5f2ff80a-08b2-4821-8da2-b4f11ddd8e22', '77aedc2a-5e3c-4ae9-accb-b2d37b8c7750', '4144e3af-7665-4e5e-b7d9-9c64135d5432', '07c02034-5179-4a47-ae6a-cf6e0a6b4d3a'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:01:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_03feaa47-e687-4024-ba1e-7bb938d2a1c1_424gt19cdevstack@QuobyteHD" returned: 1 in 0.471s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_03feaa47-e687-4024-ba1e-7bb938d2a1c1_424gt19cdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 07:01:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:15 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:01:13Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a74bd485-574d-4677-9f8d-0394221a334a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d40444772702431490af151ac07d497f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:01:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:01:13Z,use_quota=True,user_id='c2f936a77fb64ecdbd8bdc7e227e272b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:01:15 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] Creating volume a74bd485-574d-4677-9f8d-0394221a334a {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:01:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:15 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:01:15 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:01:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:15 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:01:15 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 07:01:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a74bd485-574d-4677-9f8d-0394221a334a 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:15 devstack sudo[124956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a74bd485-574d-4677-9f8d-0394221a334a 1073741824 Sep 08 07:01:15 devstack sudo[124956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:15 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-780bd225-dc59-460b-a945-3e4b1467a64b tempest-SnapshotDependencyTests-358211977 None] Create snapshot completed successfully Sep 08 07:01:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-59a059cb-d371-452d-a5ca-6fbaa4af88a8 tempest-CreateVolumesFromImageTest-753610252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-59a059cb-d371-452d-a5ca-6fbaa4af88a8 tempest-CreateVolumesFromImageTest-753610252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:15 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-59a059cb-d371-452d-a5ca-6fbaa4af88a8 tempest-CreateVolumesFromImageTest-753610252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:01:15 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-59a059cb-d371-452d-a5ca-6fbaa4af88a8 tempest-CreateVolumesFromImageTest-753610252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:01:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-59a059cb-d371-452d-a5ca-6fbaa4af88a8 tempest-CreateVolumesFromImageTest-753610252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-59a059cb-d371-452d-a5ca-6fbaa4af88a8 tempest-CreateVolumesFromImageTest-753610252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:16 devstack sudo[124961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 07:01:16 devstack sudo[124961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:16 devstack sudo[124961]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-59a059cb-d371-452d-a5ca-6fbaa4af88a8 tempest-CreateVolumesFromImageTest-753610252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.300s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:16 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-59a059cb-d371-452d-a5ca-6fbaa4af88a8 tempest-CreateVolumesFromImageTest-753610252 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:01:16 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-59a059cb-d371-452d-a5ca-6fbaa4af88a8 tempest-CreateVolumesFromImageTest-753610252 None] Deleted volume successfully. Sep 08 07:01:16 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-59a059cb-d371-452d-a5ca-6fbaa4af88a8 tempest-CreateVolumesFromImageTest-753610252 None] Lock "cinder-df51a777-cb8b-4063-8860-b54e97169bd6-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:01:16 devstack sudo[124956]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a74bd485-574d-4677-9f8d-0394221a334a 1073741824" returned: 0 in 0.519s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a74bd485-574d-4677-9f8d-0394221a334a {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:16 devstack sudo[124983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a74bd485-574d-4677-9f8d-0394221a334a Sep 08 07:01:16 devstack sudo[124983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:16 devstack sudo[124983]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a74bd485-574d-4677-9f8d-0394221a334a" returned: 0 in 0.253s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:16 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:01:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:16 devstack cinder-volume[87507]: DEBUG cinder.volume.volume_utils [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] Attempting download of 03feaa47-e687-4024-ba1e-7bb938d2a1c1 ((None, [{'url': 'file:///opt/stack/data/glance/images/03feaa47-e687-4024-ba1e-7bb938d2a1c1', 'metadata': {}}])) to volume a74bd485-574d-4677-9f8d-0394221a334a. {{(pid=87507) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 08 07:01:16 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e799ced5-68be-413c-b134-d5d07b883898]: (4, 'raw') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:01:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_03feaa47-e687-4024-ba1e-7bb938d2a1c1__gy3lcup {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:16 devstack sudo[124995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_03feaa47-e687-4024-ba1e-7bb938d2a1c1__gy3lcup Sep 08 07:01:16 devstack sudo[124995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:17 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-cf312e3b-f496-4470-8c22-83b7436cdb1d tempest-CreateVolumesFromImageTest-753610252 None] Acquiring lock "cinder-1881e01a-8ed1-49e6-8e25-5396e472a91b-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:01:17 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d4f9766-8341-4377-ae93-1bd10c711729 tempest-SnapshotDependencyTests-358211977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:01:17 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-cf312e3b-f496-4470-8c22-83b7436cdb1d tempest-CreateVolumesFromImageTest-753610252 None] Lock "cinder-1881e01a-8ed1-49e6-8e25-5396e472a91b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:01:17 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7d4f9766-8341-4377-ae93-1bd10c711729 tempest-SnapshotDependencyTests-358211977 None] Flow 'volume_create_manager' (0cbf1e34-4455-494c-8d6c-5c9601c2bd65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:01:17 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7d4f9766-8341-4377-ae93-1bd10c711729 tempest-SnapshotDependencyTests-358211977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d52db96b-cc0e-4281-ac4b-6f7fe5a124fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:17 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7d4f9766-8341-4377-ae93-1bd10c711729 tempest-SnapshotDependencyTests-358211977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d52db96b-cc0e-4281-ac4b-6f7fe5a124fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:01:17Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4deff0c-ae04-4a69-ba4a-f268c0256ba0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a0356b8c5674359b939db5aac531090',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:01:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=102d1c44-88ab-4f67-ba9a-250b1e1043cf,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:01:17Z,use_quota=True,user_id='484e8efd947245c6928211ac8edf811d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:17 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7d4f9766-8341-4377-ae93-1bd10c711729 tempest-SnapshotDependencyTests-358211977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e3529a5-8547-425c-8d39-3e2e40d21288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:17 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7d4f9766-8341-4377-ae93-1bd10c711729 tempest-SnapshotDependencyTests-358211977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e3529a5-8547-425c-8d39-3e2e40d21288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:17 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7d4f9766-8341-4377-ae93-1bd10c711729 tempest-SnapshotDependencyTests-358211977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1766df4-392e-48ce-9662-d2ef313ccbec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:17 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7d4f9766-8341-4377-ae93-1bd10c711729 tempest-SnapshotDependencyTests-358211977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1766df4-392e-48ce-9662-d2ef313ccbec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e4deff0c-ae04-4a69-ba4a-f268c0256ba0', 'volume_name': 'volume-e4deff0c-ae04-4a69-ba4a-f268c0256ba0', 'volume_size': 1, 'snapshot_id': '102d1c44-88ab-4f67-ba9a-250b1e1043cf'}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:17 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7d4f9766-8341-4377-ae93-1bd10c711729 tempest-SnapshotDependencyTests-358211977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef6b743b-ecc1-4296-bba0-2be54c320023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:17 devstack sudo[124995]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:17 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7d4f9766-8341-4377-ae93-1bd10c711729 tempest-SnapshotDependencyTests-358211977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef6b743b-ecc1-4296-bba0-2be54c320023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:17 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7d4f9766-8341-4377-ae93-1bd10c711729 tempest-SnapshotDependencyTests-358211977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b19f1079-7bd0-4ef5-bd6c-aacf7ca897f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:17 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-7d4f9766-8341-4377-ae93-1bd10c711729 tempest-SnapshotDependencyTests-358211977 None] Volume e4deff0c-ae04-4a69-ba4a-f268c0256ba0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e4deff0c-ae04-4a69-ba4a-f268c0256ba0', 'volume_size': 1, 'snapshot_id': '102d1c44-88ab-4f67-ba9a-250b1e1043cf'} Sep 08 07:01:17 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-cf312e3b-f496-4470-8c22-83b7436cdb1d tempest-CreateVolumesFromImageTest-753610252 None] Acquiring lock "cinder-quobyte-1881e01a-8ed1-49e6-8e25-5396e472a91b" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:01:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_03feaa47-e687-4024-ba1e-7bb938d2a1c1__gy3lcup" returned: 0 in 0.451s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_03feaa47-e687-4024-ba1e-7bb938d2a1c1__gy3lcup {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-7d4f9766-8341-4377-ae93-1bd10c711729 tempest-SnapshotDependencyTests-358211977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-7d4f9766-8341-4377-ae93-1bd10c711729 tempest-SnapshotDependencyTests-358211977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:17 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-7d4f9766-8341-4377-ae93-1bd10c711729 tempest-SnapshotDependencyTests-358211977 None] Acquiring lock "cinder-quobyte-102d1c44-88ab-4f67-ba9a-250b1e1043cf-e4deff0c-ae04-4a69-ba4a-f268c0256ba0" by "_create_volume_from_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:01:17 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-cf312e3b-f496-4470-8c22-83b7436cdb1d tempest-CreateVolumesFromImageTest-753610252 None] Lock "cinder-quobyte-1881e01a-8ed1-49e6-8e25-5396e472a91b" acquired by "delete_volume" :: waited 0.046s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:01:17 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-7d4f9766-8341-4377-ae93-1bd10c711729 tempest-SnapshotDependencyTests-358211977 None] Lock "cinder-quobyte-102d1c44-88ab-4f67-ba9a-250b1e1043cf-e4deff0c-ae04-4a69-ba4a-f268c0256ba0" acquired by "_create_volume_from_snapshot" :: waited 0.039s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:01:17 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-7d4f9766-8341-4377-ae93-1bd10c711729 tempest-SnapshotDependencyTests-358211977 None] Creating volume e4deff0c-ae04-4a69-ba4a-f268c0256ba0 from snapshot 102d1c44-88ab-4f67-ba9a-250b1e1043cf {{(pid=87507) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 08 07:01:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-7d4f9766-8341-4377-ae93-1bd10c711729 tempest-SnapshotDependencyTests-358211977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-7d4f9766-8341-4377-ae93-1bd10c711729 tempest-SnapshotDependencyTests-358211977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:17 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-7d4f9766-8341-4377-ae93-1bd10c711729 tempest-SnapshotDependencyTests-358211977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:01:17 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-7d4f9766-8341-4377-ae93-1bd10c711729 tempest-SnapshotDependencyTests-358211977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:01:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-7d4f9766-8341-4377-ae93-1bd10c711729 tempest-SnapshotDependencyTests-358211977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:17 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-7d4f9766-8341-4377-ae93-1bd10c711729 tempest-SnapshotDependencyTests-358211977 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:01:17 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-7d4f9766-8341-4377-ae93-1bd10c711729 tempest-SnapshotDependencyTests-358211977 None] Acquiring lock "cinder-quobyte-e4deff0c-ae04-4a69-ba4a-f268c0256ba0" by "_copy_volume_from_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:01:17 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73ae36e-9f03-45ca-8953-9fe34aabdbe5]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:01:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-cf312e3b-f496-4470-8c22-83b7436cdb1d tempest-CreateVolumesFromImageTest-753610252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1881e01a-8ed1-49e6-8e25-5396e472a91b {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:17 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-7d4f9766-8341-4377-ae93-1bd10c711729 tempest-SnapshotDependencyTests-358211977 None] Lock "cinder-quobyte-e4deff0c-ae04-4a69-ba4a-f268c0256ba0" acquired by "_copy_volume_from_snapshot" :: waited 0.049s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:01:17 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-7d4f9766-8341-4377-ae93-1bd10c711729 tempest-SnapshotDependencyTests-358211977 None] snapshot: 102d1c44-88ab-4f67-ba9a-250b1e1043cf, volume: e4deff0c-ae04-4a69-ba4a-f268c0256ba0, {{(pid=87507) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 08 07:01:17 devstack sudo[125014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_03feaa47-e687-4024-ba1e-7bb938d2a1c1__gy3lcup Sep 08 07:01:17 devstack sudo[125014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-7d4f9766-8341-4377-ae93-1bd10c711729 tempest-SnapshotDependencyTests-358211977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-7d4f9766-8341-4377-ae93-1bd10c711729 tempest-SnapshotDependencyTests-358211977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:17 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-7d4f9766-8341-4377-ae93-1bd10c711729 tempest-SnapshotDependencyTests-358211977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:01:17 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-7d4f9766-8341-4377-ae93-1bd10c711729 tempest-SnapshotDependencyTests-358211977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:01:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-7d4f9766-8341-4377-ae93-1bd10c711729 tempest-SnapshotDependencyTests-358211977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:17 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c78224a-8702-44df-9cd8-08e9adb12387]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:01:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7d4f9766-8341-4377-ae93-1bd10c711729 tempest-SnapshotDependencyTests-358211977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df0ab3e4-7154-4dd5-8131-e0cee86beb34.102d1c44-88ab-4f67-ba9a-250b1e1043cf {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:17 devstack sudo[125018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1881e01a-8ed1-49e6-8e25-5396e472a91b Sep 08 07:01:17 devstack sudo[125018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:17 devstack sudo[125023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df0ab3e4-7154-4dd5-8131-e0cee86beb34.102d1c44-88ab-4f67-ba9a-250b1e1043cf Sep 08 07:01:17 devstack sudo[125023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:17 devstack sudo[125014]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_03feaa47-e687-4024-ba1e-7bb938d2a1c1__gy3lcup" returned: 1 in 0.403s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_03feaa47-e687-4024-ba1e-7bb938d2a1c1__gy3lcup' failed. Not Retrying. {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 07:01:17 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02bb8bd-a00f-4e27-a320-81b43e8ac357]: (4, 'raw') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:01:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_03feaa47-e687-4024-ba1e-7bb938d2a1c1_424gt19cdevstack@QuobyteHD {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:17 devstack sudo[125018]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-cf312e3b-f496-4470-8c22-83b7436cdb1d tempest-CreateVolumesFromImageTest-753610252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1881e01a-8ed1-49e6-8e25-5396e472a91b" returned: 0 in 0.449s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-cf312e3b-f496-4470-8c22-83b7436cdb1d tempest-CreateVolumesFromImageTest-753610252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1881e01a-8ed1-49e6-8e25-5396e472a91b {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:17 devstack sudo[125034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_03feaa47-e687-4024-ba1e-7bb938d2a1c1_424gt19cdevstack@QuobyteHD Sep 08 07:01:17 devstack sudo[125034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:17 devstack sudo[125043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1881e01a-8ed1-49e6-8e25-5396e472a91b Sep 08 07:01:17 devstack sudo[125043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:17 devstack sudo[125023]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7d4f9766-8341-4377-ae93-1bd10c711729 tempest-SnapshotDependencyTests-358211977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df0ab3e4-7154-4dd5-8131-e0cee86beb34.102d1c44-88ab-4f67-ba9a-250b1e1043cf" returned: 0 in 0.452s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:17 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-7d4f9766-8341-4377-ae93-1bd10c711729 tempest-SnapshotDependencyTests-358211977 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df0ab3e4-7154-4dd5-8131-e0cee86beb34(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:01:17 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[699a1b80-d838-40e8-8cf7-093b2307d434]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:01:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7d4f9766-8341-4377-ae93-1bd10c711729 tempest-SnapshotDependencyTests-358211977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df0ab3e4-7154-4dd5-8131-e0cee86beb34 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:18 devstack sudo[125034]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_03feaa47-e687-4024-ba1e-7bb938d2a1c1_424gt19cdevstack@QuobyteHD" returned: 0 in 0.406s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_03feaa47-e687-4024-ba1e-7bb938d2a1c1_424gt19cdevstack@QuobyteHD {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:18 devstack sudo[125051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df0ab3e4-7154-4dd5-8131-e0cee86beb34 Sep 08 07:01:18 devstack sudo[125051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:18 devstack sudo[125043]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-cf312e3b-f496-4470-8c22-83b7436cdb1d tempest-CreateVolumesFromImageTest-753610252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-1881e01a-8ed1-49e6-8e25-5396e472a91b" returned: 0 in 0.304s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:18 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-cf312e3b-f496-4470-8c22-83b7436cdb1d tempest-CreateVolumesFromImageTest-753610252 None] Lock "cinder-quobyte-1881e01a-8ed1-49e6-8e25-5396e472a91b" released by "delete_volume" :: held 0.819s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:01:18 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-cf312e3b-f496-4470-8c22-83b7436cdb1d tempest-CreateVolumesFromImageTest-753610252 None] Created reservations ['21a3a4f5-64e8-4ab2-b184-1cedded621d3', '0347d6e2-0e89-4842-a8c2-1f9aa0371293', '041c61a2-05f5-4acb-9ef8-c03fd71b093a', 'ef6c2660-1087-4760-8711-aea832f6f171'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:01:18 devstack sudo[125062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_03feaa47-e687-4024-ba1e-7bb938d2a1c1_424gt19cdevstack@QuobyteHD Sep 08 07:01:18 devstack sudo[125062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-cf312e3b-f496-4470-8c22-83b7436cdb1d tempest-CreateVolumesFromImageTest-753610252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-cf312e3b-f496-4470-8c22-83b7436cdb1d tempest-CreateVolumesFromImageTest-753610252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:18 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-cf312e3b-f496-4470-8c22-83b7436cdb1d tempest-CreateVolumesFromImageTest-753610252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:01:18 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-cf312e3b-f496-4470-8c22-83b7436cdb1d tempest-CreateVolumesFromImageTest-753610252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:01:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-cf312e3b-f496-4470-8c22-83b7436cdb1d tempest-CreateVolumesFromImageTest-753610252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-cf312e3b-f496-4470-8c22-83b7436cdb1d tempest-CreateVolumesFromImageTest-753610252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:18 devstack sudo[125070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 07:01:18 devstack sudo[125070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:18 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-26737287-0b6d-4586-9490-42723bdd9a98 tempest-CreateVolumesFromImageTest-753610252 None] Acquiring lock "cinder-fff8b38c-e17f-4058-9ebb-42644cecc306-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:01:18 devstack sudo[125051]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7d4f9766-8341-4377-ae93-1bd10c711729 tempest-SnapshotDependencyTests-358211977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df0ab3e4-7154-4dd5-8131-e0cee86beb34" returned: 0 in 0.485s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:18 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-7d4f9766-8341-4377-ae93-1bd10c711729 tempest-SnapshotDependencyTests-358211977 None] will copy from snapshot at /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df0ab3e4-7154-4dd5-8131-e0cee86beb34 {{(pid=87507) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 08 07:01:18 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-7d4f9766-8341-4377-ae93-1bd10c711729 tempest-SnapshotDependencyTests-358211977 None] Creating direct copy from snapshot {{(pid=87507) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 08 07:01:18 devstack cinder-volume[87507]: DEBUG cinder.utils [None req-7d4f9766-8341-4377-ae93-1bd10c711729 tempest-SnapshotDependencyTests-358211977 None] Path /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e4deff0c-ae04-4a69-ba4a-f268c0256ba0 not found in is_blk_device check {{(pid=87507) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 08 07:01:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7d4f9766-8341-4377-ae93-1bd10c711729 tempest-SnapshotDependencyTests-358211977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df0ab3e4-7154-4dd5-8131-e0cee86beb34 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e4deff0c-ae04-4a69-ba4a-f268c0256ba0 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:18 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-26737287-0b6d-4586-9490-42723bdd9a98 tempest-CreateVolumesFromImageTest-753610252 None] Lock "cinder-fff8b38c-e17f-4058-9ebb-42644cecc306-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:01:18 devstack sudo[125078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df0ab3e4-7154-4dd5-8131-e0cee86beb34 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e4deff0c-ae04-4a69-ba4a-f268c0256ba0 Sep 08 07:01:18 devstack sudo[125078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:18 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-26737287-0b6d-4586-9490-42723bdd9a98 tempest-CreateVolumesFromImageTest-753610252 None] Acquiring lock "cinder-quobyte-fff8b38c-e17f-4058-9ebb-42644cecc306" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:01:18 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-26737287-0b6d-4586-9490-42723bdd9a98 tempest-CreateVolumesFromImageTest-753610252 None] Lock "cinder-quobyte-fff8b38c-e17f-4058-9ebb-42644cecc306" acquired by "delete_volume" :: waited 0.031s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:01:18 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c175249d-c3e0-416b-bcbd-73afa878ed5f]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:01:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-26737287-0b6d-4586-9490-42723bdd9a98 tempest-CreateVolumesFromImageTest-753610252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-fff8b38c-e17f-4058-9ebb-42644cecc306 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:18 devstack sudo[125062]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_03feaa47-e687-4024-ba1e-7bb938d2a1c1_424gt19cdevstack@QuobyteHD" returned: 1 in 0.545s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_03feaa47-e687-4024-ba1e-7bb938d2a1c1_424gt19cdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 07:01:18 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] 03feaa47-e687-4024-ba1e-7bb938d2a1c1 was raw, converting to qcow2 {{(pid=87507) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 08 07:01:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_03feaa47-e687-4024-ba1e-7bb938d2a1c1_424gt19cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a74bd485-574d-4677-9f8d-0394221a334a {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:18 devstack sudo[125092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_03feaa47-e687-4024-ba1e-7bb938d2a1c1_424gt19cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a74bd485-574d-4677-9f8d-0394221a334a Sep 08 07:01:18 devstack sudo[125092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:18 devstack sudo[125070]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-cf312e3b-f496-4470-8c22-83b7436cdb1d tempest-CreateVolumesFromImageTest-753610252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.431s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:18 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-cf312e3b-f496-4470-8c22-83b7436cdb1d tempest-CreateVolumesFromImageTest-753610252 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:01:18 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-cf312e3b-f496-4470-8c22-83b7436cdb1d tempest-CreateVolumesFromImageTest-753610252 None] Deleted volume successfully. Sep 08 07:01:18 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-cf312e3b-f496-4470-8c22-83b7436cdb1d tempest-CreateVolumesFromImageTest-753610252 None] Lock "cinder-1881e01a-8ed1-49e6-8e25-5396e472a91b-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:01:18 devstack sudo[125089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-fff8b38c-e17f-4058-9ebb-42644cecc306 Sep 08 07:01:18 devstack sudo[125089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:18 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-084da471-7c02-4ca8-8d47-973884db11c5 tempest-ProjectReaderTests-1152707596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:01:18 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-084da471-7c02-4ca8-8d47-973884db11c5 tempest-ProjectReaderTests-1152707596 None] Flow 'volume_create_manager' (91c5f251-043b-4207-960e-2ff9735db923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:01:18 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-084da471-7c02-4ca8-8d47-973884db11c5 tempest-ProjectReaderTests-1152707596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d49c4294-cc14-4c16-84cf-3ed4d248145f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:19 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-084da471-7c02-4ca8-8d47-973884db11c5 tempest-ProjectReaderTests-1152707596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d49c4294-cc14-4c16-84cf-3ed4d248145f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:01:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1445261242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dea3e977-53b2-4408-abed-16d1d6048b0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c6367f07ddf4a4cb92e17a1b8b6bb5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:01:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:01:19Z,use_quota=True,user_id='0b8690b455d34f248f0182e09db083f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:19 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-084da471-7c02-4ca8-8d47-973884db11c5 tempest-ProjectReaderTests-1152707596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52e80845-2105-467c-ba7e-31e0723dd4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:19 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-084da471-7c02-4ca8-8d47-973884db11c5 tempest-ProjectReaderTests-1152707596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52e80845-2105-467c-ba7e-31e0723dd4d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:19 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-084da471-7c02-4ca8-8d47-973884db11c5 tempest-ProjectReaderTests-1152707596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db9b5871-fdd6-413b-9012-271182dc11c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:19 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-084da471-7c02-4ca8-8d47-973884db11c5 tempest-ProjectReaderTests-1152707596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db9b5871-fdd6-413b-9012-271182dc11c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dea3e977-53b2-4408-abed-16d1d6048b0c', 'volume_name': 'volume-dea3e977-53b2-4408-abed-16d1d6048b0c', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:19 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-084da471-7c02-4ca8-8d47-973884db11c5 tempest-ProjectReaderTests-1152707596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46780b2f-6b12-4748-82f9-38c1a58dc89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:19 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-084da471-7c02-4ca8-8d47-973884db11c5 tempest-ProjectReaderTests-1152707596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46780b2f-6b12-4748-82f9-38c1a58dc89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:19 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-084da471-7c02-4ca8-8d47-973884db11c5 tempest-ProjectReaderTests-1152707596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37a3b2ce-c7c8-435e-ad86-7888a89bf56b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:19 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-084da471-7c02-4ca8-8d47-973884db11c5 tempest-ProjectReaderTests-1152707596 None] Volume dea3e977-53b2-4408-abed-16d1d6048b0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dea3e977-53b2-4408-abed-16d1d6048b0c', 'volume_size': 1} Sep 08 07:01:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-084da471-7c02-4ca8-8d47-973884db11c5 tempest-ProjectReaderTests-1152707596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:19 devstack sudo[125089]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-26737287-0b6d-4586-9490-42723bdd9a98 tempest-CreateVolumesFromImageTest-753610252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-fff8b38c-e17f-4058-9ebb-42644cecc306" returned: 0 in 0.622s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-26737287-0b6d-4586-9490-42723bdd9a98 tempest-CreateVolumesFromImageTest-753610252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-fff8b38c-e17f-4058-9ebb-42644cecc306 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:19 devstack sudo[125130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-fff8b38c-e17f-4058-9ebb-42644cecc306 Sep 08 07:01:19 devstack sudo[125130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:19 devstack sudo[125092]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_03feaa47-e687-4024-ba1e-7bb938d2a1c1_424gt19cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a74bd485-574d-4677-9f8d-0394221a334a" returned: 0 in 0.859s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:19 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_03feaa47-e687-4024-ba1e-7bb938d2a1c1_424gt19cdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a74bd485-574d-4677-9f8d-0394221a334a {{(pid=87507) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 07:01:19 devstack cinder-volume[87507]: INFO cinder.image.image_utils [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] Converted 0.00 MB image at 0.00 MB/s Sep 08 07:01:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a74bd485-574d-4677-9f8d-0394221a334a 1G {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:19 devstack sudo[125141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a74bd485-574d-4677-9f8d-0394221a334a 1G Sep 08 07:01:19 devstack sudo[125141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:19 devstack sudo[125130]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-26737287-0b6d-4586-9490-42723bdd9a98 tempest-CreateVolumesFromImageTest-753610252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-fff8b38c-e17f-4058-9ebb-42644cecc306" returned: 0 in 0.576s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:19 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-26737287-0b6d-4586-9490-42723bdd9a98 tempest-CreateVolumesFromImageTest-753610252 None] Lock "cinder-quobyte-fff8b38c-e17f-4058-9ebb-42644cecc306" released by "delete_volume" :: held 1.297s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:01:20 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-26737287-0b6d-4586-9490-42723bdd9a98 tempest-CreateVolumesFromImageTest-753610252 None] Created reservations ['b46e7ef3-6e4c-4470-be29-76b5d94d074e', '53f956c9-2879-42a0-9d69-d103cf0993ab', 'bf640ad9-05c3-46f6-a4c0-d0160c13911a', 'ff333394-011c-4766-92bb-12707d925e77'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:01:20 devstack cinder-volume[87507]: DEBUG oslo_service.periodic_task [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87507) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 07:01:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:20 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:01:20 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:01:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:20 devstack sudo[125165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 07:01:20 devstack sudo[125165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-26737287-0b6d-4586-9490-42723bdd9a98 tempest-CreateVolumesFromImageTest-753610252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-26737287-0b6d-4586-9490-42723bdd9a98 tempest-CreateVolumesFromImageTest-753610252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:20 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-26737287-0b6d-4586-9490-42723bdd9a98 tempest-CreateVolumesFromImageTest-753610252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:01:20 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-26737287-0b6d-4586-9490-42723bdd9a98 tempest-CreateVolumesFromImageTest-753610252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:01:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-26737287-0b6d-4586-9490-42723bdd9a98 tempest-CreateVolumesFromImageTest-753610252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-26737287-0b6d-4586-9490-42723bdd9a98 tempest-CreateVolumesFromImageTest-753610252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:20 devstack sudo[125141]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a74bd485-574d-4677-9f8d-0394221a334a 1G" returned: 0 in 0.878s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:20 devstack cinder-volume[87507]: DEBUG cinder.volume.volume_utils [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] Downloaded image 03feaa47-e687-4024-ba1e-7bb938d2a1c1 ((None, [{'url': 'file:///opt/stack/data/glance/images/03feaa47-e687-4024-ba1e-7bb938d2a1c1', 'metadata': {}}])) to volume a74bd485-574d-4677-9f8d-0394221a334a successfully. {{(pid=87507) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 08 07:01:20 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] Temporary image 03feaa47-e687-4024-ba1e-7bb938d2a1c1 for user c2f936a77fb64ecdbd8bdc7e227e272b is deleted. {{(pid=87507) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 08 07:01:20 devstack cinder-volume[87507]: DEBUG cinder.volume.volume_utils [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] Marking volume a74bd485-574d-4677-9f8d-0394221a334a as bootable. {{(pid=87507) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 08 07:01:20 devstack sudo[125175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 07:01:20 devstack sudo[125175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:20 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] Copying metadata from image 03feaa47-e687-4024-ba1e-7bb938d2a1c1 to a74bd485-574d-4677-9f8d-0394221a334a. {{(pid=87507) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 08 07:01:20 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] Creating volume glance metadata for volume a74bd485-574d-4677-9f8d-0394221a334a backed by image 03feaa47-e687-4024-ba1e-7bb938d2a1c1 with: {'image_id': '03feaa47-e687-4024-ba1e-7bb938d2a1c1', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '474b5254ddf668f6e6ea8462f5f98d56', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87507) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 08 07:01:20 devstack sudo[125165]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.516s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:20 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:01:20 devstack cinder-volume[87507]: DEBUG oslo_service.periodic_task [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Running periodic task VolumeManager._thread_info {{(pid=87507) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 07:01:20 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] thread count: 29 {{(pid=87507) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 07:01:20 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] thread info: [<_MainThread(MainThread, started 127913129345152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87507) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 07:01:20 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fba67cb-2a73-4b9a-863c-217b41e18749) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a74bd485-574d-4677-9f8d-0394221a334a', 'volume_size': 1, 'image_id': '03feaa47-e687-4024-ba1e-7bb938d2a1c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/03feaa47-e687-4024-ba1e-7bb938d2a1c1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '474b5254ddf668f6e6ea8462f5f98d56', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd40444772702431490af151ac07d497f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ce2f92437e70ca2b785f36f8410da64db401c70d599284a38b1f6627776c61b5747e856a5f58dd97cd277fb314310b7d96942a6dc1f82a5dedd543a170769e56', 'id': '03feaa47-e687-4024-ba1e-7bb938d2a1c1', 'created_at': datetime.datetime(2026, 9, 8, 5, 1, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 5, 1, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/03feaa47-e687-4024-ba1e-7bb938d2a1c1/file', 'properties': {}}, 'image_service': }' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:20 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cbebac0-6b29-49de-bd01-8d1c79471964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:20 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] Volume volume-a74bd485-574d-4677-9f8d-0394221a334a (a74bd485-574d-4677-9f8d-0394221a334a): created successfully Sep 08 07:01:20 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cbebac0-6b29-49de-bd01-8d1c79471964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:20 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] Flow 'volume_create_manager' (d3dd4bcb-1bfe-403b-bf9b-9b0af29d55f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:01:20 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-53c972ab-4006-48c7-9ff1-f1206e539dfa tempest-VolumeImageDependencyTests-1956159590 None] Created volume successfully. Sep 08 07:01:21 devstack sudo[125175]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:21 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-26737287-0b6d-4586-9490-42723bdd9a98 tempest-CreateVolumesFromImageTest-753610252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.783s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:21 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-26737287-0b6d-4586-9490-42723bdd9a98 tempest-CreateVolumesFromImageTest-753610252 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:01:21 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-26737287-0b6d-4586-9490-42723bdd9a98 tempest-CreateVolumesFromImageTest-753610252 None] Deleted volume successfully. Sep 08 07:01:21 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-26737287-0b6d-4586-9490-42723bdd9a98 tempest-CreateVolumesFromImageTest-753610252 None] Lock "cinder-fff8b38c-e17f-4058-9ebb-42644cecc306-delete_volume" released by "delete_volume" :: held 2.763s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:01:22 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-1f924165-76a5-4145-a636-5f5d7ef673e2 tempest-VolumeImageDependencyTests-1956159590 None] Acquiring lock "cinder-a74bd485-574d-4677-9f8d-0394221a334a-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:01:22 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-1f924165-76a5-4145-a636-5f5d7ef673e2 tempest-VolumeImageDependencyTests-1956159590 None] Lock "cinder-a74bd485-574d-4677-9f8d-0394221a334a-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:01:22 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-1f924165-76a5-4145-a636-5f5d7ef673e2 tempest-VolumeImageDependencyTests-1956159590 None] Acquiring lock "cinder-quobyte-a74bd485-574d-4677-9f8d-0394221a334a" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:01:22 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-1f924165-76a5-4145-a636-5f5d7ef673e2 tempest-VolumeImageDependencyTests-1956159590 None] Lock "cinder-quobyte-a74bd485-574d-4677-9f8d-0394221a334a" acquired by "delete_volume" :: waited 0.031s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:01:22 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[390406e5-8c53-48c9-9dd8-9e6eead6f9e1]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:01:22 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1f924165-76a5-4145-a636-5f5d7ef673e2 tempest-VolumeImageDependencyTests-1956159590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a74bd485-574d-4677-9f8d-0394221a334a {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:22 devstack sudo[125245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a74bd485-574d-4677-9f8d-0394221a334a Sep 08 07:01:22 devstack sudo[125245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:23 devstack sudo[125245]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1f924165-76a5-4145-a636-5f5d7ef673e2 tempest-VolumeImageDependencyTests-1956159590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a74bd485-574d-4677-9f8d-0394221a334a" returned: 0 in 1.079s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1f924165-76a5-4145-a636-5f5d7ef673e2 tempest-VolumeImageDependencyTests-1956159590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a74bd485-574d-4677-9f8d-0394221a334a {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:23 devstack sudo[125284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a74bd485-574d-4677-9f8d-0394221a334a Sep 08 07:01:23 devstack sudo[125284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:24 devstack sudo[125284]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1f924165-76a5-4145-a636-5f5d7ef673e2 tempest-VolumeImageDependencyTests-1956159590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a74bd485-574d-4677-9f8d-0394221a334a" returned: 0 in 0.875s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:24 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-1f924165-76a5-4145-a636-5f5d7ef673e2 tempest-VolumeImageDependencyTests-1956159590 None] Lock "cinder-quobyte-a74bd485-574d-4677-9f8d-0394221a334a" released by "delete_volume" :: held 2.080s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:01:24 devstack sudo[125078]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7d4f9766-8341-4377-ae93-1bd10c711729 tempest-SnapshotDependencyTests-358211977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df0ab3e4-7154-4dd5-8131-e0cee86beb34 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e4deff0c-ae04-4a69-ba4a-f268c0256ba0" returned: 0 in 6.140s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:24 devstack cinder-volume[87507]: DEBUG cinder.image.image_utils [None req-7d4f9766-8341-4377-ae93-1bd10c711729 tempest-SnapshotDependencyTests-358211977 None] Image conversion details: src /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df0ab3e4-7154-4dd5-8131-e0cee86beb34, size 1024.00 MB, duration 6.14 sec, destination /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e4deff0c-ae04-4a69-ba4a-f268c0256ba0 {{(pid=87507) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 07:01:24 devstack cinder-volume[87507]: INFO cinder.image.image_utils [None req-7d4f9766-8341-4377-ae93-1bd10c711729 tempest-SnapshotDependencyTests-358211977 None] Converted 1024.00 MB image at 166.73 MB/s Sep 08 07:01:24 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-7d4f9766-8341-4377-ae93-1bd10c711729 tempest-SnapshotDependencyTests-358211977 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e4deff0c-ae04-4a69-ba4a-f268c0256ba0 is being set with open permissions: ugo+rw Sep 08 07:01:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7d4f9766-8341-4377-ae93-1bd10c711729 tempest-SnapshotDependencyTests-358211977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e4deff0c-ae04-4a69-ba4a-f268c0256ba0 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:24 devstack sudo[125314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e4deff0c-ae04-4a69-ba4a-f268c0256ba0 Sep 08 07:01:24 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-1f924165-76a5-4145-a636-5f5d7ef673e2 tempest-VolumeImageDependencyTests-1956159590 None] Created reservations ['388700a4-82c5-44ce-934f-0a37d0404acc', 'c83b114a-4076-4442-ba01-8e3984186f48', '868efcf1-97e9-4f41-ab68-08e5a3bc8abe', '51b37012-62bb-46c7-9664-10c48d0b5465'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:01:24 devstack sudo[125314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-1f924165-76a5-4145-a636-5f5d7ef673e2 tempest-VolumeImageDependencyTests-1956159590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-1f924165-76a5-4145-a636-5f5d7ef673e2 tempest-VolumeImageDependencyTests-1956159590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:24 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-1f924165-76a5-4145-a636-5f5d7ef673e2 tempest-VolumeImageDependencyTests-1956159590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:01:24 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-1f924165-76a5-4145-a636-5f5d7ef673e2 tempest-VolumeImageDependencyTests-1956159590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:01:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-1f924165-76a5-4145-a636-5f5d7ef673e2 tempest-VolumeImageDependencyTests-1956159590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1f924165-76a5-4145-a636-5f5d7ef673e2 tempest-VolumeImageDependencyTests-1956159590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:24 devstack sudo[125319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 07:01:24 devstack sudo[125319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:24 devstack sudo[125314]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7d4f9766-8341-4377-ae93-1bd10c711729 tempest-SnapshotDependencyTests-358211977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e4deff0c-ae04-4a69-ba4a-f268c0256ba0" returned: 0 in 0.343s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:24 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-7d4f9766-8341-4377-ae93-1bd10c711729 tempest-SnapshotDependencyTests-358211977 None] Lock "cinder-quobyte-e4deff0c-ae04-4a69-ba4a-f268c0256ba0" released by "_copy_volume_from_snapshot" :: held 7.544s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:01:24 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-7d4f9766-8341-4377-ae93-1bd10c711729 tempest-SnapshotDependencyTests-358211977 None] Lock "cinder-quobyte-102d1c44-88ab-4f67-ba9a-250b1e1043cf-e4deff0c-ae04-4a69-ba4a-f268c0256ba0" released by "_create_volume_from_snapshot" :: held 7.667s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:01:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-7d4f9766-8341-4377-ae93-1bd10c711729 tempest-SnapshotDependencyTests-358211977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.707s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-084da471-7c02-4ca8-8d47-973884db11c5 tempest-ProjectReaderTests-1152707596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.881s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:24 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-084da471-7c02-4ca8-8d47-973884db11c5 tempest-ProjectReaderTests-1152707596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:01:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1445261242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dea3e977-53b2-4408-abed-16d1d6048b0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c6367f07ddf4a4cb92e17a1b8b6bb5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:01:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:01:19Z,use_quota=True,user_id='0b8690b455d34f248f0182e09db083f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:01:24 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-084da471-7c02-4ca8-8d47-973884db11c5 tempest-ProjectReaderTests-1152707596 None] Creating volume dea3e977-53b2-4408-abed-16d1d6048b0c {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:01:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-084da471-7c02-4ca8-8d47-973884db11c5 tempest-ProjectReaderTests-1152707596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-084da471-7c02-4ca8-8d47-973884db11c5 tempest-ProjectReaderTests-1152707596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:24 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-084da471-7c02-4ca8-8d47-973884db11c5 tempest-ProjectReaderTests-1152707596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:01:24 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-084da471-7c02-4ca8-8d47-973884db11c5 tempest-ProjectReaderTests-1152707596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:01:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-084da471-7c02-4ca8-8d47-973884db11c5 tempest-ProjectReaderTests-1152707596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:24 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-084da471-7c02-4ca8-8d47-973884db11c5 tempest-ProjectReaderTests-1152707596 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:01:24 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-084da471-7c02-4ca8-8d47-973884db11c5 tempest-ProjectReaderTests-1152707596 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 07:01:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-084da471-7c02-4ca8-8d47-973884db11c5 tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dea3e977-53b2-4408-abed-16d1d6048b0c 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:25 devstack sudo[125319]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:25 devstack sudo[125332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dea3e977-53b2-4408-abed-16d1d6048b0c 1073741824 Sep 08 07:01:25 devstack sudo[125332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1f924165-76a5-4145-a636-5f5d7ef673e2 tempest-VolumeImageDependencyTests-1956159590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.359s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:25 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-1f924165-76a5-4145-a636-5f5d7ef673e2 tempest-VolumeImageDependencyTests-1956159590 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:01:25 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-1f924165-76a5-4145-a636-5f5d7ef673e2 tempest-VolumeImageDependencyTests-1956159590 None] Deleted volume successfully. Sep 08 07:01:25 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7d4f9766-8341-4377-ae93-1bd10c711729 tempest-SnapshotDependencyTests-358211977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b19f1079-7bd0-4ef5-bd6c-aacf7ca897f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4deff0c-ae04-4a69-ba4a-f268c0256ba0', 'volume_size': 1, 'snapshot_id': '102d1c44-88ab-4f67-ba9a-250b1e1043cf'}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:25 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7d4f9766-8341-4377-ae93-1bd10c711729 tempest-SnapshotDependencyTests-358211977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b564d3f5-d312-4b8d-bf0a-161eb4668040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:25 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-7d4f9766-8341-4377-ae93-1bd10c711729 tempest-SnapshotDependencyTests-358211977 None] Volume volume-e4deff0c-ae04-4a69-ba4a-f268c0256ba0 (e4deff0c-ae04-4a69-ba4a-f268c0256ba0): created successfully Sep 08 07:01:25 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7d4f9766-8341-4377-ae93-1bd10c711729 tempest-SnapshotDependencyTests-358211977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b564d3f5-d312-4b8d-bf0a-161eb4668040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:25 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-7d4f9766-8341-4377-ae93-1bd10c711729 tempest-SnapshotDependencyTests-358211977 None] Flow 'volume_create_manager' (0cbf1e34-4455-494c-8d6c-5c9601c2bd65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:01:25 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-1f924165-76a5-4145-a636-5f5d7ef673e2 tempest-VolumeImageDependencyTests-1956159590 None] Lock "cinder-a74bd485-574d-4677-9f8d-0394221a334a-delete_volume" released by "delete_volume" :: held 2.822s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:01:25 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-7d4f9766-8341-4377-ae93-1bd10c711729 tempest-SnapshotDependencyTests-358211977 None] Created volume successfully. Sep 08 07:01:25 devstack sudo[125332]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-084da471-7c02-4ca8-8d47-973884db11c5 tempest-ProjectReaderTests-1152707596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dea3e977-53b2-4408-abed-16d1d6048b0c 1073741824" returned: 0 in 0.557s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-084da471-7c02-4ca8-8d47-973884db11c5 tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dea3e977-53b2-4408-abed-16d1d6048b0c {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:25 devstack sudo[125356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dea3e977-53b2-4408-abed-16d1d6048b0c Sep 08 07:01:25 devstack sudo[125356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:25 devstack sudo[125356]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-084da471-7c02-4ca8-8d47-973884db11c5 tempest-ProjectReaderTests-1152707596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dea3e977-53b2-4408-abed-16d1d6048b0c" returned: 0 in 0.297s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:25 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-084da471-7c02-4ca8-8d47-973884db11c5 tempest-ProjectReaderTests-1152707596 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:01:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-084da471-7c02-4ca8-8d47-973884db11c5 tempest-ProjectReaderTests-1152707596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:25 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-084da471-7c02-4ca8-8d47-973884db11c5 tempest-ProjectReaderTests-1152707596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37a3b2ce-c7c8-435e-ad86-7888a89bf56b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dea3e977-53b2-4408-abed-16d1d6048b0c', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:25 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-084da471-7c02-4ca8-8d47-973884db11c5 tempest-ProjectReaderTests-1152707596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81a77d70-c70f-4272-be03-74cb137bfef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:25 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-084da471-7c02-4ca8-8d47-973884db11c5 tempest-ProjectReaderTests-1152707596 None] Volume volume-dea3e977-53b2-4408-abed-16d1d6048b0c (dea3e977-53b2-4408-abed-16d1d6048b0c): created successfully Sep 08 07:01:25 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-084da471-7c02-4ca8-8d47-973884db11c5 tempest-ProjectReaderTests-1152707596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81a77d70-c70f-4272-be03-74cb137bfef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:25 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-084da471-7c02-4ca8-8d47-973884db11c5 tempest-ProjectReaderTests-1152707596 None] Flow 'volume_create_manager' (91c5f251-043b-4207-960e-2ff9735db923) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:01:25 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-084da471-7c02-4ca8-8d47-973884db11c5 tempest-ProjectReaderTests-1152707596 None] Created volume successfully. Sep 08 07:01:26 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-c0302811-ca09-46f0-83ef-0371eaaf83a2 tempest-SnapshotDependencyTests-358211977 None] Acquiring lock "cinder-102d1c44-88ab-4f67-ba9a-250b1e1043cf-delete_snapshot" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:01:26 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-c0302811-ca09-46f0-83ef-0371eaaf83a2 tempest-SnapshotDependencyTests-358211977 None] Lock "cinder-102d1c44-88ab-4f67-ba9a-250b1e1043cf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:01:26 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-c0302811-ca09-46f0-83ef-0371eaaf83a2 tempest-SnapshotDependencyTests-358211977 None] Acquiring lock "cinder-quobyte-df0ab3e4-7154-4dd5-8131-e0cee86beb34" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:01:26 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-c0302811-ca09-46f0-83ef-0371eaaf83a2 tempest-SnapshotDependencyTests-358211977 None] Lock "cinder-quobyte-df0ab3e4-7154-4dd5-8131-e0cee86beb34" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:01:26 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-c0302811-ca09-46f0-83ef-0371eaaf83a2 tempest-SnapshotDependencyTests-358211977 None] Acquiring lock "cinder-quobyte-102d1c44-88ab-4f67-ba9a-250b1e1043cf" by "_delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:01:26 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-c0302811-ca09-46f0-83ef-0371eaaf83a2 tempest-SnapshotDependencyTests-358211977 None] Lock "cinder-quobyte-102d1c44-88ab-4f67-ba9a-250b1e1043cf" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:01:26 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-c0302811-ca09-46f0-83ef-0371eaaf83a2 tempest-SnapshotDependencyTests-358211977 None] Deleting offline snapshot 102d1c44-88ab-4f67-ba9a-250b1e1043cf of volume df0ab3e4-7154-4dd5-8131-e0cee86beb34 {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 07:01:26 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-c0302811-ca09-46f0-83ef-0371eaaf83a2 tempest-SnapshotDependencyTests-358211977 None] snapshot_file for this snap is: volume-df0ab3e4-7154-4dd5-8131-e0cee86beb34.102d1c44-88ab-4f67-ba9a-250b1e1043cf {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 07:01:26 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[743d4db1-52fe-401e-8213-74db6baf292f]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:01:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-c0302811-ca09-46f0-83ef-0371eaaf83a2 tempest-SnapshotDependencyTests-358211977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df0ab3e4-7154-4dd5-8131-e0cee86beb34.102d1c44-88ab-4f67-ba9a-250b1e1043cf {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:26 devstack sudo[125383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df0ab3e4-7154-4dd5-8131-e0cee86beb34.102d1c44-88ab-4f67-ba9a-250b1e1043cf Sep 08 07:01:26 devstack sudo[125383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:26 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8159b10-b1b3-4b28-9567-3b61e6dcfa87 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:01:26 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-e8159b10-b1b3-4b28-9567-3b61e6dcfa87 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Flow 'volume_create_manager' (5f502c74-0fed-4824-b36e-4f5b6bdcd29c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:01:26 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-e8159b10-b1b3-4b28-9567-3b61e6dcfa87 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15d733d1-29af-450a-a0e7-8c4d356c138c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:26 devstack cinder-volume[87507]: DEBUG dbcounter [-] [87507] Writing DB stats cinder:SELECT=140,cinder:UPDATE=194,cinder:INSERT=53,cinder:DELETE=20 {{(pid=87507) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:01:26 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-e8159b10-b1b3-4b28-9567-3b61e6dcfa87 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15d733d1-29af-450a-a0e7-8c4d356c138c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:01:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1271137273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=004d9f83-d614-49bd-a3e9-d4819f0d155d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c354875ecfb4a179f5a9af76951d762',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:01:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:01:27Z,use_quota=True,user_id='cd0534fb217442b98f8f3168e5f9cc6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:26 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-e8159b10-b1b3-4b28-9567-3b61e6dcfa87 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (749eaaa3-84ec-47e2-990e-0e0ee838e75c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:26 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-e8159b10-b1b3-4b28-9567-3b61e6dcfa87 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (749eaaa3-84ec-47e2-990e-0e0ee838e75c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:26 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-e8159b10-b1b3-4b28-9567-3b61e6dcfa87 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab7aee17-ed0b-4c6c-975a-05f3f751d271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:26 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-e8159b10-b1b3-4b28-9567-3b61e6dcfa87 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab7aee17-ed0b-4c6c-975a-05f3f751d271) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '004d9f83-d614-49bd-a3e9-d4819f0d155d', 'volume_name': 'volume-004d9f83-d614-49bd-a3e9-d4819f0d155d', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:26 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-e8159b10-b1b3-4b28-9567-3b61e6dcfa87 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a0257d6-83a5-47c1-a245-7f02cddc870b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:26 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-e8159b10-b1b3-4b28-9567-3b61e6dcfa87 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a0257d6-83a5-47c1-a245-7f02cddc870b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:26 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-e8159b10-b1b3-4b28-9567-3b61e6dcfa87 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4e2334f-ebd3-47ec-9d51-189b50700b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:26 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-e8159b10-b1b3-4b28-9567-3b61e6dcfa87 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Volume 004d9f83-d614-49bd-a3e9-d4819f0d155d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-004d9f83-d614-49bd-a3e9-d4819f0d155d', 'volume_size': 1} Sep 08 07:01:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-e8159b10-b1b3-4b28-9567-3b61e6dcfa87 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-e8159b10-b1b3-4b28-9567-3b61e6dcfa87 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:26 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-e8159b10-b1b3-4b28-9567-3b61e6dcfa87 tempest-CreateVolumesFromSnapshotTest-1375213394 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:01:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1271137273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=004d9f83-d614-49bd-a3e9-d4819f0d155d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c354875ecfb4a179f5a9af76951d762',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:01:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:01:27Z,use_quota=True,user_id='cd0534fb217442b98f8f3168e5f9cc6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:01:26 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-e8159b10-b1b3-4b28-9567-3b61e6dcfa87 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Creating volume 004d9f83-d614-49bd-a3e9-d4819f0d155d {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:01:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-e8159b10-b1b3-4b28-9567-3b61e6dcfa87 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-e8159b10-b1b3-4b28-9567-3b61e6dcfa87 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:26 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-e8159b10-b1b3-4b28-9567-3b61e6dcfa87 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:01:26 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-e8159b10-b1b3-4b28-9567-3b61e6dcfa87 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:01:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-e8159b10-b1b3-4b28-9567-3b61e6dcfa87 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:26 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-e8159b10-b1b3-4b28-9567-3b61e6dcfa87 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:01:26 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-e8159b10-b1b3-4b28-9567-3b61e6dcfa87 tempest-CreateVolumesFromSnapshotTest-1375213394 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 07:01:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e8159b10-b1b3-4b28-9567-3b61e6dcfa87 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-004d9f83-d614-49bd-a3e9-d4819f0d155d 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:26 devstack sudo[125437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-004d9f83-d614-49bd-a3e9-d4819f0d155d 1073741824 Sep 08 07:01:26 devstack sudo[125437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:27 devstack sudo[125383]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:27 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-9aa8b270-5feb-48cb-b888-1a4f7557dbad tempest-ProjectReaderTests-1152707596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:27 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-c0302811-ca09-46f0-83ef-0371eaaf83a2 tempest-SnapshotDependencyTests-358211977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df0ab3e4-7154-4dd5-8131-e0cee86beb34.102d1c44-88ab-4f67-ba9a-250b1e1043cf" returned: 0 in 0.612s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:27 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-c0302811-ca09-46f0-83ef-0371eaaf83a2 tempest-SnapshotDependencyTests-358211977 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df0ab3e4-7154-4dd5-8131-e0cee86beb34(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:01:27 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4746e575-6f78-420a-89cb-44183a6810b5]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:01:27 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-c0302811-ca09-46f0-83ef-0371eaaf83a2 tempest-SnapshotDependencyTests-358211977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df0ab3e4-7154-4dd5-8131-e0cee86beb34 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:27 devstack sudo[125442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df0ab3e4-7154-4dd5-8131-e0cee86beb34 Sep 08 07:01:27 devstack sudo[125442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:27 devstack sudo[125437]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:27 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e8159b10-b1b3-4b28-9567-3b61e6dcfa87 tempest-CreateVolumesFromSnapshotTest-1375213394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-004d9f83-d614-49bd-a3e9-d4819f0d155d 1073741824" returned: 0 in 0.589s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:27 devstack cinder-volume[87507]: DEBUG dbcounter [-] [87507] Writing DB stats cinder:SELECT=141,cinder:UPDATE=179,cinder:DELETE=15,cinder:INSERT=50 {{(pid=87507) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:01:27 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e8159b10-b1b3-4b28-9567-3b61e6dcfa87 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-004d9f83-d614-49bd-a3e9-d4819f0d155d {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:27 devstack sudo[125467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-004d9f83-d614-49bd-a3e9-d4819f0d155d Sep 08 07:01:27 devstack sudo[125467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:27 devstack sudo[125442]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:27 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-c0302811-ca09-46f0-83ef-0371eaaf83a2 tempest-SnapshotDependencyTests-358211977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df0ab3e4-7154-4dd5-8131-e0cee86beb34" returned: 0 in 0.675s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:27 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-c0302811-ca09-46f0-83ef-0371eaaf83a2 tempest-SnapshotDependencyTests-358211977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df0ab3e4-7154-4dd5-8131-e0cee86beb34.102d1c44-88ab-4f67-ba9a-250b1e1043cf {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:27 devstack sudo[125476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df0ab3e4-7154-4dd5-8131-e0cee86beb34.102d1c44-88ab-4f67-ba9a-250b1e1043cf Sep 08 07:01:27 devstack sudo[125476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:27 devstack sudo[125467]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:27 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e8159b10-b1b3-4b28-9567-3b61e6dcfa87 tempest-CreateVolumesFromSnapshotTest-1375213394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-004d9f83-d614-49bd-a3e9-d4819f0d155d" returned: 0 in 0.277s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:27 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-e8159b10-b1b3-4b28-9567-3b61e6dcfa87 tempest-CreateVolumesFromSnapshotTest-1375213394 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:01:27 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-e8159b10-b1b3-4b28-9567-3b61e6dcfa87 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:27 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-9aa8b270-5feb-48cb-b888-1a4f7557dbad tempest-ProjectReaderTests-1152707596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.803s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:27 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-e8159b10-b1b3-4b28-9567-3b61e6dcfa87 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4e2334f-ebd3-47ec-9d51-189b50700b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-004d9f83-d614-49bd-a3e9-d4819f0d155d', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:27 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-e8159b10-b1b3-4b28-9567-3b61e6dcfa87 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8b0beff-032e-4ffd-b19b-cc8eba1f786b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:27 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-9aa8b270-5feb-48cb-b888-1a4f7557dbad tempest-ProjectReaderTests-1152707596 None] Creating offline snapshot 31e2183e-02ca-4b4c-a0eb-78de8ea09c88 of volume dea3e977-53b2-4408-abed-16d1d6048b0c {{(pid=87507) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 07:01:27 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-e8159b10-b1b3-4b28-9567-3b61e6dcfa87 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Volume volume-004d9f83-d614-49bd-a3e9-d4819f0d155d (004d9f83-d614-49bd-a3e9-d4819f0d155d): created successfully Sep 08 07:01:27 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-e8159b10-b1b3-4b28-9567-3b61e6dcfa87 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8b0beff-032e-4ffd-b19b-cc8eba1f786b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:27 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-e8159b10-b1b3-4b28-9567-3b61e6dcfa87 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Flow 'volume_create_manager' (5f502c74-0fed-4824-b36e-4f5b6bdcd29c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:01:27 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[acdd2ed7-02e3-4dfa-baa9-147747d0f6d7]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:01:27 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9aa8b270-5feb-48cb-b888-1a4f7557dbad tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dea3e977-53b2-4408-abed-16d1d6048b0c {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:27 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-e8159b10-b1b3-4b28-9567-3b61e6dcfa87 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Created volume successfully. Sep 08 07:01:28 devstack sudo[125485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dea3e977-53b2-4408-abed-16d1d6048b0c Sep 08 07:01:28 devstack sudo[125485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:28 devstack sudo[125476]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:28 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-c0302811-ca09-46f0-83ef-0371eaaf83a2 tempest-SnapshotDependencyTests-358211977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df0ab3e4-7154-4dd5-8131-e0cee86beb34.102d1c44-88ab-4f67-ba9a-250b1e1043cf" returned: 0 in 0.431s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:28 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-c0302811-ca09-46f0-83ef-0371eaaf83a2 tempest-SnapshotDependencyTests-358211977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df0ab3e4-7154-4dd5-8131-e0cee86beb34.102d1c44-88ab-4f67-ba9a-250b1e1043cf {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:28 devstack sudo[125498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df0ab3e4-7154-4dd5-8131-e0cee86beb34.102d1c44-88ab-4f67-ba9a-250b1e1043cf Sep 08 07:01:28 devstack sudo[125498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:28 devstack sudo[125485]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:28 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9aa8b270-5feb-48cb-b888-1a4f7557dbad tempest-ProjectReaderTests-1152707596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dea3e977-53b2-4408-abed-16d1d6048b0c" returned: 0 in 0.461s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:28 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9aa8b270-5feb-48cb-b888-1a4f7557dbad tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dea3e977-53b2-4408-abed-16d1d6048b0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dea3e977-53b2-4408-abed-16d1d6048b0c.31e2183e-02ca-4b4c-a0eb-78de8ea09c88 1G {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:28 devstack sudo[125507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dea3e977-53b2-4408-abed-16d1d6048b0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dea3e977-53b2-4408-abed-16d1d6048b0c.31e2183e-02ca-4b4c-a0eb-78de8ea09c88 1G Sep 08 07:01:28 devstack sudo[125507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:28 devstack sudo[125498]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:28 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-c0302811-ca09-46f0-83ef-0371eaaf83a2 tempest-SnapshotDependencyTests-358211977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df0ab3e4-7154-4dd5-8131-e0cee86beb34.102d1c44-88ab-4f67-ba9a-250b1e1043cf" returned: 0 in 0.307s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:28 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-c0302811-ca09-46f0-83ef-0371eaaf83a2 tempest-SnapshotDependencyTests-358211977 None] Lock "cinder-quobyte-102d1c44-88ab-4f67-ba9a-250b1e1043cf" released by "_delete_snapshot" :: held 2.140s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:01:28 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-c0302811-ca09-46f0-83ef-0371eaaf83a2 tempest-SnapshotDependencyTests-358211977 None] Lock "cinder-quobyte-df0ab3e4-7154-4dd5-8131-e0cee86beb34" released by "delete_snapshot" :: held 2.179s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:01:28 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-c0302811-ca09-46f0-83ef-0371eaaf83a2 tempest-SnapshotDependencyTests-358211977 None] Created reservations ['e96116ff-ee03-49d9-81b1-cf9727f8876c', 'b651253a-88ef-4c04-b12e-3cd906dd1813', 'd38515f9-3064-44a9-8162-0dd19dcce640', '6525a151-8510-4a75-a918-7a89b2c65f60'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:01:28 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-c0302811-ca09-46f0-83ef-0371eaaf83a2 tempest-SnapshotDependencyTests-358211977 None] Delete snapshot completed successfully. Sep 08 07:01:28 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-c0302811-ca09-46f0-83ef-0371eaaf83a2 tempest-SnapshotDependencyTests-358211977 None] Lock "cinder-102d1c44-88ab-4f67-ba9a-250b1e1043cf-delete_snapshot" released by "delete_snapshot" :: held 2.360s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:01:28 devstack sudo[125507]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:28 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9aa8b270-5feb-48cb-b888-1a4f7557dbad tempest-ProjectReaderTests-1152707596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dea3e977-53b2-4408-abed-16d1d6048b0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dea3e977-53b2-4408-abed-16d1d6048b0c.31e2183e-02ca-4b4c-a0eb-78de8ea09c88 1G" returned: 0 in 0.495s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:28 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9aa8b270-5feb-48cb-b888-1a4f7557dbad tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dea3e977-53b2-4408-abed-16d1d6048b0c -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dea3e977-53b2-4408-abed-16d1d6048b0c.31e2183e-02ca-4b4c-a0eb-78de8ea09c88 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:28 devstack sudo[125529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dea3e977-53b2-4408-abed-16d1d6048b0c -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dea3e977-53b2-4408-abed-16d1d6048b0c.31e2183e-02ca-4b4c-a0eb-78de8ea09c88 Sep 08 07:01:28 devstack sudo[125529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:28 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-1e0c84cb-622d-4414-afa8-41e6fe0379a7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:29 devstack sudo[125529]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:29 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9aa8b270-5feb-48cb-b888-1a4f7557dbad tempest-ProjectReaderTests-1152707596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dea3e977-53b2-4408-abed-16d1d6048b0c -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dea3e977-53b2-4408-abed-16d1d6048b0c.31e2183e-02ca-4b4c-a0eb-78de8ea09c88" returned: 0 in 0.312s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:29 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-9aa8b270-5feb-48cb-b888-1a4f7557dbad tempest-ProjectReaderTests-1152707596 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dea3e977-53b2-4408-abed-16d1d6048b0c.31e2183e-02ca-4b4c-a0eb-78de8ea09c88 is being set with open permissions: ugo+rw Sep 08 07:01:29 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9aa8b270-5feb-48cb-b888-1a4f7557dbad tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dea3e977-53b2-4408-abed-16d1d6048b0c.31e2183e-02ca-4b4c-a0eb-78de8ea09c88 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:29 devstack sudo[125543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dea3e977-53b2-4408-abed-16d1d6048b0c.31e2183e-02ca-4b4c-a0eb-78de8ea09c88 Sep 08 07:01:29 devstack sudo[125543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:29 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5f58397-dbaa-439e-8f32-81f30c86451f tempest-ProjectMemberTests-411164925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:01:29 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b5f58397-dbaa-439e-8f32-81f30c86451f tempest-ProjectMemberTests-411164925 None] Flow 'volume_create_manager' (c293a161-0cdc-4889-9519-17178e450bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:01:29 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b5f58397-dbaa-439e-8f32-81f30c86451f tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51360452-0140-4661-83c4-db229db17b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:29 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b5f58397-dbaa-439e-8f32-81f30c86451f tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51360452-0140-4661-83c4-db229db17b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-630709103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c124cbd3-9c94-4db9-8713-dfc83a8e3c0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc639babed634473856ad52d77e5a6af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:01:29Z,use_quota=True,user_id='c850edcf996545b89f3d8d0b683570e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:29 devstack sudo[125543]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:29 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b5f58397-dbaa-439e-8f32-81f30c86451f tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9911763-f610-4783-b832-244e90be09c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:29 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b5f58397-dbaa-439e-8f32-81f30c86451f tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9911763-f610-4783-b832-244e90be09c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:29 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b5f58397-dbaa-439e-8f32-81f30c86451f tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b8e5a7b-0e38-4ae7-810e-e209d2fcc057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:29 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b5f58397-dbaa-439e-8f32-81f30c86451f tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b8e5a7b-0e38-4ae7-810e-e209d2fcc057) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c124cbd3-9c94-4db9-8713-dfc83a8e3c0a', 'volume_name': 'volume-c124cbd3-9c94-4db9-8713-dfc83a8e3c0a', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:29 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b5f58397-dbaa-439e-8f32-81f30c86451f tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a88c657b-655a-4e1f-a51f-260359802f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:29 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b5f58397-dbaa-439e-8f32-81f30c86451f tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a88c657b-655a-4e1f-a51f-260359802f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:29 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b5f58397-dbaa-439e-8f32-81f30c86451f tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad04f9b8-7890-4299-abad-bd471800b716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:29 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-b5f58397-dbaa-439e-8f32-81f30c86451f tempest-ProjectMemberTests-411164925 None] Volume c124cbd3-9c94-4db9-8713-dfc83a8e3c0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c124cbd3-9c94-4db9-8713-dfc83a8e3c0a', 'volume_size': 1} Sep 08 07:01:29 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b5f58397-dbaa-439e-8f32-81f30c86451f tempest-ProjectMemberTests-411164925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:29 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9aa8b270-5feb-48cb-b888-1a4f7557dbad tempest-ProjectReaderTests-1152707596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dea3e977-53b2-4408-abed-16d1d6048b0c.31e2183e-02ca-4b4c-a0eb-78de8ea09c88" returned: 0 in 0.302s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:29 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9aa8b270-5feb-48cb-b888-1a4f7557dbad tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dea3e977-53b2-4408-abed-16d1d6048b0c.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:29 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-5f6c32dc-2f13-482e-a694-69643e45c5ab tempest-SnapshotDependencyTests-358211977 None] Acquiring lock "cinder-df0ab3e4-7154-4dd5-8131-e0cee86beb34-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:01:29 devstack sudo[125559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dea3e977-53b2-4408-abed-16d1d6048b0c.info Sep 08 07:01:29 devstack sudo[125559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:29 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-5f6c32dc-2f13-482e-a694-69643e45c5ab tempest-SnapshotDependencyTests-358211977 None] Lock "cinder-df0ab3e4-7154-4dd5-8131-e0cee86beb34-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:01:29 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-5f6c32dc-2f13-482e-a694-69643e45c5ab tempest-SnapshotDependencyTests-358211977 None] Acquiring lock "cinder-quobyte-df0ab3e4-7154-4dd5-8131-e0cee86beb34" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:01:29 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-5f6c32dc-2f13-482e-a694-69643e45c5ab tempest-SnapshotDependencyTests-358211977 None] Lock "cinder-quobyte-df0ab3e4-7154-4dd5-8131-e0cee86beb34" acquired by "delete_volume" :: waited 0.016s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:01:29 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9992f5fb-3a62-4ea4-a4ae-cddd42f6e6c0]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:01:29 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5f6c32dc-2f13-482e-a694-69643e45c5ab tempest-SnapshotDependencyTests-358211977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df0ab3e4-7154-4dd5-8131-e0cee86beb34 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:29 devstack sudo[125564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df0ab3e4-7154-4dd5-8131-e0cee86beb34 Sep 08 07:01:29 devstack sudo[125564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:29 devstack sudo[125559]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:29 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9aa8b270-5feb-48cb-b888-1a4f7557dbad tempest-ProjectReaderTests-1152707596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dea3e977-53b2-4408-abed-16d1d6048b0c.info" returned: 0 in 0.256s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:29 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-9aa8b270-5feb-48cb-b888-1a4f7557dbad tempest-ProjectReaderTests-1152707596 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dea3e977-53b2-4408-abed-16d1d6048b0c.info is being set with open permissions: ugo+rw Sep 08 07:01:29 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9aa8b270-5feb-48cb-b888-1a4f7557dbad tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dea3e977-53b2-4408-abed-16d1d6048b0c.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:29 devstack sudo[125570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dea3e977-53b2-4408-abed-16d1d6048b0c.info Sep 08 07:01:29 devstack sudo[125570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:29 devstack sudo[125570]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:29 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9aa8b270-5feb-48cb-b888-1a4f7557dbad tempest-ProjectReaderTests-1152707596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dea3e977-53b2-4408-abed-16d1d6048b0c.info" returned: 0 in 0.253s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:30 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-9aa8b270-5feb-48cb-b888-1a4f7557dbad tempest-ProjectReaderTests-1152707596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.197s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:30 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-1e0c84cb-622d-4414-afa8-41e6fe0379a7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.055s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:30 devstack sudo[125564]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:30 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5f6c32dc-2f13-482e-a694-69643e45c5ab tempest-SnapshotDependencyTests-358211977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df0ab3e4-7154-4dd5-8131-e0cee86beb34" returned: 0 in 0.401s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:30 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5f6c32dc-2f13-482e-a694-69643e45c5ab tempest-SnapshotDependencyTests-358211977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df0ab3e4-7154-4dd5-8131-e0cee86beb34 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:30 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-1e0c84cb-622d-4414-afa8-41e6fe0379a7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Creating offline snapshot 6e9c25e1-cd85-4c8d-af67-b36613b3ad55 of volume 004d9f83-d614-49bd-a3e9-d4819f0d155d {{(pid=87507) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 07:01:30 devstack sudo[125586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df0ab3e4-7154-4dd5-8131-e0cee86beb34 Sep 08 07:01:30 devstack sudo[125586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:30 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-9aa8b270-5feb-48cb-b888-1a4f7557dbad tempest-ProjectReaderTests-1152707596 None] Create snapshot completed successfully Sep 08 07:01:30 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db832cf-8d4b-44e3-b6cb-db72a1ca6cd2]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:01:30 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1e0c84cb-622d-4414-afa8-41e6fe0379a7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-004d9f83-d614-49bd-a3e9-d4819f0d155d {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:30 devstack sudo[125591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-004d9f83-d614-49bd-a3e9-d4819f0d155d Sep 08 07:01:30 devstack sudo[125591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:30 devstack sudo[125586]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:30 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5f6c32dc-2f13-482e-a694-69643e45c5ab tempest-SnapshotDependencyTests-358211977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-df0ab3e4-7154-4dd5-8131-e0cee86beb34" returned: 0 in 0.285s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:30 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-5f6c32dc-2f13-482e-a694-69643e45c5ab tempest-SnapshotDependencyTests-358211977 None] Lock "cinder-quobyte-df0ab3e4-7154-4dd5-8131-e0cee86beb34" released by "delete_volume" :: held 0.746s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:01:30 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-5f6c32dc-2f13-482e-a694-69643e45c5ab tempest-SnapshotDependencyTests-358211977 None] Created reservations ['023d2e64-4488-4103-9637-d960b79df753', '9a4c3c1f-5805-4d84-ac98-8d3e7b1531fd', '553ffb9d-e921-4997-8c94-e8c7656b0950', '508ce851-5ce3-4a12-8320-10007b056dbb'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:01:30 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-5f6c32dc-2f13-482e-a694-69643e45c5ab tempest-SnapshotDependencyTests-358211977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:30 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-5f6c32dc-2f13-482e-a694-69643e45c5ab tempest-SnapshotDependencyTests-358211977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:30 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-5f6c32dc-2f13-482e-a694-69643e45c5ab tempest-SnapshotDependencyTests-358211977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:01:30 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-5f6c32dc-2f13-482e-a694-69643e45c5ab tempest-SnapshotDependencyTests-358211977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:01:30 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-5f6c32dc-2f13-482e-a694-69643e45c5ab tempest-SnapshotDependencyTests-358211977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:30 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5f6c32dc-2f13-482e-a694-69643e45c5ab tempest-SnapshotDependencyTests-358211977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:30 devstack sudo[125607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 07:01:30 devstack sudo[125607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:30 devstack sudo[125591]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:30 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1e0c84cb-622d-4414-afa8-41e6fe0379a7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-004d9f83-d614-49bd-a3e9-d4819f0d155d" returned: 0 in 0.399s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:30 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1e0c84cb-622d-4414-afa8-41e6fe0379a7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-004d9f83-d614-49bd-a3e9-d4819f0d155d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-004d9f83-d614-49bd-a3e9-d4819f0d155d.6e9c25e1-cd85-4c8d-af67-b36613b3ad55 1G {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:30 devstack sudo[125612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-004d9f83-d614-49bd-a3e9-d4819f0d155d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-004d9f83-d614-49bd-a3e9-d4819f0d155d.6e9c25e1-cd85-4c8d-af67-b36613b3ad55 1G Sep 08 07:01:30 devstack sudo[125612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:30 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-10f7a3e0-e4e2-4c5e-b868-cc4aa932ac6a tempest-SnapshotDependencyTests-358211977 None] Acquiring lock "cinder-e4deff0c-ae04-4a69-ba4a-f268c0256ba0-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:01:30 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-10f7a3e0-e4e2-4c5e-b868-cc4aa932ac6a tempest-SnapshotDependencyTests-358211977 None] Lock "cinder-e4deff0c-ae04-4a69-ba4a-f268c0256ba0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:01:30 devstack sudo[125607]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:30 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5f6c32dc-2f13-482e-a694-69643e45c5ab tempest-SnapshotDependencyTests-358211977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.294s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:30 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-5f6c32dc-2f13-482e-a694-69643e45c5ab tempest-SnapshotDependencyTests-358211977 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:01:30 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-10f7a3e0-e4e2-4c5e-b868-cc4aa932ac6a tempest-SnapshotDependencyTests-358211977 None] Acquiring lock "cinder-quobyte-e4deff0c-ae04-4a69-ba4a-f268c0256ba0" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:01:30 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-5f6c32dc-2f13-482e-a694-69643e45c5ab tempest-SnapshotDependencyTests-358211977 None] Deleted volume successfully. Sep 08 07:01:30 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-10f7a3e0-e4e2-4c5e-b868-cc4aa932ac6a tempest-SnapshotDependencyTests-358211977 None] Lock "cinder-quobyte-e4deff0c-ae04-4a69-ba4a-f268c0256ba0" acquired by "delete_volume" :: waited 0.024s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:01:30 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-5f6c32dc-2f13-482e-a694-69643e45c5ab tempest-SnapshotDependencyTests-358211977 None] Lock "cinder-df0ab3e4-7154-4dd5-8131-e0cee86beb34-delete_volume" released by "delete_volume" :: held 1.261s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:01:30 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df380a0-64ab-4748-b10e-3826280ad482]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:01:30 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-10f7a3e0-e4e2-4c5e-b868-cc4aa932ac6a tempest-SnapshotDependencyTests-358211977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e4deff0c-ae04-4a69-ba4a-f268c0256ba0 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:30 devstack sudo[125627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e4deff0c-ae04-4a69-ba4a-f268c0256ba0 Sep 08 07:01:30 devstack sudo[125627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:30 devstack sudo[125612]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:30 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1e0c84cb-622d-4414-afa8-41e6fe0379a7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-004d9f83-d614-49bd-a3e9-d4819f0d155d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-004d9f83-d614-49bd-a3e9-d4819f0d155d.6e9c25e1-cd85-4c8d-af67-b36613b3ad55 1G" returned: 0 in 0.461s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:30 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1e0c84cb-622d-4414-afa8-41e6fe0379a7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-004d9f83-d614-49bd-a3e9-d4819f0d155d -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-004d9f83-d614-49bd-a3e9-d4819f0d155d.6e9c25e1-cd85-4c8d-af67-b36613b3ad55 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:30 devstack sudo[125633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-004d9f83-d614-49bd-a3e9-d4819f0d155d -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-004d9f83-d614-49bd-a3e9-d4819f0d155d.6e9c25e1-cd85-4c8d-af67-b36613b3ad55 Sep 08 07:01:30 devstack sudo[125633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:31 devstack sudo[125627]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-10f7a3e0-e4e2-4c5e-b868-cc4aa932ac6a tempest-SnapshotDependencyTests-358211977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e4deff0c-ae04-4a69-ba4a-f268c0256ba0" returned: 0 in 0.439s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-10f7a3e0-e4e2-4c5e-b868-cc4aa932ac6a tempest-SnapshotDependencyTests-358211977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e4deff0c-ae04-4a69-ba4a-f268c0256ba0 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:31 devstack sudo[125650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e4deff0c-ae04-4a69-ba4a-f268c0256ba0 Sep 08 07:01:31 devstack sudo[125650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:31 devstack sudo[125633]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1e0c84cb-622d-4414-afa8-41e6fe0379a7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-004d9f83-d614-49bd-a3e9-d4819f0d155d -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-004d9f83-d614-49bd-a3e9-d4819f0d155d.6e9c25e1-cd85-4c8d-af67-b36613b3ad55" returned: 0 in 0.337s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:31 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-1e0c84cb-622d-4414-afa8-41e6fe0379a7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-004d9f83-d614-49bd-a3e9-d4819f0d155d.6e9c25e1-cd85-4c8d-af67-b36613b3ad55 is being set with open permissions: ugo+rw Sep 08 07:01:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1e0c84cb-622d-4414-afa8-41e6fe0379a7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-004d9f83-d614-49bd-a3e9-d4819f0d155d.6e9c25e1-cd85-4c8d-af67-b36613b3ad55 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:31 devstack sudo[125655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-004d9f83-d614-49bd-a3e9-d4819f0d155d.6e9c25e1-cd85-4c8d-af67-b36613b3ad55 Sep 08 07:01:31 devstack sudo[125655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:31 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-bb0a61c8-ac72-467c-beb4-bd42279aec11 tempest-ProjectReaderTests-1152707596 None] Acquiring lock "cinder-31e2183e-02ca-4b4c-a0eb-78de8ea09c88-delete_snapshot" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:01:31 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-bb0a61c8-ac72-467c-beb4-bd42279aec11 tempest-ProjectReaderTests-1152707596 None] Lock "cinder-31e2183e-02ca-4b4c-a0eb-78de8ea09c88-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:01:31 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-bb0a61c8-ac72-467c-beb4-bd42279aec11 tempest-ProjectReaderTests-1152707596 None] Acquiring lock "cinder-quobyte-dea3e977-53b2-4408-abed-16d1d6048b0c" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:01:31 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-bb0a61c8-ac72-467c-beb4-bd42279aec11 tempest-ProjectReaderTests-1152707596 None] Lock "cinder-quobyte-dea3e977-53b2-4408-abed-16d1d6048b0c" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:01:31 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-bb0a61c8-ac72-467c-beb4-bd42279aec11 tempest-ProjectReaderTests-1152707596 None] Acquiring lock "cinder-quobyte-31e2183e-02ca-4b4c-a0eb-78de8ea09c88" by "_delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:01:31 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-bb0a61c8-ac72-467c-beb4-bd42279aec11 tempest-ProjectReaderTests-1152707596 None] Lock "cinder-quobyte-31e2183e-02ca-4b4c-a0eb-78de8ea09c88" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:01:31 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-bb0a61c8-ac72-467c-beb4-bd42279aec11 tempest-ProjectReaderTests-1152707596 None] Deleting offline snapshot 31e2183e-02ca-4b4c-a0eb-78de8ea09c88 of volume dea3e977-53b2-4408-abed-16d1d6048b0c {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 07:01:31 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-bb0a61c8-ac72-467c-beb4-bd42279aec11 tempest-ProjectReaderTests-1152707596 None] snapshot_file for this snap is: volume-dea3e977-53b2-4408-abed-16d1d6048b0c.31e2183e-02ca-4b4c-a0eb-78de8ea09c88 {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 07:01:31 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c276f6d-d217-4f1b-826a-c755867a9d37]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:01:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bb0a61c8-ac72-467c-beb4-bd42279aec11 tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dea3e977-53b2-4408-abed-16d1d6048b0c.31e2183e-02ca-4b4c-a0eb-78de8ea09c88 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:31 devstack sudo[125650]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-10f7a3e0-e4e2-4c5e-b868-cc4aa932ac6a tempest-SnapshotDependencyTests-358211977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e4deff0c-ae04-4a69-ba4a-f268c0256ba0" returned: 0 in 0.292s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:31 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-10f7a3e0-e4e2-4c5e-b868-cc4aa932ac6a tempest-SnapshotDependencyTests-358211977 None] Lock "cinder-quobyte-e4deff0c-ae04-4a69-ba4a-f268c0256ba0" released by "delete_volume" :: held 0.781s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:01:31 devstack sudo[125655]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:31 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-10f7a3e0-e4e2-4c5e-b868-cc4aa932ac6a tempest-SnapshotDependencyTests-358211977 None] Created reservations ['a63d9e2a-d994-4487-ac8f-75fd687180d8', '57aba43a-e123-4afb-8634-76271e3e4c91', 'c50b4024-b2be-4724-8a6b-258132cb9aca', '9360f2f4-c23f-4064-be22-7155266bb67c'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:01:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1e0c84cb-622d-4414-afa8-41e6fe0379a7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-004d9f83-d614-49bd-a3e9-d4819f0d155d.6e9c25e1-cd85-4c8d-af67-b36613b3ad55" returned: 0 in 0.316s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:31 devstack sudo[125664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dea3e977-53b2-4408-abed-16d1d6048b0c.31e2183e-02ca-4b4c-a0eb-78de8ea09c88 Sep 08 07:01:31 devstack sudo[125664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1e0c84cb-622d-4414-afa8-41e6fe0379a7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-004d9f83-d614-49bd-a3e9-d4819f0d155d.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:31 devstack sudo[125670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-004d9f83-d614-49bd-a3e9-d4819f0d155d.info Sep 08 07:01:31 devstack sudo[125670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-10f7a3e0-e4e2-4c5e-b868-cc4aa932ac6a tempest-SnapshotDependencyTests-358211977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-10f7a3e0-e4e2-4c5e-b868-cc4aa932ac6a tempest-SnapshotDependencyTests-358211977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:31 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-10f7a3e0-e4e2-4c5e-b868-cc4aa932ac6a tempest-SnapshotDependencyTests-358211977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:01:31 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-10f7a3e0-e4e2-4c5e-b868-cc4aa932ac6a tempest-SnapshotDependencyTests-358211977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:01:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-10f7a3e0-e4e2-4c5e-b868-cc4aa932ac6a tempest-SnapshotDependencyTests-358211977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-10f7a3e0-e4e2-4c5e-b868-cc4aa932ac6a tempest-SnapshotDependencyTests-358211977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:31 devstack sudo[125675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 07:01:31 devstack sudo[125675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:31 devstack sudo[125670]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1e0c84cb-622d-4414-afa8-41e6fe0379a7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-004d9f83-d614-49bd-a3e9-d4819f0d155d.info" returned: 0 in 0.291s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:31 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-1e0c84cb-622d-4414-afa8-41e6fe0379a7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-004d9f83-d614-49bd-a3e9-d4819f0d155d.info is being set with open permissions: ugo+rw Sep 08 07:01:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1e0c84cb-622d-4414-afa8-41e6fe0379a7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-004d9f83-d614-49bd-a3e9-d4819f0d155d.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:31 devstack sudo[125664]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bb0a61c8-ac72-467c-beb4-bd42279aec11 tempest-ProjectReaderTests-1152707596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dea3e977-53b2-4408-abed-16d1d6048b0c.31e2183e-02ca-4b4c-a0eb-78de8ea09c88" returned: 0 in 0.447s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:31 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-bb0a61c8-ac72-467c-beb4-bd42279aec11 tempest-ProjectReaderTests-1152707596 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dea3e977-53b2-4408-abed-16d1d6048b0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:01:31 devstack sudo[125688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-004d9f83-d614-49bd-a3e9-d4819f0d155d.info Sep 08 07:01:31 devstack sudo[125688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:31 devstack sudo[125675]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-10f7a3e0-e4e2-4c5e-b868-cc4aa932ac6a tempest-SnapshotDependencyTests-358211977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.307s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:32 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-10f7a3e0-e4e2-4c5e-b868-cc4aa932ac6a tempest-SnapshotDependencyTests-358211977 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:01:32 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4184062a-01b9-4048-8ec7-396b57cf9735]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:01:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bb0a61c8-ac72-467c-beb4-bd42279aec11 tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dea3e977-53b2-4408-abed-16d1d6048b0c {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:32 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-10f7a3e0-e4e2-4c5e-b868-cc4aa932ac6a tempest-SnapshotDependencyTests-358211977 None] Deleted volume successfully. Sep 08 07:01:32 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-10f7a3e0-e4e2-4c5e-b868-cc4aa932ac6a tempest-SnapshotDependencyTests-358211977 None] Lock "cinder-e4deff0c-ae04-4a69-ba4a-f268c0256ba0-delete_volume" released by "delete_volume" :: held 1.370s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:01:32 devstack sudo[125693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dea3e977-53b2-4408-abed-16d1d6048b0c Sep 08 07:01:32 devstack sudo[125693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:32 devstack sudo[125688]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1e0c84cb-622d-4414-afa8-41e6fe0379a7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-004d9f83-d614-49bd-a3e9-d4819f0d155d.info" returned: 0 in 0.295s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-1e0c84cb-622d-4414-afa8-41e6fe0379a7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.246s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b5f58397-dbaa-439e-8f32-81f30c86451f tempest-ProjectMemberTests-411164925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.811s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:32 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-b5f58397-dbaa-439e-8f32-81f30c86451f tempest-ProjectMemberTests-411164925 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-630709103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c124cbd3-9c94-4db9-8713-dfc83a8e3c0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc639babed634473856ad52d77e5a6af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:01:29Z,use_quota=True,user_id='c850edcf996545b89f3d8d0b683570e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:01:32 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-b5f58397-dbaa-439e-8f32-81f30c86451f tempest-ProjectMemberTests-411164925 None] Creating volume c124cbd3-9c94-4db9-8713-dfc83a8e3c0a {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:01:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b5f58397-dbaa-439e-8f32-81f30c86451f tempest-ProjectMemberTests-411164925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b5f58397-dbaa-439e-8f32-81f30c86451f tempest-ProjectMemberTests-411164925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:32 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-b5f58397-dbaa-439e-8f32-81f30c86451f tempest-ProjectMemberTests-411164925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:01:32 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-b5f58397-dbaa-439e-8f32-81f30c86451f tempest-ProjectMemberTests-411164925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:01:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b5f58397-dbaa-439e-8f32-81f30c86451f tempest-ProjectMemberTests-411164925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:32 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-b5f58397-dbaa-439e-8f32-81f30c86451f tempest-ProjectMemberTests-411164925 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:01:32 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-b5f58397-dbaa-439e-8f32-81f30c86451f tempest-ProjectMemberTests-411164925 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 07:01:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b5f58397-dbaa-439e-8f32-81f30c86451f tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c124cbd3-9c94-4db9-8713-dfc83a8e3c0a 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:32 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-1e0c84cb-622d-4414-afa8-41e6fe0379a7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Create snapshot completed successfully Sep 08 07:01:32 devstack sudo[125704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c124cbd3-9c94-4db9-8713-dfc83a8e3c0a 1073741824 Sep 08 07:01:32 devstack sudo[125704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:32 devstack sudo[125693]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bb0a61c8-ac72-467c-beb4-bd42279aec11 tempest-ProjectReaderTests-1152707596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dea3e977-53b2-4408-abed-16d1d6048b0c" returned: 0 in 0.504s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bb0a61c8-ac72-467c-beb4-bd42279aec11 tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dea3e977-53b2-4408-abed-16d1d6048b0c.31e2183e-02ca-4b4c-a0eb-78de8ea09c88 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:32 devstack sudo[125717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dea3e977-53b2-4408-abed-16d1d6048b0c.31e2183e-02ca-4b4c-a0eb-78de8ea09c88 Sep 08 07:01:32 devstack sudo[125717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:32 devstack sudo[125704]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b5f58397-dbaa-439e-8f32-81f30c86451f tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c124cbd3-9c94-4db9-8713-dfc83a8e3c0a 1073741824" returned: 0 in 0.508s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b5f58397-dbaa-439e-8f32-81f30c86451f tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c124cbd3-9c94-4db9-8713-dfc83a8e3c0a {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:32 devstack sudo[125735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c124cbd3-9c94-4db9-8713-dfc83a8e3c0a Sep 08 07:01:32 devstack sudo[125735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:32 devstack sudo[125717]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bb0a61c8-ac72-467c-beb4-bd42279aec11 tempest-ProjectReaderTests-1152707596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dea3e977-53b2-4408-abed-16d1d6048b0c.31e2183e-02ca-4b4c-a0eb-78de8ea09c88" returned: 0 in 0.354s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bb0a61c8-ac72-467c-beb4-bd42279aec11 tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dea3e977-53b2-4408-abed-16d1d6048b0c.31e2183e-02ca-4b4c-a0eb-78de8ea09c88 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:32 devstack sudo[125737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dea3e977-53b2-4408-abed-16d1d6048b0c.31e2183e-02ca-4b4c-a0eb-78de8ea09c88 Sep 08 07:01:32 devstack sudo[125737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:33 devstack sudo[125735]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b5f58397-dbaa-439e-8f32-81f30c86451f tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c124cbd3-9c94-4db9-8713-dfc83a8e3c0a" returned: 0 in 0.251s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:33 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-b5f58397-dbaa-439e-8f32-81f30c86451f tempest-ProjectMemberTests-411164925 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:01:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b5f58397-dbaa-439e-8f32-81f30c86451f tempest-ProjectMemberTests-411164925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:33 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b5f58397-dbaa-439e-8f32-81f30c86451f tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad04f9b8-7890-4299-abad-bd471800b716) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c124cbd3-9c94-4db9-8713-dfc83a8e3c0a', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:33 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b5f58397-dbaa-439e-8f32-81f30c86451f tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a81d196-12f0-497b-b521-ab5391cb6396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:33 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-b5f58397-dbaa-439e-8f32-81f30c86451f tempest-ProjectMemberTests-411164925 None] Volume volume-c124cbd3-9c94-4db9-8713-dfc83a8e3c0a (c124cbd3-9c94-4db9-8713-dfc83a8e3c0a): created successfully Sep 08 07:01:33 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b5f58397-dbaa-439e-8f32-81f30c86451f tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a81d196-12f0-497b-b521-ab5391cb6396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:33 devstack sudo[125737]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:33 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-b5f58397-dbaa-439e-8f32-81f30c86451f tempest-ProjectMemberTests-411164925 None] Flow 'volume_create_manager' (c293a161-0cdc-4889-9519-17178e450bd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:01:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bb0a61c8-ac72-467c-beb4-bd42279aec11 tempest-ProjectReaderTests-1152707596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dea3e977-53b2-4408-abed-16d1d6048b0c.31e2183e-02ca-4b4c-a0eb-78de8ea09c88" returned: 0 in 0.283s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:33 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-bb0a61c8-ac72-467c-beb4-bd42279aec11 tempest-ProjectReaderTests-1152707596 None] Lock "cinder-quobyte-31e2183e-02ca-4b4c-a0eb-78de8ea09c88" released by "_delete_snapshot" :: held 1.723s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:01:33 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-b5f58397-dbaa-439e-8f32-81f30c86451f tempest-ProjectMemberTests-411164925 None] Created volume successfully. Sep 08 07:01:33 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-bb0a61c8-ac72-467c-beb4-bd42279aec11 tempest-ProjectReaderTests-1152707596 None] Lock "cinder-quobyte-dea3e977-53b2-4408-abed-16d1d6048b0c" released by "delete_snapshot" :: held 1.755s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:01:33 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-bb0a61c8-ac72-467c-beb4-bd42279aec11 tempest-ProjectReaderTests-1152707596 None] Created reservations ['b75c5bfd-9d0d-4acf-9ce6-f865c751cc9d', 'bb75c2b0-d342-48c7-a371-86edf0859a9b', '15a49c0d-b720-482b-8dd6-ef939be83edc', '3029039f-9962-4360-8298-d30f91a1cdf0'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:01:33 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-bb0a61c8-ac72-467c-beb4-bd42279aec11 tempest-ProjectReaderTests-1152707596 None] Delete snapshot completed successfully. Sep 08 07:01:33 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-bb0a61c8-ac72-467c-beb4-bd42279aec11 tempest-ProjectReaderTests-1152707596 None] Lock "cinder-31e2183e-02ca-4b4c-a0eb-78de8ea09c88-delete_snapshot" released by "delete_snapshot" :: held 2.005s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:01:33 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-bad72a4c-8c44-4b96-9b0c-0e2dee20b777 tempest-ProjectReaderTests-1152707596 None] Acquiring lock "cinder-dea3e977-53b2-4408-abed-16d1d6048b0c-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:01:33 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-bad72a4c-8c44-4b96-9b0c-0e2dee20b777 tempest-ProjectReaderTests-1152707596 None] Lock "cinder-dea3e977-53b2-4408-abed-16d1d6048b0c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:01:33 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-bad72a4c-8c44-4b96-9b0c-0e2dee20b777 tempest-ProjectReaderTests-1152707596 None] Acquiring lock "cinder-quobyte-dea3e977-53b2-4408-abed-16d1d6048b0c" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:01:33 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-bad72a4c-8c44-4b96-9b0c-0e2dee20b777 tempest-ProjectReaderTests-1152707596 None] Lock "cinder-quobyte-dea3e977-53b2-4408-abed-16d1d6048b0c" acquired by "delete_volume" :: waited 0.021s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:01:33 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9397fc0-c183-435c-a7c2-e14fed5cb463]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:01:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bad72a4c-8c44-4b96-9b0c-0e2dee20b777 tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dea3e977-53b2-4408-abed-16d1d6048b0c {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:33 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac4773cb-3f02-4d3b-9fc8-62c5ee0b7278 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:01:33 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ac4773cb-3f02-4d3b-9fc8-62c5ee0b7278 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Flow 'volume_create_manager' (0dcaac64-9707-4d4e-8960-8c02b79bbf69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:01:33 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ac4773cb-3f02-4d3b-9fc8-62c5ee0b7278 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2685a877-19df-4372-bad9-d612aae0f717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:33 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ac4773cb-3f02-4d3b-9fc8-62c5ee0b7278 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2685a877-19df-4372-bad9-d612aae0f717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:01:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-397877204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d216298f-bb6c-45ed-90de-b599a80502ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c354875ecfb4a179f5a9af76951d762',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:01:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:01:34Z,use_quota=True,user_id='cd0534fb217442b98f8f3168e5f9cc6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:33 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ac4773cb-3f02-4d3b-9fc8-62c5ee0b7278 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11412aed-9740-4ae0-978a-afa96b8479ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:33 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ac4773cb-3f02-4d3b-9fc8-62c5ee0b7278 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11412aed-9740-4ae0-978a-afa96b8479ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:33 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ac4773cb-3f02-4d3b-9fc8-62c5ee0b7278 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c4416e5-0bbe-4311-88a6-01caa1e21ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:33 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ac4773cb-3f02-4d3b-9fc8-62c5ee0b7278 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c4416e5-0bbe-4311-88a6-01caa1e21ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd216298f-bb6c-45ed-90de-b599a80502ad', 'volume_name': 'volume-d216298f-bb6c-45ed-90de-b599a80502ad', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:33 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ac4773cb-3f02-4d3b-9fc8-62c5ee0b7278 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65210a6c-4bdd-4c25-b7de-530ae31b0b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:33 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ac4773cb-3f02-4d3b-9fc8-62c5ee0b7278 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65210a6c-4bdd-4c25-b7de-530ae31b0b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:34 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ac4773cb-3f02-4d3b-9fc8-62c5ee0b7278 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0243b0e1-4c04-42e8-adaf-bf66986b0620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:34 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-ac4773cb-3f02-4d3b-9fc8-62c5ee0b7278 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Volume d216298f-bb6c-45ed-90de-b599a80502ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d216298f-bb6c-45ed-90de-b599a80502ad', 'volume_size': 1} Sep 08 07:01:34 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-ac4773cb-3f02-4d3b-9fc8-62c5ee0b7278 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:34 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-ac4773cb-3f02-4d3b-9fc8-62c5ee0b7278 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:34 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-ac4773cb-3f02-4d3b-9fc8-62c5ee0b7278 tempest-CreateVolumesFromSnapshotTest-1375213394 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:01:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-397877204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d216298f-bb6c-45ed-90de-b599a80502ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c354875ecfb4a179f5a9af76951d762',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:01:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:01:34Z,use_quota=True,user_id='cd0534fb217442b98f8f3168e5f9cc6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:01:34 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-ac4773cb-3f02-4d3b-9fc8-62c5ee0b7278 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Creating volume d216298f-bb6c-45ed-90de-b599a80502ad {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:01:34 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-ac4773cb-3f02-4d3b-9fc8-62c5ee0b7278 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:34 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-ac4773cb-3f02-4d3b-9fc8-62c5ee0b7278 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:34 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-ac4773cb-3f02-4d3b-9fc8-62c5ee0b7278 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:01:34 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-ac4773cb-3f02-4d3b-9fc8-62c5ee0b7278 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:01:34 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-ac4773cb-3f02-4d3b-9fc8-62c5ee0b7278 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:34 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-ac4773cb-3f02-4d3b-9fc8-62c5ee0b7278 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:01:34 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-ac4773cb-3f02-4d3b-9fc8-62c5ee0b7278 tempest-CreateVolumesFromSnapshotTest-1375213394 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 07:01:34 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ac4773cb-3f02-4d3b-9fc8-62c5ee0b7278 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d216298f-bb6c-45ed-90de-b599a80502ad 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:34 devstack sudo[125771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dea3e977-53b2-4408-abed-16d1d6048b0c Sep 08 07:01:34 devstack sudo[125771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:34 devstack sudo[125778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d216298f-bb6c-45ed-90de-b599a80502ad 1073741824 Sep 08 07:01:34 devstack sudo[125778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:34 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-052e6f24-6056-446c-812f-f3749a4dc2ef tempest-CreateVolumesFromSnapshotTest-1375213394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:01:34 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-052e6f24-6056-446c-812f-f3749a4dc2ef tempest-CreateVolumesFromSnapshotTest-1375213394 None] Flow 'volume_create_manager' (fa9a5e8f-1cdd-4a28-a0a0-461094a2ab06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:01:34 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-052e6f24-6056-446c-812f-f3749a4dc2ef tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fc0c317-2c11-41f4-867f-f4274197eae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:34 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-052e6f24-6056-446c-812f-f3749a4dc2ef tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fc0c317-2c11-41f4-867f-f4274197eae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:01:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2019213147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1a751bf-1a70-49b9-be0c-be10a550b86e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c354875ecfb4a179f5a9af76951d762',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:01:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:01:34Z,use_quota=True,user_id='cd0534fb217442b98f8f3168e5f9cc6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:34 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-052e6f24-6056-446c-812f-f3749a4dc2ef tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad0cd4e9-8e50-475f-8ce2-1bcd385c86b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:34 devstack sudo[125771]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:34 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-052e6f24-6056-446c-812f-f3749a4dc2ef tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad0cd4e9-8e50-475f-8ce2-1bcd385c86b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:34 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-052e6f24-6056-446c-812f-f3749a4dc2ef tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (785024a2-1006-4e86-8412-248a0305a7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:34 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-052e6f24-6056-446c-812f-f3749a4dc2ef tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (785024a2-1006-4e86-8412-248a0305a7bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1a751bf-1a70-49b9-be0c-be10a550b86e', 'volume_name': 'volume-e1a751bf-1a70-49b9-be0c-be10a550b86e', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:34 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-052e6f24-6056-446c-812f-f3749a4dc2ef tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (565e98dc-4922-471e-88b8-86f851a1a5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:34 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-052e6f24-6056-446c-812f-f3749a4dc2ef tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (565e98dc-4922-471e-88b8-86f851a1a5c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:34 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-052e6f24-6056-446c-812f-f3749a4dc2ef tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d79084ac-abe0-4966-8cc1-99fad370590c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:34 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-052e6f24-6056-446c-812f-f3749a4dc2ef tempest-CreateVolumesFromSnapshotTest-1375213394 None] Volume e1a751bf-1a70-49b9-be0c-be10a550b86e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1a751bf-1a70-49b9-be0c-be10a550b86e', 'volume_size': 1} Sep 08 07:01:34 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-052e6f24-6056-446c-812f-f3749a4dc2ef tempest-CreateVolumesFromSnapshotTest-1375213394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:34 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bad72a4c-8c44-4b96-9b0c-0e2dee20b777 tempest-ProjectReaderTests-1152707596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dea3e977-53b2-4408-abed-16d1d6048b0c" returned: 0 in 0.820s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:34 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bad72a4c-8c44-4b96-9b0c-0e2dee20b777 tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dea3e977-53b2-4408-abed-16d1d6048b0c {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:34 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-ee58c188-c0d6-47f1-be40-0782408d6a21 tempest-ProjectMemberTests-411164925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:34 devstack sudo[125805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dea3e977-53b2-4408-abed-16d1d6048b0c Sep 08 07:01:34 devstack sudo[125805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:34 devstack sudo[125778]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:34 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-6937310f-174c-4cd7-9ee4-53e10d2b3669 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:01:34 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6937310f-174c-4cd7-9ee4-53e10d2b3669 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Flow 'volume_create_manager' (b7a6a243-3912-4d92-b1e0-852f58d4b1b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:01:34 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6937310f-174c-4cd7-9ee4-53e10d2b3669 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42860e10-32f5-4662-882b-7481435159ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:34 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ac4773cb-3f02-4d3b-9fc8-62c5ee0b7278 tempest-CreateVolumesFromSnapshotTest-1375213394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d216298f-bb6c-45ed-90de-b599a80502ad 1073741824" returned: 0 in 0.820s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:34 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6937310f-174c-4cd7-9ee4-53e10d2b3669 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42860e10-32f5-4662-882b-7481435159ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:01:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-629693495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa318b77-8ac7-440d-8b3a-cb6ffdd672fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c354875ecfb4a179f5a9af76951d762',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:01:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:01:35Z,use_quota=True,user_id='cd0534fb217442b98f8f3168e5f9cc6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:34 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6937310f-174c-4cd7-9ee4-53e10d2b3669 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04bfcd8e-e838-4ad3-9bb9-9a3173d7fc29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:34 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6937310f-174c-4cd7-9ee4-53e10d2b3669 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04bfcd8e-e838-4ad3-9bb9-9a3173d7fc29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:34 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6937310f-174c-4cd7-9ee4-53e10d2b3669 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c957fbff-5863-4553-8d5c-5643703e6ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:34 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6937310f-174c-4cd7-9ee4-53e10d2b3669 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c957fbff-5863-4553-8d5c-5643703e6ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa318b77-8ac7-440d-8b3a-cb6ffdd672fc', 'volume_name': 'volume-fa318b77-8ac7-440d-8b3a-cb6ffdd672fc', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:34 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6937310f-174c-4cd7-9ee4-53e10d2b3669 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59d94275-3b56-4401-9b36-1bcdd7df3c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:34 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6937310f-174c-4cd7-9ee4-53e10d2b3669 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59d94275-3b56-4401-9b36-1bcdd7df3c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:34 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6937310f-174c-4cd7-9ee4-53e10d2b3669 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1700470-0c5c-4f57-b94a-54ee5cb3e227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:34 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-6937310f-174c-4cd7-9ee4-53e10d2b3669 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Volume fa318b77-8ac7-440d-8b3a-cb6ffdd672fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa318b77-8ac7-440d-8b3a-cb6ffdd672fc', 'volume_size': 1} Sep 08 07:01:34 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-6937310f-174c-4cd7-9ee4-53e10d2b3669 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:34 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ac4773cb-3f02-4d3b-9fc8-62c5ee0b7278 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d216298f-bb6c-45ed-90de-b599a80502ad {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:35 devstack sudo[125817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d216298f-bb6c-45ed-90de-b599a80502ad Sep 08 07:01:35 devstack sudo[125817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:35 devstack sudo[125805]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bad72a4c-8c44-4b96-9b0c-0e2dee20b777 tempest-ProjectReaderTests-1152707596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-dea3e977-53b2-4408-abed-16d1d6048b0c" returned: 0 in 0.440s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:35 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-bad72a4c-8c44-4b96-9b0c-0e2dee20b777 tempest-ProjectReaderTests-1152707596 None] Lock "cinder-quobyte-dea3e977-53b2-4408-abed-16d1d6048b0c" released by "delete_volume" :: held 1.393s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:01:35 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-bad72a4c-8c44-4b96-9b0c-0e2dee20b777 tempest-ProjectReaderTests-1152707596 None] Created reservations ['e7fe1987-057f-41d0-92eb-aaf23a204bc9', '31826b83-05d7-4a0c-a601-4e54109dd57a', '4a8b6fb5-5a48-4d83-bfcc-a167be073b7b', 'dea623b7-3ecb-4b57-9aee-22e18c2b0484'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:01:35 devstack sudo[125817]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ac4773cb-3f02-4d3b-9fc8-62c5ee0b7278 tempest-CreateVolumesFromSnapshotTest-1375213394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d216298f-bb6c-45ed-90de-b599a80502ad" returned: 0 in 0.370s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:35 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-ac4773cb-3f02-4d3b-9fc8-62c5ee0b7278 tempest-CreateVolumesFromSnapshotTest-1375213394 None] <== create_volume: return (1328ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:01:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-ac4773cb-3f02-4d3b-9fc8-62c5ee0b7278 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.332s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-052e6f24-6056-446c-812f-f3749a4dc2ef tempest-CreateVolumesFromSnapshotTest-1375213394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.693s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:35 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-052e6f24-6056-446c-812f-f3749a4dc2ef tempest-CreateVolumesFromSnapshotTest-1375213394 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:01:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2019213147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1a751bf-1a70-49b9-be0c-be10a550b86e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c354875ecfb4a179f5a9af76951d762',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:01:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:01:34Z,use_quota=True,user_id='cd0534fb217442b98f8f3168e5f9cc6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:01:35 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-052e6f24-6056-446c-812f-f3749a4dc2ef tempest-CreateVolumesFromSnapshotTest-1375213394 None] Creating volume e1a751bf-1a70-49b9-be0c-be10a550b86e {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:01:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-052e6f24-6056-446c-812f-f3749a4dc2ef tempest-CreateVolumesFromSnapshotTest-1375213394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-052e6f24-6056-446c-812f-f3749a4dc2ef tempest-CreateVolumesFromSnapshotTest-1375213394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:35 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-052e6f24-6056-446c-812f-f3749a4dc2ef tempest-CreateVolumesFromSnapshotTest-1375213394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:01:35 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-052e6f24-6056-446c-812f-f3749a4dc2ef tempest-CreateVolumesFromSnapshotTest-1375213394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:01:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-052e6f24-6056-446c-812f-f3749a4dc2ef tempest-CreateVolumesFromSnapshotTest-1375213394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:35 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-052e6f24-6056-446c-812f-f3749a4dc2ef tempest-CreateVolumesFromSnapshotTest-1375213394 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:01:35 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-052e6f24-6056-446c-812f-f3749a4dc2ef tempest-CreateVolumesFromSnapshotTest-1375213394 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 07:01:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-052e6f24-6056-446c-812f-f3749a4dc2ef tempest-CreateVolumesFromSnapshotTest-1375213394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e1a751bf-1a70-49b9-be0c-be10a550b86e 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-bad72a4c-8c44-4b96-9b0c-0e2dee20b777 tempest-ProjectReaderTests-1152707596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-bad72a4c-8c44-4b96-9b0c-0e2dee20b777 tempest-ProjectReaderTests-1152707596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:35 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-bad72a4c-8c44-4b96-9b0c-0e2dee20b777 tempest-ProjectReaderTests-1152707596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:01:35 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-bad72a4c-8c44-4b96-9b0c-0e2dee20b777 tempest-ProjectReaderTests-1152707596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:01:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-bad72a4c-8c44-4b96-9b0c-0e2dee20b777 tempest-ProjectReaderTests-1152707596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bad72a4c-8c44-4b96-9b0c-0e2dee20b777 tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ac4773cb-3f02-4d3b-9fc8-62c5ee0b7278 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0243b0e1-4c04-42e8-adaf-bf66986b0620) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d216298f-bb6c-45ed-90de-b599a80502ad', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:35 devstack sudo[125833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e1a751bf-1a70-49b9-be0c-be10a550b86e 1073741824 Sep 08 07:01:35 devstack sudo[125833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ac4773cb-3f02-4d3b-9fc8-62c5ee0b7278 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b3ca25e-d8b7-4d98-8ab3-affaa6e5baa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:35 devstack sudo[125834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 07:01:35 devstack sudo[125834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:35 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-ac4773cb-3f02-4d3b-9fc8-62c5ee0b7278 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Volume volume-d216298f-bb6c-45ed-90de-b599a80502ad (d216298f-bb6c-45ed-90de-b599a80502ad): created successfully Sep 08 07:01:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ac4773cb-3f02-4d3b-9fc8-62c5ee0b7278 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b3ca25e-d8b7-4d98-8ab3-affaa6e5baa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-ac4773cb-3f02-4d3b-9fc8-62c5ee0b7278 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Flow 'volume_create_manager' (0dcaac64-9707-4d4e-8960-8c02b79bbf69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:01:35 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-ac4773cb-3f02-4d3b-9fc8-62c5ee0b7278 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Created volume successfully. Sep 08 07:01:35 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-1653eb2b-b73b-420e-b9e0-4aeaabd9f9d7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:01:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1653eb2b-b73b-420e-b9e0-4aeaabd9f9d7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Flow 'volume_create_manager' (66aec4bc-8eda-44a4-89f4-5cfb6cf82bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:01:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1653eb2b-b73b-420e-b9e0-4aeaabd9f9d7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (204cafa3-1fb3-40e1-a028-afdef6d6b8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1653eb2b-b73b-420e-b9e0-4aeaabd9f9d7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (204cafa3-1fb3-40e1-a028-afdef6d6b8cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:01:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-226621677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28b69448-40e8-4506-a207-ed1971ac1e58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c354875ecfb4a179f5a9af76951d762',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:01:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:01:35Z,use_quota=True,user_id='cd0534fb217442b98f8f3168e5f9cc6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1653eb2b-b73b-420e-b9e0-4aeaabd9f9d7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fd75797-aa54-4bbf-88e5-ba5b9eddd67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1653eb2b-b73b-420e-b9e0-4aeaabd9f9d7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fd75797-aa54-4bbf-88e5-ba5b9eddd67f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1653eb2b-b73b-420e-b9e0-4aeaabd9f9d7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e202b38d-d6be-4a53-bc8e-dedb5332cac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1653eb2b-b73b-420e-b9e0-4aeaabd9f9d7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e202b38d-d6be-4a53-bc8e-dedb5332cac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28b69448-40e8-4506-a207-ed1971ac1e58', 'volume_name': 'volume-28b69448-40e8-4506-a207-ed1971ac1e58', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1653eb2b-b73b-420e-b9e0-4aeaabd9f9d7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2590136-122e-46ed-92eb-f2e352f20323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1653eb2b-b73b-420e-b9e0-4aeaabd9f9d7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2590136-122e-46ed-92eb-f2e352f20323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:35 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1653eb2b-b73b-420e-b9e0-4aeaabd9f9d7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72297942-1ef1-463e-92e4-683fd5228db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:35 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-1653eb2b-b73b-420e-b9e0-4aeaabd9f9d7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Volume 28b69448-40e8-4506-a207-ed1971ac1e58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28b69448-40e8-4506-a207-ed1971ac1e58', 'volume_size': 1} Sep 08 07:01:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-1653eb2b-b73b-420e-b9e0-4aeaabd9f9d7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:35 devstack sudo[125834]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bad72a4c-8c44-4b96-9b0c-0e2dee20b777 tempest-ProjectReaderTests-1152707596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.408s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:35 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-bad72a4c-8c44-4b96-9b0c-0e2dee20b777 tempest-ProjectReaderTests-1152707596 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:01:35 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-bad72a4c-8c44-4b96-9b0c-0e2dee20b777 tempest-ProjectReaderTests-1152707596 None] Deleted volume successfully. Sep 08 07:01:35 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-bad72a4c-8c44-4b96-9b0c-0e2dee20b777 tempest-ProjectReaderTests-1152707596 None] Lock "cinder-dea3e977-53b2-4408-abed-16d1d6048b0c-delete_volume" released by "delete_volume" :: held 2.144s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:01:36 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-36972ea1-779e-4099-996d-ee93de356478 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:01:36 devstack sudo[125833]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:36 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-36972ea1-779e-4099-996d-ee93de356478 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Flow 'volume_create_manager' (fae4dae2-0e4e-4711-94d1-935ed7ee8537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:01:36 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-36972ea1-779e-4099-996d-ee93de356478 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b594ea69-9c21-42e9-af46-1fbab54dc7f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-052e6f24-6056-446c-812f-f3749a4dc2ef tempest-CreateVolumesFromSnapshotTest-1375213394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e1a751bf-1a70-49b9-be0c-be10a550b86e 1073741824" returned: 0 in 0.722s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:36 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-36972ea1-779e-4099-996d-ee93de356478 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b594ea69-9c21-42e9-af46-1fbab54dc7f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:01:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-647696252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75596ec6-90a0-4cfd-91d6-0869f9697f60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c354875ecfb4a179f5a9af76951d762',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:01:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:01:36Z,use_quota=True,user_id='cd0534fb217442b98f8f3168e5f9cc6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:36 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-36972ea1-779e-4099-996d-ee93de356478 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (855cfb25-8922-4bd0-acfc-f8edeb370bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:36 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-36972ea1-779e-4099-996d-ee93de356478 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (855cfb25-8922-4bd0-acfc-f8edeb370bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:36 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-36972ea1-779e-4099-996d-ee93de356478 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02ab1bb1-9e4b-4f70-b4ff-1b9d5f142824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:36 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-36972ea1-779e-4099-996d-ee93de356478 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02ab1bb1-9e4b-4f70-b4ff-1b9d5f142824) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75596ec6-90a0-4cfd-91d6-0869f9697f60', 'volume_name': 'volume-75596ec6-90a0-4cfd-91d6-0869f9697f60', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:36 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-36972ea1-779e-4099-996d-ee93de356478 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de51738b-8538-4dcf-9f49-6000910863ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:36 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-36972ea1-779e-4099-996d-ee93de356478 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de51738b-8538-4dcf-9f49-6000910863ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:36 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-36972ea1-779e-4099-996d-ee93de356478 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d81f9dd5-98db-4877-9ff7-5291f37dbf78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:36 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-36972ea1-779e-4099-996d-ee93de356478 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Volume 75596ec6-90a0-4cfd-91d6-0869f9697f60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75596ec6-90a0-4cfd-91d6-0869f9697f60', 'volume_size': 1} Sep 08 07:01:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-36972ea1-779e-4099-996d-ee93de356478 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-052e6f24-6056-446c-812f-f3749a4dc2ef tempest-CreateVolumesFromSnapshotTest-1375213394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e1a751bf-1a70-49b9-be0c-be10a550b86e {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:36 devstack sudo[125872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e1a751bf-1a70-49b9-be0c-be10a550b86e Sep 08 07:01:36 devstack sudo[125872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:36 devstack sudo[125872]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-052e6f24-6056-446c-812f-f3749a4dc2ef tempest-CreateVolumesFromSnapshotTest-1375213394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e1a751bf-1a70-49b9-be0c-be10a550b86e" returned: 0 in 0.316s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:36 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-052e6f24-6056-446c-812f-f3749a4dc2ef tempest-CreateVolumesFromSnapshotTest-1375213394 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:01:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-052e6f24-6056-446c-812f-f3749a4dc2ef tempest-CreateVolumesFromSnapshotTest-1375213394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-ee58c188-c0d6-47f1-be40-0782408d6a21 tempest-ProjectMemberTests-411164925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.791s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:36 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-052e6f24-6056-446c-812f-f3749a4dc2ef tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d79084ac-abe0-4966-8cc1-99fad370590c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1a751bf-1a70-49b9-be0c-be10a550b86e', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:36 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-052e6f24-6056-446c-812f-f3749a4dc2ef tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2740b61-c94d-4551-ab3e-556b7a060b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:36 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-ee58c188-c0d6-47f1-be40-0782408d6a21 tempest-ProjectMemberTests-411164925 None] Creating offline snapshot dffb0440-1ad3-47af-a454-b96ac1b4d0cd of volume c124cbd3-9c94-4db9-8713-dfc83a8e3c0a {{(pid=87507) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 07:01:36 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-052e6f24-6056-446c-812f-f3749a4dc2ef tempest-CreateVolumesFromSnapshotTest-1375213394 None] Volume volume-e1a751bf-1a70-49b9-be0c-be10a550b86e (e1a751bf-1a70-49b9-be0c-be10a550b86e): created successfully Sep 08 07:01:36 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-052e6f24-6056-446c-812f-f3749a4dc2ef tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2740b61-c94d-4551-ab3e-556b7a060b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:36 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-052e6f24-6056-446c-812f-f3749a4dc2ef tempest-CreateVolumesFromSnapshotTest-1375213394 None] Flow 'volume_create_manager' (fa9a5e8f-1cdd-4a28-a0a0-461094a2ab06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:01:36 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee64b38-cc07-4b8a-8ae7-3dcfd93c1c3b]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:01:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ee58c188-c0d6-47f1-be40-0782408d6a21 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c124cbd3-9c94-4db9-8713-dfc83a8e3c0a {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:36 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-052e6f24-6056-446c-812f-f3749a4dc2ef tempest-CreateVolumesFromSnapshotTest-1375213394 None] Created volume successfully. Sep 08 07:01:36 devstack sudo[125887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c124cbd3-9c94-4db9-8713-dfc83a8e3c0a Sep 08 07:01:36 devstack sudo[125887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:36 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-76947630-d776-449d-a9e2-01179315f860 tempest-ProjectReaderTests-1152707596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:01:36 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-76947630-d776-449d-a9e2-01179315f860 tempest-ProjectReaderTests-1152707596 None] Flow 'volume_create_manager' (0c46786d-b1a4-4965-92a6-6e2232729ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:01:36 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-76947630-d776-449d-a9e2-01179315f860 tempest-ProjectReaderTests-1152707596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7833e319-a364-4209-8c52-e32a85c350c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:36 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-76947630-d776-449d-a9e2-01179315f860 tempest-ProjectReaderTests-1152707596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7833e319-a364-4209-8c52-e32a85c350c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:01:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1858650020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c6367f07ddf4a4cb92e17a1b8b6bb5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:01:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:01:37Z,use_quota=True,user_id='0b8690b455d34f248f0182e09db083f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:36 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-76947630-d776-449d-a9e2-01179315f860 tempest-ProjectReaderTests-1152707596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba46919f-f82e-4386-b8bb-f4c125a99452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:36 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-76947630-d776-449d-a9e2-01179315f860 tempest-ProjectReaderTests-1152707596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba46919f-f82e-4386-b8bb-f4c125a99452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:36 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-76947630-d776-449d-a9e2-01179315f860 tempest-ProjectReaderTests-1152707596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20511154-b3ca-4702-8b26-98c595d3775d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:36 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-76947630-d776-449d-a9e2-01179315f860 tempest-ProjectReaderTests-1152707596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20511154-b3ca-4702-8b26-98c595d3775d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9', 'volume_name': 'volume-c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:36 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-76947630-d776-449d-a9e2-01179315f860 tempest-ProjectReaderTests-1152707596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beec5673-0731-4041-a6d4-1449d2d892d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:36 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-76947630-d776-449d-a9e2-01179315f860 tempest-ProjectReaderTests-1152707596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beec5673-0731-4041-a6d4-1449d2d892d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:36 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-76947630-d776-449d-a9e2-01179315f860 tempest-ProjectReaderTests-1152707596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b324477e-e6b7-4a8d-80a0-cd3f15c837c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:36 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-76947630-d776-449d-a9e2-01179315f860 tempest-ProjectReaderTests-1152707596 None] Volume c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9', 'volume_size': 1} Sep 08 07:01:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-76947630-d776-449d-a9e2-01179315f860 tempest-ProjectReaderTests-1152707596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:36 devstack sudo[125887]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ee58c188-c0d6-47f1-be40-0782408d6a21 tempest-ProjectMemberTests-411164925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c124cbd3-9c94-4db9-8713-dfc83a8e3c0a" returned: 0 in 0.391s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ee58c188-c0d6-47f1-be40-0782408d6a21 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c124cbd3-9c94-4db9-8713-dfc83a8e3c0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c124cbd3-9c94-4db9-8713-dfc83a8e3c0a.dffb0440-1ad3-47af-a454-b96ac1b4d0cd 1G {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:36 devstack sudo[125904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c124cbd3-9c94-4db9-8713-dfc83a8e3c0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c124cbd3-9c94-4db9-8713-dfc83a8e3c0a.dffb0440-1ad3-47af-a454-b96ac1b4d0cd 1G Sep 08 07:01:36 devstack sudo[125904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:37 devstack sudo[125904]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ee58c188-c0d6-47f1-be40-0782408d6a21 tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c124cbd3-9c94-4db9-8713-dfc83a8e3c0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c124cbd3-9c94-4db9-8713-dfc83a8e3c0a.dffb0440-1ad3-47af-a454-b96ac1b4d0cd 1G" returned: 0 in 0.490s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ee58c188-c0d6-47f1-be40-0782408d6a21 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c124cbd3-9c94-4db9-8713-dfc83a8e3c0a -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c124cbd3-9c94-4db9-8713-dfc83a8e3c0a.dffb0440-1ad3-47af-a454-b96ac1b4d0cd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:37 devstack sudo[125925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c124cbd3-9c94-4db9-8713-dfc83a8e3c0a -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c124cbd3-9c94-4db9-8713-dfc83a8e3c0a.dffb0440-1ad3-47af-a454-b96ac1b4d0cd Sep 08 07:01:37 devstack sudo[125925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:37 devstack sudo[125925]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ee58c188-c0d6-47f1-be40-0782408d6a21 tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c124cbd3-9c94-4db9-8713-dfc83a8e3c0a -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c124cbd3-9c94-4db9-8713-dfc83a8e3c0a.dffb0440-1ad3-47af-a454-b96ac1b4d0cd" returned: 0 in 0.309s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:37 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-ee58c188-c0d6-47f1-be40-0782408d6a21 tempest-ProjectMemberTests-411164925 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c124cbd3-9c94-4db9-8713-dfc83a8e3c0a.dffb0440-1ad3-47af-a454-b96ac1b4d0cd is being set with open permissions: ugo+rw Sep 08 07:01:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ee58c188-c0d6-47f1-be40-0782408d6a21 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c124cbd3-9c94-4db9-8713-dfc83a8e3c0a.dffb0440-1ad3-47af-a454-b96ac1b4d0cd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:37 devstack sudo[125941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c124cbd3-9c94-4db9-8713-dfc83a8e3c0a.dffb0440-1ad3-47af-a454-b96ac1b4d0cd Sep 08 07:01:37 devstack sudo[125941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:38 devstack sudo[125941]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ee58c188-c0d6-47f1-be40-0782408d6a21 tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c124cbd3-9c94-4db9-8713-dfc83a8e3c0a.dffb0440-1ad3-47af-a454-b96ac1b4d0cd" returned: 0 in 0.269s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ee58c188-c0d6-47f1-be40-0782408d6a21 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c124cbd3-9c94-4db9-8713-dfc83a8e3c0a.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:38 devstack sudo[125953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c124cbd3-9c94-4db9-8713-dfc83a8e3c0a.info Sep 08 07:01:38 devstack sudo[125953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:38 devstack sudo[125953]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ee58c188-c0d6-47f1-be40-0782408d6a21 tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c124cbd3-9c94-4db9-8713-dfc83a8e3c0a.info" returned: 0 in 0.305s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:38 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-ee58c188-c0d6-47f1-be40-0782408d6a21 tempest-ProjectMemberTests-411164925 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c124cbd3-9c94-4db9-8713-dfc83a8e3c0a.info is being set with open permissions: ugo+rw Sep 08 07:01:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ee58c188-c0d6-47f1-be40-0782408d6a21 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c124cbd3-9c94-4db9-8713-dfc83a8e3c0a.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:38 devstack sudo[125966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c124cbd3-9c94-4db9-8713-dfc83a8e3c0a.info Sep 08 07:01:38 devstack sudo[125966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:38 devstack sudo[125966]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ee58c188-c0d6-47f1-be40-0782408d6a21 tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c124cbd3-9c94-4db9-8713-dfc83a8e3c0a.info" returned: 0 in 0.273s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-ee58c188-c0d6-47f1-be40-0782408d6a21 tempest-ProjectMemberTests-411164925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.179s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-6937310f-174c-4cd7-9ee4-53e10d2b3669 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.727s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:38 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-6937310f-174c-4cd7-9ee4-53e10d2b3669 tempest-CreateVolumesFromSnapshotTest-1375213394 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:01:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-629693495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa318b77-8ac7-440d-8b3a-cb6ffdd672fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c354875ecfb4a179f5a9af76951d762',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:01:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:01:35Z,use_quota=True,user_id='cd0534fb217442b98f8f3168e5f9cc6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:01:38 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-6937310f-174c-4cd7-9ee4-53e10d2b3669 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Creating volume fa318b77-8ac7-440d-8b3a-cb6ffdd672fc {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:01:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-6937310f-174c-4cd7-9ee4-53e10d2b3669 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-6937310f-174c-4cd7-9ee4-53e10d2b3669 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:38 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-6937310f-174c-4cd7-9ee4-53e10d2b3669 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:01:38 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-6937310f-174c-4cd7-9ee4-53e10d2b3669 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:01:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-6937310f-174c-4cd7-9ee4-53e10d2b3669 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:38 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-6937310f-174c-4cd7-9ee4-53e10d2b3669 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:01:38 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-6937310f-174c-4cd7-9ee4-53e10d2b3669 tempest-CreateVolumesFromSnapshotTest-1375213394 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 07:01:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6937310f-174c-4cd7-9ee4-53e10d2b3669 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-fa318b77-8ac7-440d-8b3a-cb6ffdd672fc 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:38 devstack sudo[125978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-fa318b77-8ac7-440d-8b3a-cb6ffdd672fc 1073741824 Sep 08 07:01:38 devstack sudo[125978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:38 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-ee58c188-c0d6-47f1-be40-0782408d6a21 tempest-ProjectMemberTests-411164925 None] Create snapshot completed successfully Sep 08 07:01:39 devstack sudo[125978]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6937310f-174c-4cd7-9ee4-53e10d2b3669 tempest-CreateVolumesFromSnapshotTest-1375213394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-fa318b77-8ac7-440d-8b3a-cb6ffdd672fc 1073741824" returned: 0 in 0.504s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6937310f-174c-4cd7-9ee4-53e10d2b3669 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-fa318b77-8ac7-440d-8b3a-cb6ffdd672fc {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:39 devstack sudo[126001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-fa318b77-8ac7-440d-8b3a-cb6ffdd672fc Sep 08 07:01:39 devstack sudo[126001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:39 devstack sudo[126001]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6937310f-174c-4cd7-9ee4-53e10d2b3669 tempest-CreateVolumesFromSnapshotTest-1375213394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-fa318b77-8ac7-440d-8b3a-cb6ffdd672fc" returned: 0 in 0.265s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:39 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-6937310f-174c-4cd7-9ee4-53e10d2b3669 tempest-CreateVolumesFromSnapshotTest-1375213394 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:01:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-6937310f-174c-4cd7-9ee4-53e10d2b3669 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-1653eb2b-b73b-420e-b9e0-4aeaabd9f9d7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.888s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:39 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-1653eb2b-b73b-420e-b9e0-4aeaabd9f9d7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:01:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-226621677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28b69448-40e8-4506-a207-ed1971ac1e58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c354875ecfb4a179f5a9af76951d762',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:01:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:01:35Z,use_quota=True,user_id='cd0534fb217442b98f8f3168e5f9cc6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:01:39 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-1653eb2b-b73b-420e-b9e0-4aeaabd9f9d7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Creating volume 28b69448-40e8-4506-a207-ed1971ac1e58 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:01:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-1653eb2b-b73b-420e-b9e0-4aeaabd9f9d7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-1653eb2b-b73b-420e-b9e0-4aeaabd9f9d7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:39 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-1653eb2b-b73b-420e-b9e0-4aeaabd9f9d7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:01:39 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-1653eb2b-b73b-420e-b9e0-4aeaabd9f9d7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:01:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-1653eb2b-b73b-420e-b9e0-4aeaabd9f9d7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:39 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-1653eb2b-b73b-420e-b9e0-4aeaabd9f9d7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:01:39 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-1653eb2b-b73b-420e-b9e0-4aeaabd9f9d7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 07:01:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1653eb2b-b73b-420e-b9e0-4aeaabd9f9d7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-28b69448-40e8-4506-a207-ed1971ac1e58 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:39 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6937310f-174c-4cd7-9ee4-53e10d2b3669 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1700470-0c5c-4f57-b94a-54ee5cb3e227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa318b77-8ac7-440d-8b3a-cb6ffdd672fc', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:39 devstack sudo[126013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-28b69448-40e8-4506-a207-ed1971ac1e58 1073741824 Sep 08 07:01:39 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6937310f-174c-4cd7-9ee4-53e10d2b3669 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2e711ae-37da-4b33-bfe7-50f1ff84b473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:39 devstack sudo[126013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:39 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-6937310f-174c-4cd7-9ee4-53e10d2b3669 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Volume volume-fa318b77-8ac7-440d-8b3a-cb6ffdd672fc (fa318b77-8ac7-440d-8b3a-cb6ffdd672fc): created successfully Sep 08 07:01:39 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6937310f-174c-4cd7-9ee4-53e10d2b3669 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2e711ae-37da-4b33-bfe7-50f1ff84b473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:39 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6937310f-174c-4cd7-9ee4-53e10d2b3669 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Flow 'volume_create_manager' (b7a6a243-3912-4d92-b1e0-852f58d4b1b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:01:39 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-6937310f-174c-4cd7-9ee4-53e10d2b3669 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Created volume successfully. Sep 08 07:01:39 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-b1574b5e-74e9-448c-b188-6868d08d46d1 tempest-ProjectMemberTests-411164925 None] Acquiring lock "cinder-dffb0440-1ad3-47af-a454-b96ac1b4d0cd-delete_snapshot" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:01:39 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-b1574b5e-74e9-448c-b188-6868d08d46d1 tempest-ProjectMemberTests-411164925 None] Lock "cinder-dffb0440-1ad3-47af-a454-b96ac1b4d0cd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:01:39 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-b1574b5e-74e9-448c-b188-6868d08d46d1 tempest-ProjectMemberTests-411164925 None] Acquiring lock "cinder-quobyte-c124cbd3-9c94-4db9-8713-dfc83a8e3c0a" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:01:39 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-b1574b5e-74e9-448c-b188-6868d08d46d1 tempest-ProjectMemberTests-411164925 None] Lock "cinder-quobyte-c124cbd3-9c94-4db9-8713-dfc83a8e3c0a" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:01:39 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-b1574b5e-74e9-448c-b188-6868d08d46d1 tempest-ProjectMemberTests-411164925 None] Acquiring lock "cinder-quobyte-dffb0440-1ad3-47af-a454-b96ac1b4d0cd" by "_delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:01:39 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-b1574b5e-74e9-448c-b188-6868d08d46d1 tempest-ProjectMemberTests-411164925 None] Lock "cinder-quobyte-dffb0440-1ad3-47af-a454-b96ac1b4d0cd" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:01:39 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-b1574b5e-74e9-448c-b188-6868d08d46d1 tempest-ProjectMemberTests-411164925 None] Deleting offline snapshot dffb0440-1ad3-47af-a454-b96ac1b4d0cd of volume c124cbd3-9c94-4db9-8713-dfc83a8e3c0a {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 07:01:39 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-b1574b5e-74e9-448c-b188-6868d08d46d1 tempest-ProjectMemberTests-411164925 None] snapshot_file for this snap is: volume-c124cbd3-9c94-4db9-8713-dfc83a8e3c0a.dffb0440-1ad3-47af-a454-b96ac1b4d0cd {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 07:01:39 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8415be7-9e74-4732-a150-33a3c9ca4d6b]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:01:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b1574b5e-74e9-448c-b188-6868d08d46d1 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c124cbd3-9c94-4db9-8713-dfc83a8e3c0a.dffb0440-1ad3-47af-a454-b96ac1b4d0cd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:39 devstack sudo[126028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c124cbd3-9c94-4db9-8713-dfc83a8e3c0a.dffb0440-1ad3-47af-a454-b96ac1b4d0cd Sep 08 07:01:39 devstack sudo[126028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:40 devstack sudo[126013]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1653eb2b-b73b-420e-b9e0-4aeaabd9f9d7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-28b69448-40e8-4506-a207-ed1971ac1e58 1073741824" returned: 0 in 0.583s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1653eb2b-b73b-420e-b9e0-4aeaabd9f9d7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-28b69448-40e8-4506-a207-ed1971ac1e58 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:40 devstack sudo[126040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-28b69448-40e8-4506-a207-ed1971ac1e58 Sep 08 07:01:40 devstack sudo[126040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:40 devstack sudo[126028]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b1574b5e-74e9-448c-b188-6868d08d46d1 tempest-ProjectMemberTests-411164925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c124cbd3-9c94-4db9-8713-dfc83a8e3c0a.dffb0440-1ad3-47af-a454-b96ac1b4d0cd" returned: 0 in 0.451s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:40 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-b1574b5e-74e9-448c-b188-6868d08d46d1 tempest-ProjectMemberTests-411164925 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c124cbd3-9c94-4db9-8713-dfc83a8e3c0a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:01:40 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[81537359-7570-4c3a-9f9e-7f7de6ca8112]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:01:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b1574b5e-74e9-448c-b188-6868d08d46d1 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c124cbd3-9c94-4db9-8713-dfc83a8e3c0a {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:40 devstack sudo[126040]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:40 devstack sudo[126052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c124cbd3-9c94-4db9-8713-dfc83a8e3c0a Sep 08 07:01:40 devstack sudo[126052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1653eb2b-b73b-420e-b9e0-4aeaabd9f9d7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-28b69448-40e8-4506-a207-ed1971ac1e58" returned: 0 in 0.298s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:40 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-1653eb2b-b73b-420e-b9e0-4aeaabd9f9d7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:01:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-1653eb2b-b73b-420e-b9e0-4aeaabd9f9d7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-36972ea1-779e-4099-996d-ee93de356478 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.293s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:40 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-36972ea1-779e-4099-996d-ee93de356478 tempest-CreateVolumesFromSnapshotTest-1375213394 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:01:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-647696252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75596ec6-90a0-4cfd-91d6-0869f9697f60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c354875ecfb4a179f5a9af76951d762',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:01:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:01:36Z,use_quota=True,user_id='cd0534fb217442b98f8f3168e5f9cc6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:01:40 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-36972ea1-779e-4099-996d-ee93de356478 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Creating volume 75596ec6-90a0-4cfd-91d6-0869f9697f60 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:01:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-36972ea1-779e-4099-996d-ee93de356478 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-36972ea1-779e-4099-996d-ee93de356478 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:40 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-36972ea1-779e-4099-996d-ee93de356478 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:01:40 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-36972ea1-779e-4099-996d-ee93de356478 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:01:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-36972ea1-779e-4099-996d-ee93de356478 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:40 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-36972ea1-779e-4099-996d-ee93de356478 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:01:40 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-36972ea1-779e-4099-996d-ee93de356478 tempest-CreateVolumesFromSnapshotTest-1375213394 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 07:01:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-36972ea1-779e-4099-996d-ee93de356478 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-75596ec6-90a0-4cfd-91d6-0869f9697f60 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1653eb2b-b73b-420e-b9e0-4aeaabd9f9d7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72297942-1ef1-463e-92e4-683fd5228db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28b69448-40e8-4506-a207-ed1971ac1e58', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:40 devstack sudo[126058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-75596ec6-90a0-4cfd-91d6-0869f9697f60 1073741824 Sep 08 07:01:40 devstack sudo[126058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1653eb2b-b73b-420e-b9e0-4aeaabd9f9d7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a987ed0-f69c-4c5a-9948-280426adc2a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:40 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-1653eb2b-b73b-420e-b9e0-4aeaabd9f9d7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Volume volume-28b69448-40e8-4506-a207-ed1971ac1e58 (28b69448-40e8-4506-a207-ed1971ac1e58): created successfully Sep 08 07:01:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1653eb2b-b73b-420e-b9e0-4aeaabd9f9d7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a987ed0-f69c-4c5a-9948-280426adc2a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-1653eb2b-b73b-420e-b9e0-4aeaabd9f9d7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Flow 'volume_create_manager' (66aec4bc-8eda-44a4-89f4-5cfb6cf82bcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:01:40 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-1653eb2b-b73b-420e-b9e0-4aeaabd9f9d7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Created volume successfully. Sep 08 07:01:40 devstack sudo[126052]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b1574b5e-74e9-448c-b188-6868d08d46d1 tempest-ProjectMemberTests-411164925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c124cbd3-9c94-4db9-8713-dfc83a8e3c0a" returned: 0 in 0.388s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b1574b5e-74e9-448c-b188-6868d08d46d1 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c124cbd3-9c94-4db9-8713-dfc83a8e3c0a.dffb0440-1ad3-47af-a454-b96ac1b4d0cd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:40 devstack sudo[126073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c124cbd3-9c94-4db9-8713-dfc83a8e3c0a.dffb0440-1ad3-47af-a454-b96ac1b4d0cd Sep 08 07:01:40 devstack sudo[126073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:40 devstack sudo[126058]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-36972ea1-779e-4099-996d-ee93de356478 tempest-CreateVolumesFromSnapshotTest-1375213394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-75596ec6-90a0-4cfd-91d6-0869f9697f60 1073741824" returned: 0 in 0.543s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-36972ea1-779e-4099-996d-ee93de356478 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-75596ec6-90a0-4cfd-91d6-0869f9697f60 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:41 devstack sudo[126090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-75596ec6-90a0-4cfd-91d6-0869f9697f60 Sep 08 07:01:41 devstack sudo[126090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:41 devstack sudo[126073]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b1574b5e-74e9-448c-b188-6868d08d46d1 tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c124cbd3-9c94-4db9-8713-dfc83a8e3c0a.dffb0440-1ad3-47af-a454-b96ac1b4d0cd" returned: 0 in 0.424s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b1574b5e-74e9-448c-b188-6868d08d46d1 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c124cbd3-9c94-4db9-8713-dfc83a8e3c0a.dffb0440-1ad3-47af-a454-b96ac1b4d0cd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:41 devstack sudo[126096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c124cbd3-9c94-4db9-8713-dfc83a8e3c0a.dffb0440-1ad3-47af-a454-b96ac1b4d0cd Sep 08 07:01:41 devstack sudo[126096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:41 devstack sudo[126090]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-36972ea1-779e-4099-996d-ee93de356478 tempest-CreateVolumesFromSnapshotTest-1375213394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-75596ec6-90a0-4cfd-91d6-0869f9697f60" returned: 0 in 0.258s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:41 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-36972ea1-779e-4099-996d-ee93de356478 tempest-CreateVolumesFromSnapshotTest-1375213394 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:01:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-36972ea1-779e-4099-996d-ee93de356478 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-76947630-d776-449d-a9e2-01179315f860 tempest-ProjectReaderTests-1152707596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.399s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:41 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-76947630-d776-449d-a9e2-01179315f860 tempest-ProjectReaderTests-1152707596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:01:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1858650020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c6367f07ddf4a4cb92e17a1b8b6bb5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:01:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:01:37Z,use_quota=True,user_id='0b8690b455d34f248f0182e09db083f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:01:41 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-76947630-d776-449d-a9e2-01179315f860 tempest-ProjectReaderTests-1152707596 None] Creating volume c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:01:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-76947630-d776-449d-a9e2-01179315f860 tempest-ProjectReaderTests-1152707596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-76947630-d776-449d-a9e2-01179315f860 tempest-ProjectReaderTests-1152707596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:41 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-76947630-d776-449d-a9e2-01179315f860 tempest-ProjectReaderTests-1152707596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:01:41 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-76947630-d776-449d-a9e2-01179315f860 tempest-ProjectReaderTests-1152707596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:01:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-76947630-d776-449d-a9e2-01179315f860 tempest-ProjectReaderTests-1152707596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:41 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-76947630-d776-449d-a9e2-01179315f860 tempest-ProjectReaderTests-1152707596 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:01:41 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-76947630-d776-449d-a9e2-01179315f860 tempest-ProjectReaderTests-1152707596 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 07:01:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-76947630-d776-449d-a9e2-01179315f860 tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:41 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-36972ea1-779e-4099-996d-ee93de356478 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d81f9dd5-98db-4877-9ff7-5291f37dbf78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75596ec6-90a0-4cfd-91d6-0869f9697f60', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:41 devstack sudo[126105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9 1073741824 Sep 08 07:01:41 devstack sudo[126105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:41 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-36972ea1-779e-4099-996d-ee93de356478 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e160bfa-45b5-49a4-87b6-5decefb79145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:41 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-36972ea1-779e-4099-996d-ee93de356478 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Volume volume-75596ec6-90a0-4cfd-91d6-0869f9697f60 (75596ec6-90a0-4cfd-91d6-0869f9697f60): created successfully Sep 08 07:01:41 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-36972ea1-779e-4099-996d-ee93de356478 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e160bfa-45b5-49a4-87b6-5decefb79145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:41 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-36972ea1-779e-4099-996d-ee93de356478 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Flow 'volume_create_manager' (fae4dae2-0e4e-4711-94d1-935ed7ee8537) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:01:41 devstack sudo[126096]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b1574b5e-74e9-448c-b188-6868d08d46d1 tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c124cbd3-9c94-4db9-8713-dfc83a8e3c0a.dffb0440-1ad3-47af-a454-b96ac1b4d0cd" returned: 0 in 0.267s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:41 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-36972ea1-779e-4099-996d-ee93de356478 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Created volume successfully. Sep 08 07:01:41 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-b1574b5e-74e9-448c-b188-6868d08d46d1 tempest-ProjectMemberTests-411164925 None] Lock "cinder-quobyte-dffb0440-1ad3-47af-a454-b96ac1b4d0cd" released by "_delete_snapshot" :: held 1.646s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:01:41 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-b1574b5e-74e9-448c-b188-6868d08d46d1 tempest-ProjectMemberTests-411164925 None] Lock "cinder-quobyte-c124cbd3-9c94-4db9-8713-dfc83a8e3c0a" released by "delete_snapshot" :: held 1.677s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:01:41 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-b1574b5e-74e9-448c-b188-6868d08d46d1 tempest-ProjectMemberTests-411164925 None] Created reservations ['4cc0dd0c-62f8-47ba-911d-a8a05fd42c76', 'f659decb-4e7d-46e9-b245-46be741d79ff', '8ca6466d-7003-4353-9fdf-8136f87b359e', '88a11dbf-3f9a-4ee3-960a-3ff3952422da'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:01:41 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-b1574b5e-74e9-448c-b188-6868d08d46d1 tempest-ProjectMemberTests-411164925 None] Delete snapshot completed successfully. Sep 08 07:01:41 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-b1574b5e-74e9-448c-b188-6868d08d46d1 tempest-ProjectMemberTests-411164925 None] Lock "cinder-dffb0440-1ad3-47af-a454-b96ac1b4d0cd-delete_snapshot" released by "delete_snapshot" :: held 1.829s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:01:41 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-a26cafdf-0e51-42e6-ac91-cda730d87ba9 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Acquiring lock "cinder-75596ec6-90a0-4cfd-91d6-0869f9697f60-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:01:41 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-a26cafdf-0e51-42e6-ac91-cda730d87ba9 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Lock "cinder-75596ec6-90a0-4cfd-91d6-0869f9697f60-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:01:41 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-a26cafdf-0e51-42e6-ac91-cda730d87ba9 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Acquiring lock "cinder-quobyte-75596ec6-90a0-4cfd-91d6-0869f9697f60" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:01:41 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-a26cafdf-0e51-42e6-ac91-cda730d87ba9 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Lock "cinder-quobyte-75596ec6-90a0-4cfd-91d6-0869f9697f60" acquired by "delete_volume" :: waited 0.016s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:01:41 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc791d44-8a9b-4b7f-83f9-023f3122ea70]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:01:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a26cafdf-0e51-42e6-ac91-cda730d87ba9 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-75596ec6-90a0-4cfd-91d6-0869f9697f60 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:41 devstack sudo[126105]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-76947630-d776-449d-a9e2-01179315f860 tempest-ProjectReaderTests-1152707596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9 1073741824" returned: 0 in 0.506s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:41 devstack sudo[126123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-75596ec6-90a0-4cfd-91d6-0869f9697f60 Sep 08 07:01:41 devstack sudo[126123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-76947630-d776-449d-a9e2-01179315f860 tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:41 devstack sudo[126128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9 Sep 08 07:01:41 devstack sudo[126128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:41 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-dd04d965-cfa8-456e-a005-2f941c04a815 tempest-ProjectMemberTests-411164925 None] Acquiring lock "cinder-c124cbd3-9c94-4db9-8713-dfc83a8e3c0a-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:01:41 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-dd04d965-cfa8-456e-a005-2f941c04a815 tempest-ProjectMemberTests-411164925 None] Lock "cinder-c124cbd3-9c94-4db9-8713-dfc83a8e3c0a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:01:42 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-dd04d965-cfa8-456e-a005-2f941c04a815 tempest-ProjectMemberTests-411164925 None] Acquiring lock "cinder-quobyte-c124cbd3-9c94-4db9-8713-dfc83a8e3c0a" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:01:42 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-dd04d965-cfa8-456e-a005-2f941c04a815 tempest-ProjectMemberTests-411164925 None] Lock "cinder-quobyte-c124cbd3-9c94-4db9-8713-dfc83a8e3c0a" acquired by "delete_volume" :: waited 0.032s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:01:42 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdad2fe1-cbee-4ff3-8fe8-f9631391157a]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:01:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-dd04d965-cfa8-456e-a005-2f941c04a815 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c124cbd3-9c94-4db9-8713-dfc83a8e3c0a {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:42 devstack sudo[126123]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a26cafdf-0e51-42e6-ac91-cda730d87ba9 tempest-CreateVolumesFromSnapshotTest-1375213394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-75596ec6-90a0-4cfd-91d6-0869f9697f60" returned: 0 in 0.547s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a26cafdf-0e51-42e6-ac91-cda730d87ba9 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-75596ec6-90a0-4cfd-91d6-0869f9697f60 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:42 devstack sudo[126149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-75596ec6-90a0-4cfd-91d6-0869f9697f60 Sep 08 07:01:42 devstack sudo[126149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:42 devstack sudo[126145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c124cbd3-9c94-4db9-8713-dfc83a8e3c0a Sep 08 07:01:42 devstack sudo[126145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:42 devstack sudo[126128]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-76947630-d776-449d-a9e2-01179315f860 tempest-ProjectReaderTests-1152707596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9" returned: 0 in 0.508s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:42 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-76947630-d776-449d-a9e2-01179315f860 tempest-ProjectReaderTests-1152707596 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:01:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-76947630-d776-449d-a9e2-01179315f860 tempest-ProjectReaderTests-1152707596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:42 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-76947630-d776-449d-a9e2-01179315f860 tempest-ProjectReaderTests-1152707596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b324477e-e6b7-4a8d-80a0-cd3f15c837c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:42 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-76947630-d776-449d-a9e2-01179315f860 tempest-ProjectReaderTests-1152707596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d9b30db-e43c-4233-9cae-f1fae708e574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:42 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-76947630-d776-449d-a9e2-01179315f860 tempest-ProjectReaderTests-1152707596 None] Volume volume-c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9 (c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9): created successfully Sep 08 07:01:42 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-76947630-d776-449d-a9e2-01179315f860 tempest-ProjectReaderTests-1152707596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d9b30db-e43c-4233-9cae-f1fae708e574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:42 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-76947630-d776-449d-a9e2-01179315f860 tempest-ProjectReaderTests-1152707596 None] Flow 'volume_create_manager' (0c46786d-b1a4-4965-92a6-6e2232729ecd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:01:42 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-76947630-d776-449d-a9e2-01179315f860 tempest-ProjectReaderTests-1152707596 None] Created volume successfully. Sep 08 07:01:42 devstack sudo[126149]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a26cafdf-0e51-42e6-ac91-cda730d87ba9 tempest-CreateVolumesFromSnapshotTest-1375213394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-75596ec6-90a0-4cfd-91d6-0869f9697f60" returned: 0 in 0.322s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:42 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-a26cafdf-0e51-42e6-ac91-cda730d87ba9 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Lock "cinder-quobyte-75596ec6-90a0-4cfd-91d6-0869f9697f60" released by "delete_volume" :: held 0.914s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:01:42 devstack sudo[126145]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-dd04d965-cfa8-456e-a005-2f941c04a815 tempest-ProjectMemberTests-411164925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c124cbd3-9c94-4db9-8713-dfc83a8e3c0a" returned: 0 in 0.459s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-dd04d965-cfa8-456e-a005-2f941c04a815 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c124cbd3-9c94-4db9-8713-dfc83a8e3c0a {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:42 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-a26cafdf-0e51-42e6-ac91-cda730d87ba9 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Created reservations ['e40d1e91-28db-4ce2-bdc9-9d56ef82aab8', 'cf8d6171-3800-4e65-88fc-0209626833c1', '93b1e703-50de-40b3-bc64-1bab61736548', '03ca5f09-56f4-4b7b-ab99-7eb32bb61ae0'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:01:42 devstack sudo[126170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c124cbd3-9c94-4db9-8713-dfc83a8e3c0a Sep 08 07:01:42 devstack sudo[126170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a26cafdf-0e51-42e6-ac91-cda730d87ba9 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a26cafdf-0e51-42e6-ac91-cda730d87ba9 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:42 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-a26cafdf-0e51-42e6-ac91-cda730d87ba9 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:01:42 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-a26cafdf-0e51-42e6-ac91-cda730d87ba9 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:01:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a26cafdf-0e51-42e6-ac91-cda730d87ba9 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a26cafdf-0e51-42e6-ac91-cda730d87ba9 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:42 devstack sudo[126175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 07:01:42 devstack sudo[126175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:42 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-8bc770f4-9335-4425-967f-3e7096b1acef tempest-CreateVolumesFromSnapshotTest-1375213394 None] Acquiring lock "cinder-28b69448-40e8-4506-a207-ed1971ac1e58-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:01:42 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-8bc770f4-9335-4425-967f-3e7096b1acef tempest-CreateVolumesFromSnapshotTest-1375213394 None] Lock "cinder-28b69448-40e8-4506-a207-ed1971ac1e58-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:01:42 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-8bc770f4-9335-4425-967f-3e7096b1acef tempest-CreateVolumesFromSnapshotTest-1375213394 None] Acquiring lock "cinder-quobyte-28b69448-40e8-4506-a207-ed1971ac1e58" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:01:42 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-8bc770f4-9335-4425-967f-3e7096b1acef tempest-CreateVolumesFromSnapshotTest-1375213394 None] Lock "cinder-quobyte-28b69448-40e8-4506-a207-ed1971ac1e58" acquired by "delete_volume" :: waited 0.027s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:01:42 devstack sudo[126170]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-dd04d965-cfa8-456e-a005-2f941c04a815 tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c124cbd3-9c94-4db9-8713-dfc83a8e3c0a" returned: 0 in 0.343s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:42 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0127f6a-948b-434e-998d-b0b8fe8fb11c]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:01:42 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-dd04d965-cfa8-456e-a005-2f941c04a815 tempest-ProjectMemberTests-411164925 None] Lock "cinder-quobyte-c124cbd3-9c94-4db9-8713-dfc83a8e3c0a" released by "delete_volume" :: held 0.903s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:01:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8bc770f4-9335-4425-967f-3e7096b1acef tempest-CreateVolumesFromSnapshotTest-1375213394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-28b69448-40e8-4506-a207-ed1971ac1e58 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:43 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-dd04d965-cfa8-456e-a005-2f941c04a815 tempest-ProjectMemberTests-411164925 None] Created reservations ['b6f4a9db-b20d-4428-9752-d5bbd7c395cc', '165bb6b6-a5f1-40f4-a90c-66f1750a7a0f', 'f8c46a9f-708d-45dc-904d-a775fde38edc', '90f3ec64-3e1c-43d2-bac1-428e2012b590'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:01:43 devstack sudo[126175]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a26cafdf-0e51-42e6-ac91-cda730d87ba9 tempest-CreateVolumesFromSnapshotTest-1375213394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.400s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:43 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-a26cafdf-0e51-42e6-ac91-cda730d87ba9 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:01:43 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-a26cafdf-0e51-42e6-ac91-cda730d87ba9 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Deleted volume successfully. Sep 08 07:01:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-dd04d965-cfa8-456e-a005-2f941c04a815 tempest-ProjectMemberTests-411164925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-dd04d965-cfa8-456e-a005-2f941c04a815 tempest-ProjectMemberTests-411164925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:43 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-dd04d965-cfa8-456e-a005-2f941c04a815 tempest-ProjectMemberTests-411164925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:01:43 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-dd04d965-cfa8-456e-a005-2f941c04a815 tempest-ProjectMemberTests-411164925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:01:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-dd04d965-cfa8-456e-a005-2f941c04a815 tempest-ProjectMemberTests-411164925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-dd04d965-cfa8-456e-a005-2f941c04a815 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:43 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-a26cafdf-0e51-42e6-ac91-cda730d87ba9 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Lock "cinder-75596ec6-90a0-4cfd-91d6-0869f9697f60-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:01:43 devstack sudo[126196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 07:01:43 devstack sudo[126196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:43 devstack sudo[126187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-28b69448-40e8-4506-a207-ed1971ac1e58 Sep 08 07:01:43 devstack sudo[126187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:43 devstack sudo[126196]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-dd04d965-cfa8-456e-a005-2f941c04a815 tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.360s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:43 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-dd04d965-cfa8-456e-a005-2f941c04a815 tempest-ProjectMemberTests-411164925 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:01:43 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-dd04d965-cfa8-456e-a005-2f941c04a815 tempest-ProjectMemberTests-411164925 None] Deleted volume successfully. Sep 08 07:01:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-89ac702b-a0b1-4b60-980a-f811c1fd7885 tempest-ProjectReaderTests-1152707596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-89ac702b-a0b1-4b60-980a-f811c1fd7885 tempest-ProjectReaderTests-1152707596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:43 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-dd04d965-cfa8-456e-a005-2f941c04a815 tempest-ProjectMemberTests-411164925 None] Lock "cinder-c124cbd3-9c94-4db9-8713-dfc83a8e3c0a-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:01:43 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-89ac702b-a0b1-4b60-980a-f811c1fd7885 tempest-ProjectReaderTests-1152707596 None] Creating offline snapshot 1bd7baa9-0da8-4d30-952b-56584606b44d of volume c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9 {{(pid=87507) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 07:01:43 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d6b5fc-1f3e-4a97-880b-ad32c96c409d]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:01:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-89ac702b-a0b1-4b60-980a-f811c1fd7885 tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:43 devstack sudo[126187]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8bc770f4-9335-4425-967f-3e7096b1acef tempest-CreateVolumesFromSnapshotTest-1375213394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-28b69448-40e8-4506-a207-ed1971ac1e58" returned: 0 in 0.720s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8bc770f4-9335-4425-967f-3e7096b1acef tempest-CreateVolumesFromSnapshotTest-1375213394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-28b69448-40e8-4506-a207-ed1971ac1e58 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:43 devstack sudo[126220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-28b69448-40e8-4506-a207-ed1971ac1e58 Sep 08 07:01:43 devstack sudo[126220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:43 devstack sudo[126216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9 Sep 08 07:01:43 devstack sudo[126216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:44 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-4158129f-6b4f-4205-9129-3e9b849e1227 tempest-ProjectMemberTests-411164925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:01:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4158129f-6b4f-4205-9129-3e9b849e1227 tempest-ProjectMemberTests-411164925 None] Flow 'volume_create_manager' (112ffdfd-14a0-4378-bd3b-870633bc1fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:01:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4158129f-6b4f-4205-9129-3e9b849e1227 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf134395-c297-43e1-a9ac-f252a5423981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4158129f-6b4f-4205-9129-3e9b849e1227 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf134395-c297-43e1-a9ac-f252a5423981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:01:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1541198481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ed6e326-27fc-4f84-97f9-b0bf0dd542e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc639babed634473856ad52d77e5a6af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:01:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:01:44Z,use_quota=True,user_id='c850edcf996545b89f3d8d0b683570e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4158129f-6b4f-4205-9129-3e9b849e1227 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20d1c0ee-04f9-411c-bdf5-79f9d5a05a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:44 devstack sudo[126220]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4158129f-6b4f-4205-9129-3e9b849e1227 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20d1c0ee-04f9-411c-bdf5-79f9d5a05a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4158129f-6b4f-4205-9129-3e9b849e1227 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bccc4ddf-4c2b-4bee-b275-bb83b59b5e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4158129f-6b4f-4205-9129-3e9b849e1227 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bccc4ddf-4c2b-4bee-b275-bb83b59b5e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ed6e326-27fc-4f84-97f9-b0bf0dd542e5', 'volume_name': 'volume-5ed6e326-27fc-4f84-97f9-b0bf0dd542e5', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4158129f-6b4f-4205-9129-3e9b849e1227 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91e67761-1341-4f79-a1ba-074bb0f152b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4158129f-6b4f-4205-9129-3e9b849e1227 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91e67761-1341-4f79-a1ba-074bb0f152b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:44 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4158129f-6b4f-4205-9129-3e9b849e1227 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e2967d6-cb5a-4f54-8ca3-a54bf8d051a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:44 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-4158129f-6b4f-4205-9129-3e9b849e1227 tempest-ProjectMemberTests-411164925 None] Volume 5ed6e326-27fc-4f84-97f9-b0bf0dd542e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ed6e326-27fc-4f84-97f9-b0bf0dd542e5', 'volume_size': 1} Sep 08 07:01:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4158129f-6b4f-4205-9129-3e9b849e1227 tempest-ProjectMemberTests-411164925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8bc770f4-9335-4425-967f-3e7096b1acef tempest-CreateVolumesFromSnapshotTest-1375213394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-28b69448-40e8-4506-a207-ed1971ac1e58" returned: 0 in 0.443s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:44 devstack sudo[126216]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:44 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-8bc770f4-9335-4425-967f-3e7096b1acef tempest-CreateVolumesFromSnapshotTest-1375213394 None] Lock "cinder-quobyte-28b69448-40e8-4506-a207-ed1971ac1e58" released by "delete_volume" :: held 1.235s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:01:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-89ac702b-a0b1-4b60-980a-f811c1fd7885 tempest-ProjectReaderTests-1152707596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9" returned: 0 in 0.520s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-89ac702b-a0b1-4b60-980a-f811c1fd7885 tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9.1bd7baa9-0da8-4d30-952b-56584606b44d 1G {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:44 devstack sudo[126239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9.1bd7baa9-0da8-4d30-952b-56584606b44d 1G Sep 08 07:01:44 devstack sudo[126239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:44 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-8bc770f4-9335-4425-967f-3e7096b1acef tempest-CreateVolumesFromSnapshotTest-1375213394 None] Created reservations ['960a8273-0ea9-41a7-8f1b-c17fd957406b', '73d3efda-64a2-4cf5-b1f8-02d392a125a7', 'a2feacd1-82d7-4049-bde4-b3f2f5fb69bf', '901ae748-4f34-4149-b574-3aecd8ee7d2b'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:01:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8bc770f4-9335-4425-967f-3e7096b1acef tempest-CreateVolumesFromSnapshotTest-1375213394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8bc770f4-9335-4425-967f-3e7096b1acef tempest-CreateVolumesFromSnapshotTest-1375213394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:44 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8bc770f4-9335-4425-967f-3e7096b1acef tempest-CreateVolumesFromSnapshotTest-1375213394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:01:44 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8bc770f4-9335-4425-967f-3e7096b1acef tempest-CreateVolumesFromSnapshotTest-1375213394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:01:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8bc770f4-9335-4425-967f-3e7096b1acef tempest-CreateVolumesFromSnapshotTest-1375213394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8bc770f4-9335-4425-967f-3e7096b1acef tempest-CreateVolumesFromSnapshotTest-1375213394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:44 devstack sudo[126247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 07:01:44 devstack sudo[126247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:44 devstack sudo[126239]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-89ac702b-a0b1-4b60-980a-f811c1fd7885 tempest-ProjectReaderTests-1152707596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9.1bd7baa9-0da8-4d30-952b-56584606b44d 1G" returned: 0 in 0.498s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-89ac702b-a0b1-4b60-980a-f811c1fd7885 tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9.1bd7baa9-0da8-4d30-952b-56584606b44d {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:44 devstack sudo[126247]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8bc770f4-9335-4425-967f-3e7096b1acef tempest-CreateVolumesFromSnapshotTest-1375213394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.308s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:44 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-8bc770f4-9335-4425-967f-3e7096b1acef tempest-CreateVolumesFromSnapshotTest-1375213394 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:01:44 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-8bc770f4-9335-4425-967f-3e7096b1acef tempest-CreateVolumesFromSnapshotTest-1375213394 None] Deleted volume successfully. Sep 08 07:01:44 devstack sudo[126263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9.1bd7baa9-0da8-4d30-952b-56584606b44d Sep 08 07:01:44 devstack sudo[126263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:44 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-8bc770f4-9335-4425-967f-3e7096b1acef tempest-CreateVolumesFromSnapshotTest-1375213394 None] Lock "cinder-28b69448-40e8-4506-a207-ed1971ac1e58-delete_volume" released by "delete_volume" :: held 1.878s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:01:45 devstack sudo[126263]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-89ac702b-a0b1-4b60-980a-f811c1fd7885 tempest-ProjectReaderTests-1152707596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9.1bd7baa9-0da8-4d30-952b-56584606b44d" returned: 0 in 0.358s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:45 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-89ac702b-a0b1-4b60-980a-f811c1fd7885 tempest-ProjectReaderTests-1152707596 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9.1bd7baa9-0da8-4d30-952b-56584606b44d is being set with open permissions: ugo+rw Sep 08 07:01:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-89ac702b-a0b1-4b60-980a-f811c1fd7885 tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9.1bd7baa9-0da8-4d30-952b-56584606b44d {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:45 devstack sudo[126281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9.1bd7baa9-0da8-4d30-952b-56584606b44d Sep 08 07:01:45 devstack sudo[126281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:45 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-8e1022b7-e2c8-4b82-9721-f9a0ee2166fc tempest-CreateVolumesFromSnapshotTest-1375213394 None] Acquiring lock "cinder-fa318b77-8ac7-440d-8b3a-cb6ffdd672fc-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:01:45 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-8e1022b7-e2c8-4b82-9721-f9a0ee2166fc tempest-CreateVolumesFromSnapshotTest-1375213394 None] Lock "cinder-fa318b77-8ac7-440d-8b3a-cb6ffdd672fc-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:01:45 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-8e1022b7-e2c8-4b82-9721-f9a0ee2166fc tempest-CreateVolumesFromSnapshotTest-1375213394 None] Acquiring lock "cinder-quobyte-fa318b77-8ac7-440d-8b3a-cb6ffdd672fc" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:01:45 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-8e1022b7-e2c8-4b82-9721-f9a0ee2166fc tempest-CreateVolumesFromSnapshotTest-1375213394 None] Lock "cinder-quobyte-fa318b77-8ac7-440d-8b3a-cb6ffdd672fc" acquired by "delete_volume" :: waited 0.033s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:01:45 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[39952055-373e-409d-a0d6-22ca51b634a8]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:01:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8e1022b7-e2c8-4b82-9721-f9a0ee2166fc tempest-CreateVolumesFromSnapshotTest-1375213394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-fa318b77-8ac7-440d-8b3a-cb6ffdd672fc {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:45 devstack sudo[126281]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-89ac702b-a0b1-4b60-980a-f811c1fd7885 tempest-ProjectReaderTests-1152707596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9.1bd7baa9-0da8-4d30-952b-56584606b44d" returned: 0 in 0.339s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-89ac702b-a0b1-4b60-980a-f811c1fd7885 tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:45 devstack sudo[126290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-fa318b77-8ac7-440d-8b3a-cb6ffdd672fc Sep 08 07:01:45 devstack sudo[126290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:45 devstack sudo[126297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9.info Sep 08 07:01:45 devstack sudo[126297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:45 devstack sudo[126297]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:45 devstack sudo[126290]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-89ac702b-a0b1-4b60-980a-f811c1fd7885 tempest-ProjectReaderTests-1152707596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9.info" returned: 0 in 0.267s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:45 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-89ac702b-a0b1-4b60-980a-f811c1fd7885 tempest-ProjectReaderTests-1152707596 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9.info is being set with open permissions: ugo+rw Sep 08 07:01:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-89ac702b-a0b1-4b60-980a-f811c1fd7885 tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8e1022b7-e2c8-4b82-9721-f9a0ee2166fc tempest-CreateVolumesFromSnapshotTest-1375213394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-fa318b77-8ac7-440d-8b3a-cb6ffdd672fc" returned: 0 in 0.417s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8e1022b7-e2c8-4b82-9721-f9a0ee2166fc tempest-CreateVolumesFromSnapshotTest-1375213394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-fa318b77-8ac7-440d-8b3a-cb6ffdd672fc {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:45 devstack sudo[126310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9.info Sep 08 07:01:45 devstack sudo[126310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:45 devstack sudo[126313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-fa318b77-8ac7-440d-8b3a-cb6ffdd672fc Sep 08 07:01:45 devstack sudo[126313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:45 devstack sudo[126310]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-89ac702b-a0b1-4b60-980a-f811c1fd7885 tempest-ProjectReaderTests-1152707596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9.info" returned: 0 in 0.250s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-89ac702b-a0b1-4b60-980a-f811c1fd7885 tempest-ProjectReaderTests-1152707596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.358s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:45 devstack sudo[126313]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4158129f-6b4f-4205-9129-3e9b849e1227 tempest-ProjectMemberTests-411164925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.815s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:45 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-4158129f-6b4f-4205-9129-3e9b849e1227 tempest-ProjectMemberTests-411164925 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:01:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1541198481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ed6e326-27fc-4f84-97f9-b0bf0dd542e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc639babed634473856ad52d77e5a6af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:01:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:01:44Z,use_quota=True,user_id='c850edcf996545b89f3d8d0b683570e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:01:45 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-4158129f-6b4f-4205-9129-3e9b849e1227 tempest-ProjectMemberTests-411164925 None] Creating volume 5ed6e326-27fc-4f84-97f9-b0bf0dd542e5 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:01:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4158129f-6b4f-4205-9129-3e9b849e1227 tempest-ProjectMemberTests-411164925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4158129f-6b4f-4205-9129-3e9b849e1227 tempest-ProjectMemberTests-411164925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:45 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-4158129f-6b4f-4205-9129-3e9b849e1227 tempest-ProjectMemberTests-411164925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:01:45 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-4158129f-6b4f-4205-9129-3e9b849e1227 tempest-ProjectMemberTests-411164925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:01:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4158129f-6b4f-4205-9129-3e9b849e1227 tempest-ProjectMemberTests-411164925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:45 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-4158129f-6b4f-4205-9129-3e9b849e1227 tempest-ProjectMemberTests-411164925 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:01:45 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-4158129f-6b4f-4205-9129-3e9b849e1227 tempest-ProjectMemberTests-411164925 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 07:01:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4158129f-6b4f-4205-9129-3e9b849e1227 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5ed6e326-27fc-4f84-97f9-b0bf0dd542e5 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8e1022b7-e2c8-4b82-9721-f9a0ee2166fc tempest-CreateVolumesFromSnapshotTest-1375213394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-fa318b77-8ac7-440d-8b3a-cb6ffdd672fc" returned: 0 in 0.285s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:46 devstack sudo[126325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5ed6e326-27fc-4f84-97f9-b0bf0dd542e5 1073741824 Sep 08 07:01:46 devstack sudo[126325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:46 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-8e1022b7-e2c8-4b82-9721-f9a0ee2166fc tempest-CreateVolumesFromSnapshotTest-1375213394 None] Lock "cinder-quobyte-fa318b77-8ac7-440d-8b3a-cb6ffdd672fc" released by "delete_volume" :: held 0.763s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:01:46 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-89ac702b-a0b1-4b60-980a-f811c1fd7885 tempest-ProjectReaderTests-1152707596 None] Create snapshot completed successfully Sep 08 07:01:46 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-8e1022b7-e2c8-4b82-9721-f9a0ee2166fc tempest-CreateVolumesFromSnapshotTest-1375213394 None] Created reservations ['cfa46db5-c883-41e8-92f4-274b1a5b1771', 'fd749e5d-382d-4eb2-9889-4ab84b4eedf9', 'a2e12bd5-521d-4da6-8470-53076373b0e8', 'aa973f78-bf0b-424b-9099-fb7645fc8563'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:01:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8e1022b7-e2c8-4b82-9721-f9a0ee2166fc tempest-CreateVolumesFromSnapshotTest-1375213394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8e1022b7-e2c8-4b82-9721-f9a0ee2166fc tempest-CreateVolumesFromSnapshotTest-1375213394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:46 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8e1022b7-e2c8-4b82-9721-f9a0ee2166fc tempest-CreateVolumesFromSnapshotTest-1375213394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:01:46 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8e1022b7-e2c8-4b82-9721-f9a0ee2166fc tempest-CreateVolumesFromSnapshotTest-1375213394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:01:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8e1022b7-e2c8-4b82-9721-f9a0ee2166fc tempest-CreateVolumesFromSnapshotTest-1375213394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8e1022b7-e2c8-4b82-9721-f9a0ee2166fc tempest-CreateVolumesFromSnapshotTest-1375213394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:46 devstack sudo[126333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 07:01:46 devstack sudo[126333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:46 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-216989a9-e7d3-4fe2-89e3-67b618599056 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Acquiring lock "cinder-e1a751bf-1a70-49b9-be0c-be10a550b86e-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:01:46 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-216989a9-e7d3-4fe2-89e3-67b618599056 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Lock "cinder-e1a751bf-1a70-49b9-be0c-be10a550b86e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:01:46 devstack sudo[126333]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8e1022b7-e2c8-4b82-9721-f9a0ee2166fc tempest-CreateVolumesFromSnapshotTest-1375213394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.273s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:46 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-8e1022b7-e2c8-4b82-9721-f9a0ee2166fc tempest-CreateVolumesFromSnapshotTest-1375213394 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:01:46 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-216989a9-e7d3-4fe2-89e3-67b618599056 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Acquiring lock "cinder-quobyte-e1a751bf-1a70-49b9-be0c-be10a550b86e" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:01:46 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-8e1022b7-e2c8-4b82-9721-f9a0ee2166fc tempest-CreateVolumesFromSnapshotTest-1375213394 None] Deleted volume successfully. Sep 08 07:01:46 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-216989a9-e7d3-4fe2-89e3-67b618599056 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Lock "cinder-quobyte-e1a751bf-1a70-49b9-be0c-be10a550b86e" acquired by "delete_volume" :: waited 0.022s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:01:46 devstack sudo[126325]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4158129f-6b4f-4205-9129-3e9b849e1227 tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5ed6e326-27fc-4f84-97f9-b0bf0dd542e5 1073741824" returned: 0 in 0.489s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:46 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-8e1022b7-e2c8-4b82-9721-f9a0ee2166fc tempest-CreateVolumesFromSnapshotTest-1375213394 None] Lock "cinder-fa318b77-8ac7-440d-8b3a-cb6ffdd672fc-delete_volume" released by "delete_volume" :: held 1.298s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:01:46 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3a0a9c-0689-4bf3-9b2b-e27f2d3a8adf]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:01:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-216989a9-e7d3-4fe2-89e3-67b618599056 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e1a751bf-1a70-49b9-be0c-be10a550b86e {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4158129f-6b4f-4205-9129-3e9b849e1227 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5ed6e326-27fc-4f84-97f9-b0bf0dd542e5 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:46 devstack sudo[126352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5ed6e326-27fc-4f84-97f9-b0bf0dd542e5 Sep 08 07:01:46 devstack sudo[126352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:46 devstack sudo[126349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e1a751bf-1a70-49b9-be0c-be10a550b86e Sep 08 07:01:46 devstack sudo[126349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:46 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-ab7c2f94-700e-4e62-9f19-424253fdfa31 tempest-ProjectReaderTests-1152707596 None] Acquiring lock "cinder-1bd7baa9-0da8-4d30-952b-56584606b44d-delete_snapshot" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:01:46 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-ab7c2f94-700e-4e62-9f19-424253fdfa31 tempest-ProjectReaderTests-1152707596 None] Lock "cinder-1bd7baa9-0da8-4d30-952b-56584606b44d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:01:46 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-ab7c2f94-700e-4e62-9f19-424253fdfa31 tempest-ProjectReaderTests-1152707596 None] Acquiring lock "cinder-quobyte-c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:01:46 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-ab7c2f94-700e-4e62-9f19-424253fdfa31 tempest-ProjectReaderTests-1152707596 None] Lock "cinder-quobyte-c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:01:46 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-ab7c2f94-700e-4e62-9f19-424253fdfa31 tempest-ProjectReaderTests-1152707596 None] Acquiring lock "cinder-quobyte-1bd7baa9-0da8-4d30-952b-56584606b44d" by "_delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:01:46 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-ab7c2f94-700e-4e62-9f19-424253fdfa31 tempest-ProjectReaderTests-1152707596 None] Lock "cinder-quobyte-1bd7baa9-0da8-4d30-952b-56584606b44d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:01:46 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-ab7c2f94-700e-4e62-9f19-424253fdfa31 tempest-ProjectReaderTests-1152707596 None] Deleting offline snapshot 1bd7baa9-0da8-4d30-952b-56584606b44d of volume c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9 {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 07:01:46 devstack sudo[126352]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:46 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-ab7c2f94-700e-4e62-9f19-424253fdfa31 tempest-ProjectReaderTests-1152707596 None] snapshot_file for this snap is: volume-c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9.1bd7baa9-0da8-4d30-952b-56584606b44d {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 07:01:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-4158129f-6b4f-4205-9129-3e9b849e1227 tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5ed6e326-27fc-4f84-97f9-b0bf0dd542e5" returned: 0 in 0.293s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:46 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-4158129f-6b4f-4205-9129-3e9b849e1227 tempest-ProjectMemberTests-411164925 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:01:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-4158129f-6b4f-4205-9129-3e9b849e1227 tempest-ProjectMemberTests-411164925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:46 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96cf541-a017-48f4-bb63-527b53d98f04]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:01:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ab7c2f94-700e-4e62-9f19-424253fdfa31 tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9.1bd7baa9-0da8-4d30-952b-56584606b44d {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:46 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4158129f-6b4f-4205-9129-3e9b849e1227 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e2967d6-cb5a-4f54-8ca3-a54bf8d051a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ed6e326-27fc-4f84-97f9-b0bf0dd542e5', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:46 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4158129f-6b4f-4205-9129-3e9b849e1227 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43a977a8-177d-472b-8960-0e7bce48dc6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:46 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-4158129f-6b4f-4205-9129-3e9b849e1227 tempest-ProjectMemberTests-411164925 None] Volume volume-5ed6e326-27fc-4f84-97f9-b0bf0dd542e5 (5ed6e326-27fc-4f84-97f9-b0bf0dd542e5): created successfully Sep 08 07:01:46 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4158129f-6b4f-4205-9129-3e9b849e1227 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43a977a8-177d-472b-8960-0e7bce48dc6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:46 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-4158129f-6b4f-4205-9129-3e9b849e1227 tempest-ProjectMemberTests-411164925 None] Flow 'volume_create_manager' (112ffdfd-14a0-4378-bd3b-870633bc1fe4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:01:46 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-4158129f-6b4f-4205-9129-3e9b849e1227 tempest-ProjectMemberTests-411164925 None] Created volume successfully. Sep 08 07:01:46 devstack sudo[126349]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-216989a9-e7d3-4fe2-89e3-67b618599056 tempest-CreateVolumesFromSnapshotTest-1375213394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e1a751bf-1a70-49b9-be0c-be10a550b86e" returned: 0 in 0.417s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-216989a9-e7d3-4fe2-89e3-67b618599056 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e1a751bf-1a70-49b9-be0c-be10a550b86e {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:46 devstack sudo[126370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e1a751bf-1a70-49b9-be0c-be10a550b86e Sep 08 07:01:46 devstack sudo[126370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:46 devstack sudo[126367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9.1bd7baa9-0da8-4d30-952b-56584606b44d Sep 08 07:01:46 devstack sudo[126367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:47 devstack sudo[126370]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-216989a9-e7d3-4fe2-89e3-67b618599056 tempest-CreateVolumesFromSnapshotTest-1375213394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-e1a751bf-1a70-49b9-be0c-be10a550b86e" returned: 0 in 0.276s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:47 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-216989a9-e7d3-4fe2-89e3-67b618599056 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Lock "cinder-quobyte-e1a751bf-1a70-49b9-be0c-be10a550b86e" released by "delete_volume" :: held 0.740s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:01:47 devstack sudo[126367]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ab7c2f94-700e-4e62-9f19-424253fdfa31 tempest-ProjectReaderTests-1152707596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9.1bd7baa9-0da8-4d30-952b-56584606b44d" returned: 0 in 0.395s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:47 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-ab7c2f94-700e-4e62-9f19-424253fdfa31 tempest-ProjectReaderTests-1152707596 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:01:47 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc144098-1654-4589-83d2-24015bb0651d]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:01:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ab7c2f94-700e-4e62-9f19-424253fdfa31 tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:47 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-216989a9-e7d3-4fe2-89e3-67b618599056 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Created reservations ['92d1d554-3dd3-4628-9bd5-53776d99c89a', '67077a7f-8bbe-45ce-a54c-754780baafa7', '3408f2f2-5897-4625-aed7-194ce0e111bb', 'beb38ff4-73e8-4fe6-badb-2d77b601f0f4'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:01:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-ecfdc322-eed2-4184-9896-ab358a6e9de4 tempest-ProjectMemberTests-411164925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-ecfdc322-eed2-4184-9896-ab358a6e9de4 tempest-ProjectMemberTests-411164925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:47 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-ecfdc322-eed2-4184-9896-ab358a6e9de4 tempest-ProjectMemberTests-411164925 None] Creating offline snapshot 3add8579-5079-40e5-a932-ede8b90d3158 of volume 5ed6e326-27fc-4f84-97f9-b0bf0dd542e5 {{(pid=87507) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 07:01:47 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d1ffed-95ee-4bae-acb1-ac480a41e4f8]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:01:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ecfdc322-eed2-4184-9896-ab358a6e9de4 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5ed6e326-27fc-4f84-97f9-b0bf0dd542e5 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:47 devstack sudo[126389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9 Sep 08 07:01:47 devstack sudo[126389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-216989a9-e7d3-4fe2-89e3-67b618599056 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-216989a9-e7d3-4fe2-89e3-67b618599056 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:47 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-216989a9-e7d3-4fe2-89e3-67b618599056 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:01:47 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-216989a9-e7d3-4fe2-89e3-67b618599056 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:01:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-216989a9-e7d3-4fe2-89e3-67b618599056 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-216989a9-e7d3-4fe2-89e3-67b618599056 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:47 devstack sudo[126398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 07:01:47 devstack sudo[126398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:47 devstack sudo[126393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5ed6e326-27fc-4f84-97f9-b0bf0dd542e5 Sep 08 07:01:47 devstack sudo[126393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:47 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-569d5850-63db-4904-b29d-c36027dc316d tempest-CreateVolumesFromSnapshotTest-1375213394 None] Acquiring lock "cinder-d216298f-bb6c-45ed-90de-b599a80502ad-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:01:47 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-569d5850-63db-4904-b29d-c36027dc316d tempest-CreateVolumesFromSnapshotTest-1375213394 None] Lock "cinder-d216298f-bb6c-45ed-90de-b599a80502ad-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:01:47 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-569d5850-63db-4904-b29d-c36027dc316d tempest-CreateVolumesFromSnapshotTest-1375213394 None] Acquiring lock "cinder-quobyte-d216298f-bb6c-45ed-90de-b599a80502ad" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:01:47 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-569d5850-63db-4904-b29d-c36027dc316d tempest-CreateVolumesFromSnapshotTest-1375213394 None] Lock "cinder-quobyte-d216298f-bb6c-45ed-90de-b599a80502ad" acquired by "delete_volume" :: waited 0.022s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:01:47 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a2cfde-cd5a-45ea-a540-f82067edfae3]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:01:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-569d5850-63db-4904-b29d-c36027dc316d tempest-CreateVolumesFromSnapshotTest-1375213394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d216298f-bb6c-45ed-90de-b599a80502ad {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:47 devstack sudo[126398]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-216989a9-e7d3-4fe2-89e3-67b618599056 tempest-CreateVolumesFromSnapshotTest-1375213394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.306s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:47 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-216989a9-e7d3-4fe2-89e3-67b618599056 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:01:47 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-216989a9-e7d3-4fe2-89e3-67b618599056 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Deleted volume successfully. Sep 08 07:01:47 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-216989a9-e7d3-4fe2-89e3-67b618599056 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Lock "cinder-e1a751bf-1a70-49b9-be0c-be10a550b86e-delete_volume" released by "delete_volume" :: held 1.410s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:01:47 devstack sudo[126389]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:47 devstack sudo[126409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d216298f-bb6c-45ed-90de-b599a80502ad Sep 08 07:01:47 devstack sudo[126409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ab7c2f94-700e-4e62-9f19-424253fdfa31 tempest-ProjectReaderTests-1152707596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9" returned: 0 in 0.552s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ab7c2f94-700e-4e62-9f19-424253fdfa31 tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9.1bd7baa9-0da8-4d30-952b-56584606b44d {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:47 devstack sudo[126421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9.1bd7baa9-0da8-4d30-952b-56584606b44d Sep 08 07:01:47 devstack sudo[126421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:47 devstack sudo[126393]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ecfdc322-eed2-4184-9896-ab358a6e9de4 tempest-ProjectMemberTests-411164925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5ed6e326-27fc-4f84-97f9-b0bf0dd542e5" returned: 0 in 0.470s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ecfdc322-eed2-4184-9896-ab358a6e9de4 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5ed6e326-27fc-4f84-97f9-b0bf0dd542e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5ed6e326-27fc-4f84-97f9-b0bf0dd542e5.3add8579-5079-40e5-a932-ede8b90d3158 1G {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:47 devstack sudo[126424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5ed6e326-27fc-4f84-97f9-b0bf0dd542e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5ed6e326-27fc-4f84-97f9-b0bf0dd542e5.3add8579-5079-40e5-a932-ede8b90d3158 1G Sep 08 07:01:47 devstack sudo[126424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:48 devstack sudo[126409]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-569d5850-63db-4904-b29d-c36027dc316d tempest-CreateVolumesFromSnapshotTest-1375213394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d216298f-bb6c-45ed-90de-b599a80502ad" returned: 0 in 0.399s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-569d5850-63db-4904-b29d-c36027dc316d tempest-CreateVolumesFromSnapshotTest-1375213394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d216298f-bb6c-45ed-90de-b599a80502ad {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:48 devstack sudo[126442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d216298f-bb6c-45ed-90de-b599a80502ad Sep 08 07:01:48 devstack sudo[126442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:48 devstack sudo[126421]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ab7c2f94-700e-4e62-9f19-424253fdfa31 tempest-ProjectReaderTests-1152707596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9.1bd7baa9-0da8-4d30-952b-56584606b44d" returned: 0 in 0.365s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ab7c2f94-700e-4e62-9f19-424253fdfa31 tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9.1bd7baa9-0da8-4d30-952b-56584606b44d {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:48 devstack sudo[126448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9.1bd7baa9-0da8-4d30-952b-56584606b44d Sep 08 07:01:48 devstack sudo[126448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:48 devstack sudo[126424]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ecfdc322-eed2-4184-9896-ab358a6e9de4 tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5ed6e326-27fc-4f84-97f9-b0bf0dd542e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5ed6e326-27fc-4f84-97f9-b0bf0dd542e5.3add8579-5079-40e5-a932-ede8b90d3158 1G" returned: 0 in 0.460s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ecfdc322-eed2-4184-9896-ab358a6e9de4 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ed6e326-27fc-4f84-97f9-b0bf0dd542e5 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5ed6e326-27fc-4f84-97f9-b0bf0dd542e5.3add8579-5079-40e5-a932-ede8b90d3158 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:48 devstack sudo[126455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ed6e326-27fc-4f84-97f9-b0bf0dd542e5 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5ed6e326-27fc-4f84-97f9-b0bf0dd542e5.3add8579-5079-40e5-a932-ede8b90d3158 Sep 08 07:01:48 devstack sudo[126455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:48 devstack sudo[126442]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-569d5850-63db-4904-b29d-c36027dc316d tempest-CreateVolumesFromSnapshotTest-1375213394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d216298f-bb6c-45ed-90de-b599a80502ad" returned: 0 in 0.304s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:48 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-569d5850-63db-4904-b29d-c36027dc316d tempest-CreateVolumesFromSnapshotTest-1375213394 None] Lock "cinder-quobyte-d216298f-bb6c-45ed-90de-b599a80502ad" released by "delete_volume" :: held 0.758s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:01:48 devstack sudo[126448]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:48 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-569d5850-63db-4904-b29d-c36027dc316d tempest-CreateVolumesFromSnapshotTest-1375213394 None] Created reservations ['2edb71f9-29b4-4bb1-a297-35878538ed9d', '5487fc68-246e-40d6-a649-b0de1f4f6977', '8798b303-674b-4cf8-958d-527a2dd248c1', '55769591-2dfc-4bb0-a2d7-54ab9d31e198'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:01:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ab7c2f94-700e-4e62-9f19-424253fdfa31 tempest-ProjectReaderTests-1152707596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9.1bd7baa9-0da8-4d30-952b-56584606b44d" returned: 0 in 0.295s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:48 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-ab7c2f94-700e-4e62-9f19-424253fdfa31 tempest-ProjectReaderTests-1152707596 None] Lock "cinder-quobyte-1bd7baa9-0da8-4d30-952b-56584606b44d" released by "_delete_snapshot" :: held 1.734s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:01:48 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-ab7c2f94-700e-4e62-9f19-424253fdfa31 tempest-ProjectReaderTests-1152707596 None] Lock "cinder-quobyte-c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9" released by "delete_snapshot" :: held 1.763s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:01:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-569d5850-63db-4904-b29d-c36027dc316d tempest-CreateVolumesFromSnapshotTest-1375213394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-569d5850-63db-4904-b29d-c36027dc316d tempest-CreateVolumesFromSnapshotTest-1375213394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:48 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-569d5850-63db-4904-b29d-c36027dc316d tempest-CreateVolumesFromSnapshotTest-1375213394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:01:48 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-569d5850-63db-4904-b29d-c36027dc316d tempest-CreateVolumesFromSnapshotTest-1375213394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:01:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-569d5850-63db-4904-b29d-c36027dc316d tempest-CreateVolumesFromSnapshotTest-1375213394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-569d5850-63db-4904-b29d-c36027dc316d tempest-CreateVolumesFromSnapshotTest-1375213394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:48 devstack sudo[126469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 07:01:48 devstack sudo[126469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:48 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-ab7c2f94-700e-4e62-9f19-424253fdfa31 tempest-ProjectReaderTests-1152707596 None] Created reservations ['0e2821ae-96b0-4e61-a14c-44f6c4d2df10', '7498c212-9635-43ff-a020-6ae25eeecb20', 'c6ccd8a9-a19b-4721-b96a-a898ef8c0689', '45b33e7d-73cd-44d6-a532-3c11137e6483'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:01:48 devstack sudo[126455]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ecfdc322-eed2-4184-9896-ab358a6e9de4 tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ed6e326-27fc-4f84-97f9-b0bf0dd542e5 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5ed6e326-27fc-4f84-97f9-b0bf0dd542e5.3add8579-5079-40e5-a932-ede8b90d3158" returned: 0 in 0.327s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:48 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-ecfdc322-eed2-4184-9896-ab358a6e9de4 tempest-ProjectMemberTests-411164925 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5ed6e326-27fc-4f84-97f9-b0bf0dd542e5.3add8579-5079-40e5-a932-ede8b90d3158 is being set with open permissions: ugo+rw Sep 08 07:01:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ecfdc322-eed2-4184-9896-ab358a6e9de4 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5ed6e326-27fc-4f84-97f9-b0bf0dd542e5.3add8579-5079-40e5-a932-ede8b90d3158 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:48 devstack sudo[126474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5ed6e326-27fc-4f84-97f9-b0bf0dd542e5.3add8579-5079-40e5-a932-ede8b90d3158 Sep 08 07:01:48 devstack sudo[126474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:48 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-ab7c2f94-700e-4e62-9f19-424253fdfa31 tempest-ProjectReaderTests-1152707596 None] Delete snapshot completed successfully. Sep 08 07:01:48 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-ab7c2f94-700e-4e62-9f19-424253fdfa31 tempest-ProjectReaderTests-1152707596 None] Lock "cinder-1bd7baa9-0da8-4d30-952b-56584606b44d-delete_snapshot" released by "delete_snapshot" :: held 1.995s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:01:48 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-ff376702-fdd8-4210-84ad-6c0506c2fad7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Acquiring lock "cinder-6e9c25e1-cd85-4c8d-af67-b36613b3ad55-delete_snapshot" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:01:48 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-ff376702-fdd8-4210-84ad-6c0506c2fad7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Lock "cinder-6e9c25e1-cd85-4c8d-af67-b36613b3ad55-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:01:48 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-ff376702-fdd8-4210-84ad-6c0506c2fad7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Acquiring lock "cinder-quobyte-004d9f83-d614-49bd-a3e9-d4819f0d155d" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:01:48 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-ff376702-fdd8-4210-84ad-6c0506c2fad7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Lock "cinder-quobyte-004d9f83-d614-49bd-a3e9-d4819f0d155d" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:01:48 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-ff376702-fdd8-4210-84ad-6c0506c2fad7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Acquiring lock "cinder-quobyte-6e9c25e1-cd85-4c8d-af67-b36613b3ad55" by "_delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:01:48 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-ff376702-fdd8-4210-84ad-6c0506c2fad7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Lock "cinder-quobyte-6e9c25e1-cd85-4c8d-af67-b36613b3ad55" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:01:48 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-ff376702-fdd8-4210-84ad-6c0506c2fad7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Deleting offline snapshot 6e9c25e1-cd85-4c8d-af67-b36613b3ad55 of volume 004d9f83-d614-49bd-a3e9-d4819f0d155d {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 07:01:48 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-ff376702-fdd8-4210-84ad-6c0506c2fad7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] snapshot_file for this snap is: volume-004d9f83-d614-49bd-a3e9-d4819f0d155d.6e9c25e1-cd85-4c8d-af67-b36613b3ad55 {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 07:01:48 devstack sudo[126469]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-569d5850-63db-4904-b29d-c36027dc316d tempest-CreateVolumesFromSnapshotTest-1375213394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.329s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:48 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-569d5850-63db-4904-b29d-c36027dc316d tempest-CreateVolumesFromSnapshotTest-1375213394 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:01:48 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[85eea1fe-d14c-4e4d-9d5c-00dc9203f2e3]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:01:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ff376702-fdd8-4210-84ad-6c0506c2fad7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-004d9f83-d614-49bd-a3e9-d4819f0d155d.6e9c25e1-cd85-4c8d-af67-b36613b3ad55 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:48 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-077935fc-3477-4007-92f6-c6d84ac74d0c tempest-ProjectReaderTests-1152707596 None] Acquiring lock "cinder-c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:01:48 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-569d5850-63db-4904-b29d-c36027dc316d tempest-CreateVolumesFromSnapshotTest-1375213394 None] Deleted volume successfully. Sep 08 07:01:48 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-077935fc-3477-4007-92f6-c6d84ac74d0c tempest-ProjectReaderTests-1152707596 None] Lock "cinder-c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:01:48 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-569d5850-63db-4904-b29d-c36027dc316d tempest-CreateVolumesFromSnapshotTest-1375213394 None] Lock "cinder-d216298f-bb6c-45ed-90de-b599a80502ad-delete_volume" released by "delete_volume" :: held 1.383s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:01:48 devstack sudo[126474]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ecfdc322-eed2-4184-9896-ab358a6e9de4 tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5ed6e326-27fc-4f84-97f9-b0bf0dd542e5.3add8579-5079-40e5-a932-ede8b90d3158" returned: 0 in 0.340s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:49 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-077935fc-3477-4007-92f6-c6d84ac74d0c tempest-ProjectReaderTests-1152707596 None] Acquiring lock "cinder-quobyte-c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:01:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ecfdc322-eed2-4184-9896-ab358a6e9de4 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5ed6e326-27fc-4f84-97f9-b0bf0dd542e5.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:49 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-077935fc-3477-4007-92f6-c6d84ac74d0c tempest-ProjectReaderTests-1152707596 None] Lock "cinder-quobyte-c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9" acquired by "delete_volume" :: waited 0.029s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:01:49 devstack sudo[126490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5ed6e326-27fc-4f84-97f9-b0bf0dd542e5.info Sep 08 07:01:49 devstack sudo[126490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:49 devstack sudo[126483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-004d9f83-d614-49bd-a3e9-d4819f0d155d.6e9c25e1-cd85-4c8d-af67-b36613b3ad55 Sep 08 07:01:49 devstack sudo[126483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:49 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[5386b09a-6e52-4cb1-944e-b1d5fd6e3856]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:01:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-077935fc-3477-4007-92f6-c6d84ac74d0c tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:49 devstack sudo[126494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9 Sep 08 07:01:49 devstack sudo[126494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:49 devstack sudo[126490]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ecfdc322-eed2-4184-9896-ab358a6e9de4 tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5ed6e326-27fc-4f84-97f9-b0bf0dd542e5.info" returned: 0 in 0.287s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:49 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-ecfdc322-eed2-4184-9896-ab358a6e9de4 tempest-ProjectMemberTests-411164925 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5ed6e326-27fc-4f84-97f9-b0bf0dd542e5.info is being set with open permissions: ugo+rw Sep 08 07:01:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ecfdc322-eed2-4184-9896-ab358a6e9de4 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5ed6e326-27fc-4f84-97f9-b0bf0dd542e5.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:49 devstack sudo[126483]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ff376702-fdd8-4210-84ad-6c0506c2fad7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-004d9f83-d614-49bd-a3e9-d4819f0d155d.6e9c25e1-cd85-4c8d-af67-b36613b3ad55" returned: 0 in 0.420s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:49 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-ff376702-fdd8-4210-84ad-6c0506c2fad7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-004d9f83-d614-49bd-a3e9-d4819f0d155d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:01:49 devstack sudo[126507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5ed6e326-27fc-4f84-97f9-b0bf0dd542e5.info Sep 08 07:01:49 devstack sudo[126507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:49 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd4dd4f-735f-4b19-ba25-34a5723be9fe]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:01:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ff376702-fdd8-4210-84ad-6c0506c2fad7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-004d9f83-d614-49bd-a3e9-d4819f0d155d {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:49 devstack sudo[126494]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-077935fc-3477-4007-92f6-c6d84ac74d0c tempest-ProjectReaderTests-1152707596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9" returned: 0 in 0.391s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-077935fc-3477-4007-92f6-c6d84ac74d0c tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:49 devstack sudo[126512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-004d9f83-d614-49bd-a3e9-d4819f0d155d Sep 08 07:01:49 devstack sudo[126512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:49 devstack sudo[126519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9 Sep 08 07:01:49 devstack sudo[126519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:49 devstack sudo[126507]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ecfdc322-eed2-4184-9896-ab358a6e9de4 tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5ed6e326-27fc-4f84-97f9-b0bf0dd542e5.info" returned: 0 in 0.271s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-ecfdc322-eed2-4184-9896-ab358a6e9de4 tempest-ProjectMemberTests-411164925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.270s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:49 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-ecfdc322-eed2-4184-9896-ab358a6e9de4 tempest-ProjectMemberTests-411164925 None] Create snapshot completed successfully Sep 08 07:01:49 devstack sudo[126519]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-077935fc-3477-4007-92f6-c6d84ac74d0c tempest-ProjectReaderTests-1152707596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9" returned: 0 in 0.271s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:49 devstack sudo[126512]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ff376702-fdd8-4210-84ad-6c0506c2fad7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-004d9f83-d614-49bd-a3e9-d4819f0d155d" returned: 0 in 0.384s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ff376702-fdd8-4210-84ad-6c0506c2fad7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-004d9f83-d614-49bd-a3e9-d4819f0d155d.6e9c25e1-cd85-4c8d-af67-b36613b3ad55 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:49 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-077935fc-3477-4007-92f6-c6d84ac74d0c tempest-ProjectReaderTests-1152707596 None] Lock "cinder-quobyte-c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9" released by "delete_volume" :: held 0.734s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:01:49 devstack sudo[126536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-004d9f83-d614-49bd-a3e9-d4819f0d155d.6e9c25e1-cd85-4c8d-af67-b36613b3ad55 Sep 08 07:01:49 devstack sudo[126536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:49 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-077935fc-3477-4007-92f6-c6d84ac74d0c tempest-ProjectReaderTests-1152707596 None] Created reservations ['c8703c80-bc0f-4427-9b01-ad033afaa149', 'ef241773-c98e-4d78-919e-3ad1c722ba1a', '93c1cc48-4b82-43f6-9b6a-33e930c0ca35', '6cf9916a-ee93-4422-9341-74638379adf3'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:01:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-077935fc-3477-4007-92f6-c6d84ac74d0c tempest-ProjectReaderTests-1152707596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-077935fc-3477-4007-92f6-c6d84ac74d0c tempest-ProjectReaderTests-1152707596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:49 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-077935fc-3477-4007-92f6-c6d84ac74d0c tempest-ProjectReaderTests-1152707596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:01:49 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-077935fc-3477-4007-92f6-c6d84ac74d0c tempest-ProjectReaderTests-1152707596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:01:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-077935fc-3477-4007-92f6-c6d84ac74d0c tempest-ProjectReaderTests-1152707596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-077935fc-3477-4007-92f6-c6d84ac74d0c tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:49 devstack sudo[126541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 07:01:49 devstack sudo[126541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:50 devstack sudo[126536]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ff376702-fdd8-4210-84ad-6c0506c2fad7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-004d9f83-d614-49bd-a3e9-d4819f0d155d.6e9c25e1-cd85-4c8d-af67-b36613b3ad55" returned: 0 in 0.379s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ff376702-fdd8-4210-84ad-6c0506c2fad7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-004d9f83-d614-49bd-a3e9-d4819f0d155d.6e9c25e1-cd85-4c8d-af67-b36613b3ad55 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:50 devstack sudo[126556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-004d9f83-d614-49bd-a3e9-d4819f0d155d.6e9c25e1-cd85-4c8d-af67-b36613b3ad55 Sep 08 07:01:50 devstack sudo[126556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:50 devstack sudo[126541]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-077935fc-3477-4007-92f6-c6d84ac74d0c tempest-ProjectReaderTests-1152707596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.275s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:50 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-077935fc-3477-4007-92f6-c6d84ac74d0c tempest-ProjectReaderTests-1152707596 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:01:50 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-077935fc-3477-4007-92f6-c6d84ac74d0c tempest-ProjectReaderTests-1152707596 None] Deleted volume successfully. Sep 08 07:01:50 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-077935fc-3477-4007-92f6-c6d84ac74d0c tempest-ProjectReaderTests-1152707596 None] Lock "cinder-c5c41c7b-f5f5-4a4a-9f3b-5a6e442ccbd9-delete_volume" released by "delete_volume" :: held 1.258s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:01:50 devstack sudo[126556]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ff376702-fdd8-4210-84ad-6c0506c2fad7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-004d9f83-d614-49bd-a3e9-d4819f0d155d.6e9c25e1-cd85-4c8d-af67-b36613b3ad55" returned: 0 in 0.289s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:50 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-16ed7202-f906-44d9-bc12-66c951a02b63 tempest-ProjectMemberTests-411164925 None] Acquiring lock "cinder-3add8579-5079-40e5-a932-ede8b90d3158-delete_snapshot" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:01:50 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-ff376702-fdd8-4210-84ad-6c0506c2fad7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Lock "cinder-quobyte-6e9c25e1-cd85-4c8d-af67-b36613b3ad55" released by "_delete_snapshot" :: held 1.654s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:01:50 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-16ed7202-f906-44d9-bc12-66c951a02b63 tempest-ProjectMemberTests-411164925 None] Lock "cinder-3add8579-5079-40e5-a932-ede8b90d3158-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:01:50 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-16ed7202-f906-44d9-bc12-66c951a02b63 tempest-ProjectMemberTests-411164925 None] Acquiring lock "cinder-quobyte-5ed6e326-27fc-4f84-97f9-b0bf0dd542e5" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:01:50 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-ff376702-fdd8-4210-84ad-6c0506c2fad7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Lock "cinder-quobyte-004d9f83-d614-49bd-a3e9-d4819f0d155d" released by "delete_snapshot" :: held 1.695s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:01:50 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-16ed7202-f906-44d9-bc12-66c951a02b63 tempest-ProjectMemberTests-411164925 None] Lock "cinder-quobyte-5ed6e326-27fc-4f84-97f9-b0bf0dd542e5" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:01:50 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-16ed7202-f906-44d9-bc12-66c951a02b63 tempest-ProjectMemberTests-411164925 None] Acquiring lock "cinder-quobyte-3add8579-5079-40e5-a932-ede8b90d3158" by "_delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:01:50 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-16ed7202-f906-44d9-bc12-66c951a02b63 tempest-ProjectMemberTests-411164925 None] Lock "cinder-quobyte-3add8579-5079-40e5-a932-ede8b90d3158" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:01:50 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-16ed7202-f906-44d9-bc12-66c951a02b63 tempest-ProjectMemberTests-411164925 None] Deleting offline snapshot 3add8579-5079-40e5-a932-ede8b90d3158 of volume 5ed6e326-27fc-4f84-97f9-b0bf0dd542e5 {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 07:01:50 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-16ed7202-f906-44d9-bc12-66c951a02b63 tempest-ProjectMemberTests-411164925 None] snapshot_file for this snap is: volume-5ed6e326-27fc-4f84-97f9-b0bf0dd542e5.3add8579-5079-40e5-a932-ede8b90d3158 {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 07:01:50 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a3a558-cc09-472a-98dd-94b010598652]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:01:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-16ed7202-f906-44d9-bc12-66c951a02b63 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5ed6e326-27fc-4f84-97f9-b0bf0dd542e5.3add8579-5079-40e5-a932-ede8b90d3158 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:50 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c267f9c-8606-4290-acdb-13270204c78c tempest-ProjectReaderTests-1152707596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:01:50 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2c267f9c-8606-4290-acdb-13270204c78c tempest-ProjectReaderTests-1152707596 None] Flow 'volume_create_manager' (6dd1db7d-6c31-4e36-b5e0-50cbb24991ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:01:50 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2c267f9c-8606-4290-acdb-13270204c78c tempest-ProjectReaderTests-1152707596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65e19250-bfb6-4f7e-be53-3fde766f0f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:50 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-ff376702-fdd8-4210-84ad-6c0506c2fad7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Created reservations ['c9801265-887f-4e68-89f4-d1d08fb8e97e', '36ab92dd-6f57-43de-bd14-e851704bcb72', 'c6a6ced4-7f67-4000-affa-f922d6884031', '280c50d2-7906-4302-8c02-59a7a2a24dbd'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:01:50 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2c267f9c-8606-4290-acdb-13270204c78c tempest-ProjectReaderTests-1152707596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65e19250-bfb6-4f7e-be53-3fde766f0f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1055867689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f15cd4cc-8742-4035-8286-7fef4ff788e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c6367f07ddf4a4cb92e17a1b8b6bb5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:01:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:01:51Z,use_quota=True,user_id='0b8690b455d34f248f0182e09db083f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:50 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2c267f9c-8606-4290-acdb-13270204c78c tempest-ProjectReaderTests-1152707596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5678c31d-b3ce-4a0e-871a-3654b2e28e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:50 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2c267f9c-8606-4290-acdb-13270204c78c tempest-ProjectReaderTests-1152707596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5678c31d-b3ce-4a0e-871a-3654b2e28e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:50 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2c267f9c-8606-4290-acdb-13270204c78c tempest-ProjectReaderTests-1152707596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9f8c706-0a7f-402e-a934-da3cf9985483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:50 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2c267f9c-8606-4290-acdb-13270204c78c tempest-ProjectReaderTests-1152707596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9f8c706-0a7f-402e-a934-da3cf9985483) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f15cd4cc-8742-4035-8286-7fef4ff788e5', 'volume_name': 'volume-f15cd4cc-8742-4035-8286-7fef4ff788e5', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:50 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2c267f9c-8606-4290-acdb-13270204c78c tempest-ProjectReaderTests-1152707596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11f14ba7-fbc3-44e4-9fe0-8d2af4a1ebd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:50 devstack sudo[126571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5ed6e326-27fc-4f84-97f9-b0bf0dd542e5.3add8579-5079-40e5-a932-ede8b90d3158 Sep 08 07:01:50 devstack sudo[126571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:50 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2c267f9c-8606-4290-acdb-13270204c78c tempest-ProjectReaderTests-1152707596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11f14ba7-fbc3-44e4-9fe0-8d2af4a1ebd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:50 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2c267f9c-8606-4290-acdb-13270204c78c tempest-ProjectReaderTests-1152707596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95646ca9-2856-4b48-b988-dee0b805e609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:50 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-2c267f9c-8606-4290-acdb-13270204c78c tempest-ProjectReaderTests-1152707596 None] Volume f15cd4cc-8742-4035-8286-7fef4ff788e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f15cd4cc-8742-4035-8286-7fef4ff788e5', 'volume_size': 1} Sep 08 07:01:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-2c267f9c-8606-4290-acdb-13270204c78c tempest-ProjectReaderTests-1152707596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-2c267f9c-8606-4290-acdb-13270204c78c tempest-ProjectReaderTests-1152707596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:50 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-2c267f9c-8606-4290-acdb-13270204c78c tempest-ProjectReaderTests-1152707596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1055867689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f15cd4cc-8742-4035-8286-7fef4ff788e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c6367f07ddf4a4cb92e17a1b8b6bb5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:01:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:01:51Z,use_quota=True,user_id='0b8690b455d34f248f0182e09db083f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:01:50 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-2c267f9c-8606-4290-acdb-13270204c78c tempest-ProjectReaderTests-1152707596 None] Creating volume f15cd4cc-8742-4035-8286-7fef4ff788e5 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:01:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-2c267f9c-8606-4290-acdb-13270204c78c tempest-ProjectReaderTests-1152707596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-2c267f9c-8606-4290-acdb-13270204c78c tempest-ProjectReaderTests-1152707596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:50 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-2c267f9c-8606-4290-acdb-13270204c78c tempest-ProjectReaderTests-1152707596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:01:50 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-2c267f9c-8606-4290-acdb-13270204c78c tempest-ProjectReaderTests-1152707596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:01:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-2c267f9c-8606-4290-acdb-13270204c78c tempest-ProjectReaderTests-1152707596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:50 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-2c267f9c-8606-4290-acdb-13270204c78c tempest-ProjectReaderTests-1152707596 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:01:50 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-2c267f9c-8606-4290-acdb-13270204c78c tempest-ProjectReaderTests-1152707596 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 07:01:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2c267f9c-8606-4290-acdb-13270204c78c tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f15cd4cc-8742-4035-8286-7fef4ff788e5 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:50 devstack sudo[126579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f15cd4cc-8742-4035-8286-7fef4ff788e5 1073741824 Sep 08 07:01:50 devstack sudo[126579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:50 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-ff376702-fdd8-4210-84ad-6c0506c2fad7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Delete snapshot completed successfully. Sep 08 07:01:50 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-ff376702-fdd8-4210-84ad-6c0506c2fad7 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Lock "cinder-6e9c25e1-cd85-4c8d-af67-b36613b3ad55-delete_snapshot" released by "delete_snapshot" :: held 2.026s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:01:50 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-d089e8aa-29e8-4e70-b86c-0aa137d64d85 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Acquiring lock "cinder-004d9f83-d614-49bd-a3e9-d4819f0d155d-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:01:51 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-d089e8aa-29e8-4e70-b86c-0aa137d64d85 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Lock "cinder-004d9f83-d614-49bd-a3e9-d4819f0d155d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:01:51 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-d089e8aa-29e8-4e70-b86c-0aa137d64d85 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Acquiring lock "cinder-quobyte-004d9f83-d614-49bd-a3e9-d4819f0d155d" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:01:51 devstack sudo[126571]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-16ed7202-f906-44d9-bc12-66c951a02b63 tempest-ProjectMemberTests-411164925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5ed6e326-27fc-4f84-97f9-b0bf0dd542e5.3add8579-5079-40e5-a932-ede8b90d3158" returned: 0 in 0.436s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:51 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-16ed7202-f906-44d9-bc12-66c951a02b63 tempest-ProjectMemberTests-411164925 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ed6e326-27fc-4f84-97f9-b0bf0dd542e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:01:51 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-d089e8aa-29e8-4e70-b86c-0aa137d64d85 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Lock "cinder-quobyte-004d9f83-d614-49bd-a3e9-d4819f0d155d" acquired by "delete_volume" :: waited 0.037s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:01:51 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3221eb5-0764-4d25-98c3-faef786c10f6]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:01:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-16ed7202-f906-44d9-bc12-66c951a02b63 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5ed6e326-27fc-4f84-97f9-b0bf0dd542e5 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:51 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[27cd8d7f-ec3c-4072-8f38-e8bac656b844]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:01:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-d089e8aa-29e8-4e70-b86c-0aa137d64d85 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-004d9f83-d614-49bd-a3e9-d4819f0d155d {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:51 devstack sudo[126596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5ed6e326-27fc-4f84-97f9-b0bf0dd542e5 Sep 08 07:01:51 devstack sudo[126596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:51 devstack sudo[126579]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:51 devstack sudo[126597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-004d9f83-d614-49bd-a3e9-d4819f0d155d Sep 08 07:01:51 devstack sudo[126597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2c267f9c-8606-4290-acdb-13270204c78c tempest-ProjectReaderTests-1152707596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f15cd4cc-8742-4035-8286-7fef4ff788e5 1073741824" returned: 0 in 0.493s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2c267f9c-8606-4290-acdb-13270204c78c tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f15cd4cc-8742-4035-8286-7fef4ff788e5 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:51 devstack sudo[126607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f15cd4cc-8742-4035-8286-7fef4ff788e5 Sep 08 07:01:51 devstack sudo[126607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:51 devstack sudo[126596]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-16ed7202-f906-44d9-bc12-66c951a02b63 tempest-ProjectMemberTests-411164925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5ed6e326-27fc-4f84-97f9-b0bf0dd542e5" returned: 0 in 0.399s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-16ed7202-f906-44d9-bc12-66c951a02b63 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5ed6e326-27fc-4f84-97f9-b0bf0dd542e5.3add8579-5079-40e5-a932-ede8b90d3158 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:51 devstack sudo[126597]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-d089e8aa-29e8-4e70-b86c-0aa137d64d85 tempest-CreateVolumesFromSnapshotTest-1375213394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-004d9f83-d614-49bd-a3e9-d4819f0d155d" returned: 0 in 0.405s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-d089e8aa-29e8-4e70-b86c-0aa137d64d85 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-004d9f83-d614-49bd-a3e9-d4819f0d155d {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:51 devstack sudo[126621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5ed6e326-27fc-4f84-97f9-b0bf0dd542e5.3add8579-5079-40e5-a932-ede8b90d3158 Sep 08 07:01:51 devstack sudo[126621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:51 devstack sudo[126624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-004d9f83-d614-49bd-a3e9-d4819f0d155d Sep 08 07:01:51 devstack sudo[126624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:51 devstack sudo[126607]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2c267f9c-8606-4290-acdb-13270204c78c tempest-ProjectReaderTests-1152707596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f15cd4cc-8742-4035-8286-7fef4ff788e5" returned: 0 in 0.313s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:51 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-2c267f9c-8606-4290-acdb-13270204c78c tempest-ProjectReaderTests-1152707596 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:01:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-2c267f9c-8606-4290-acdb-13270204c78c tempest-ProjectReaderTests-1152707596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:51 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2c267f9c-8606-4290-acdb-13270204c78c tempest-ProjectReaderTests-1152707596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95646ca9-2856-4b48-b988-dee0b805e609) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f15cd4cc-8742-4035-8286-7fef4ff788e5', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:51 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2c267f9c-8606-4290-acdb-13270204c78c tempest-ProjectReaderTests-1152707596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee123ffb-37df-475d-899f-aafb6b53d45b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:51 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-2c267f9c-8606-4290-acdb-13270204c78c tempest-ProjectReaderTests-1152707596 None] Volume volume-f15cd4cc-8742-4035-8286-7fef4ff788e5 (f15cd4cc-8742-4035-8286-7fef4ff788e5): created successfully Sep 08 07:01:51 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2c267f9c-8606-4290-acdb-13270204c78c tempest-ProjectReaderTests-1152707596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee123ffb-37df-475d-899f-aafb6b53d45b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:51 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2c267f9c-8606-4290-acdb-13270204c78c tempest-ProjectReaderTests-1152707596 None] Flow 'volume_create_manager' (6dd1db7d-6c31-4e36-b5e0-50cbb24991ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:01:51 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-2c267f9c-8606-4290-acdb-13270204c78c tempest-ProjectReaderTests-1152707596 None] Created volume successfully. Sep 08 07:01:51 devstack sudo[126624]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-d089e8aa-29e8-4e70-b86c-0aa137d64d85 tempest-CreateVolumesFromSnapshotTest-1375213394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-004d9f83-d614-49bd-a3e9-d4819f0d155d" returned: 0 in 0.289s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:51 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-d089e8aa-29e8-4e70-b86c-0aa137d64d85 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Lock "cinder-quobyte-004d9f83-d614-49bd-a3e9-d4819f0d155d" released by "delete_volume" :: held 0.758s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:01:51 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-d089e8aa-29e8-4e70-b86c-0aa137d64d85 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Created reservations ['51de6a87-da2b-4cc4-a16a-6072d912c5e1', 'b9e151fc-fd24-4b72-8cdd-bf271d2becfd', '2edf01ee-5914-44b2-9d6a-56808efe2a44', '7630dc64-622c-4776-9170-86f5bef47d10'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:01:51 devstack sudo[126621]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-16ed7202-f906-44d9-bc12-66c951a02b63 tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5ed6e326-27fc-4f84-97f9-b0bf0dd542e5.3add8579-5079-40e5-a932-ede8b90d3158" returned: 0 in 0.390s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-16ed7202-f906-44d9-bc12-66c951a02b63 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5ed6e326-27fc-4f84-97f9-b0bf0dd542e5.3add8579-5079-40e5-a932-ede8b90d3158 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:51 devstack sudo[126643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5ed6e326-27fc-4f84-97f9-b0bf0dd542e5.3add8579-5079-40e5-a932-ede8b90d3158 Sep 08 07:01:51 devstack sudo[126643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-d089e8aa-29e8-4e70-b86c-0aa137d64d85 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-d089e8aa-29e8-4e70-b86c-0aa137d64d85 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:51 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-d089e8aa-29e8-4e70-b86c-0aa137d64d85 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:01:51 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-d089e8aa-29e8-4e70-b86c-0aa137d64d85 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:01:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-d089e8aa-29e8-4e70-b86c-0aa137d64d85 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-d089e8aa-29e8-4e70-b86c-0aa137d64d85 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:51 devstack sudo[126648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 07:01:51 devstack sudo[126648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:52 devstack sudo[126643]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-16ed7202-f906-44d9-bc12-66c951a02b63 tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5ed6e326-27fc-4f84-97f9-b0bf0dd542e5.3add8579-5079-40e5-a932-ede8b90d3158" returned: 0 in 0.264s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:52 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-16ed7202-f906-44d9-bc12-66c951a02b63 tempest-ProjectMemberTests-411164925 None] Lock "cinder-quobyte-3add8579-5079-40e5-a932-ede8b90d3158" released by "_delete_snapshot" :: held 1.630s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:01:52 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-16ed7202-f906-44d9-bc12-66c951a02b63 tempest-ProjectMemberTests-411164925 None] Lock "cinder-quobyte-5ed6e326-27fc-4f84-97f9-b0bf0dd542e5" released by "delete_snapshot" :: held 1.659s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:01:52 devstack sudo[126648]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-d089e8aa-29e8-4e70-b86c-0aa137d64d85 tempest-CreateVolumesFromSnapshotTest-1375213394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.281s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:52 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-d089e8aa-29e8-4e70-b86c-0aa137d64d85 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:01:52 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-d089e8aa-29e8-4e70-b86c-0aa137d64d85 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Deleted volume successfully. Sep 08 07:01:52 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-d089e8aa-29e8-4e70-b86c-0aa137d64d85 tempest-CreateVolumesFromSnapshotTest-1375213394 None] Lock "cinder-004d9f83-d614-49bd-a3e9-d4819f0d155d-delete_volume" released by "delete_volume" :: held 1.281s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:01:52 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-16ed7202-f906-44d9-bc12-66c951a02b63 tempest-ProjectMemberTests-411164925 None] Created reservations ['907688e2-bf08-446e-96b1-28e1875273b1', 'cb4af28b-415a-46bc-bc96-cb548684fbee', '3f11dbde-7c9f-4103-abd7-150042d0c9d3', '6402c989-3f80-4058-a208-d1b55d7df0ec'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:01:52 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-16ed7202-f906-44d9-bc12-66c951a02b63 tempest-ProjectMemberTests-411164925 None] Delete snapshot completed successfully. Sep 08 07:01:52 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-16ed7202-f906-44d9-bc12-66c951a02b63 tempest-ProjectMemberTests-411164925 None] Lock "cinder-3add8579-5079-40e5-a932-ede8b90d3158-delete_snapshot" released by "delete_snapshot" :: held 1.839s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:01:52 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-f911ccf0-17ad-4e05-8d7e-577814a29517 tempest-ProjectMemberTests-411164925 None] Acquiring lock "cinder-5ed6e326-27fc-4f84-97f9-b0bf0dd542e5-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:01:52 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-f911ccf0-17ad-4e05-8d7e-577814a29517 tempest-ProjectMemberTests-411164925 None] Lock "cinder-5ed6e326-27fc-4f84-97f9-b0bf0dd542e5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:01:52 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-f911ccf0-17ad-4e05-8d7e-577814a29517 tempest-ProjectMemberTests-411164925 None] Acquiring lock "cinder-quobyte-5ed6e326-27fc-4f84-97f9-b0bf0dd542e5" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:01:52 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-f911ccf0-17ad-4e05-8d7e-577814a29517 tempest-ProjectMemberTests-411164925 None] Lock "cinder-quobyte-5ed6e326-27fc-4f84-97f9-b0bf0dd542e5" acquired by "delete_volume" :: waited 0.022s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:01:52 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f771edb-c8df-4dc1-a00b-729fe8eb351e]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:01:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f911ccf0-17ad-4e05-8d7e-577814a29517 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5ed6e326-27fc-4f84-97f9-b0bf0dd542e5 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-bde33365-7931-4d77-8bd7-56ae08742d9a tempest-ProjectReaderTests-1152707596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-bde33365-7931-4d77-8bd7-56ae08742d9a tempest-ProjectReaderTests-1152707596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:52 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-bde33365-7931-4d77-8bd7-56ae08742d9a tempest-ProjectReaderTests-1152707596 None] Creating offline snapshot d7e7a02e-9214-4c2c-93ff-356e36728cf8 of volume f15cd4cc-8742-4035-8286-7fef4ff788e5 {{(pid=87507) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 07:01:53 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fbc7053-741f-4988-87cd-e339508e96c0]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:01:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bde33365-7931-4d77-8bd7-56ae08742d9a tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f15cd4cc-8742-4035-8286-7fef4ff788e5 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:53 devstack sudo[126679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5ed6e326-27fc-4f84-97f9-b0bf0dd542e5 Sep 08 07:01:53 devstack sudo[126679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:53 devstack sudo[126683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f15cd4cc-8742-4035-8286-7fef4ff788e5 Sep 08 07:01:53 devstack sudo[126683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:53 devstack sudo[126679]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f911ccf0-17ad-4e05-8d7e-577814a29517 tempest-ProjectMemberTests-411164925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5ed6e326-27fc-4f84-97f9-b0bf0dd542e5" returned: 0 in 0.455s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f911ccf0-17ad-4e05-8d7e-577814a29517 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5ed6e326-27fc-4f84-97f9-b0bf0dd542e5 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:53 devstack sudo[126700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5ed6e326-27fc-4f84-97f9-b0bf0dd542e5 Sep 08 07:01:53 devstack sudo[126700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:53 devstack sudo[126683]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bde33365-7931-4d77-8bd7-56ae08742d9a tempest-ProjectReaderTests-1152707596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f15cd4cc-8742-4035-8286-7fef4ff788e5" returned: 0 in 0.436s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bde33365-7931-4d77-8bd7-56ae08742d9a tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f15cd4cc-8742-4035-8286-7fef4ff788e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f15cd4cc-8742-4035-8286-7fef4ff788e5.d7e7a02e-9214-4c2c-93ff-356e36728cf8 1G {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:53 devstack sudo[126706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f15cd4cc-8742-4035-8286-7fef4ff788e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f15cd4cc-8742-4035-8286-7fef4ff788e5.d7e7a02e-9214-4c2c-93ff-356e36728cf8 1G Sep 08 07:01:53 devstack sudo[126706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:53 devstack sudo[126700]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f911ccf0-17ad-4e05-8d7e-577814a29517 tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-5ed6e326-27fc-4f84-97f9-b0bf0dd542e5" returned: 0 in 0.332s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:53 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-f911ccf0-17ad-4e05-8d7e-577814a29517 tempest-ProjectMemberTests-411164925 None] Lock "cinder-quobyte-5ed6e326-27fc-4f84-97f9-b0bf0dd542e5" released by "delete_volume" :: held 0.875s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:01:53 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-f911ccf0-17ad-4e05-8d7e-577814a29517 tempest-ProjectMemberTests-411164925 None] Created reservations ['f40d5ef2-7c21-4dae-97d4-94fc8f3526f0', '02482415-7354-4d0c-b12c-7e0863b80abd', 'a9fb0480-a9bf-474a-9d26-5c3f4cdc3a30', '23fde6d2-1908-42ee-9b3f-cda788d9ffc8'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:01:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-f911ccf0-17ad-4e05-8d7e-577814a29517 tempest-ProjectMemberTests-411164925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-f911ccf0-17ad-4e05-8d7e-577814a29517 tempest-ProjectMemberTests-411164925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:53 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-f911ccf0-17ad-4e05-8d7e-577814a29517 tempest-ProjectMemberTests-411164925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:01:53 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-f911ccf0-17ad-4e05-8d7e-577814a29517 tempest-ProjectMemberTests-411164925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:01:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-f911ccf0-17ad-4e05-8d7e-577814a29517 tempest-ProjectMemberTests-411164925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f911ccf0-17ad-4e05-8d7e-577814a29517 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:53 devstack sudo[126725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 07:01:53 devstack sudo[126725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:53 devstack sudo[126706]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bde33365-7931-4d77-8bd7-56ae08742d9a tempest-ProjectReaderTests-1152707596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f15cd4cc-8742-4035-8286-7fef4ff788e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f15cd4cc-8742-4035-8286-7fef4ff788e5.d7e7a02e-9214-4c2c-93ff-356e36728cf8 1G" returned: 0 in 0.524s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bde33365-7931-4d77-8bd7-56ae08742d9a tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f15cd4cc-8742-4035-8286-7fef4ff788e5 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f15cd4cc-8742-4035-8286-7fef4ff788e5.d7e7a02e-9214-4c2c-93ff-356e36728cf8 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:54 devstack sudo[126730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f15cd4cc-8742-4035-8286-7fef4ff788e5 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f15cd4cc-8742-4035-8286-7fef4ff788e5.d7e7a02e-9214-4c2c-93ff-356e36728cf8 Sep 08 07:01:54 devstack sudo[126730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:54 devstack sudo[126725]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f911ccf0-17ad-4e05-8d7e-577814a29517 tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.294s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:54 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-f911ccf0-17ad-4e05-8d7e-577814a29517 tempest-ProjectMemberTests-411164925 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:01:54 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-f911ccf0-17ad-4e05-8d7e-577814a29517 tempest-ProjectMemberTests-411164925 None] Deleted volume successfully. Sep 08 07:01:54 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-f911ccf0-17ad-4e05-8d7e-577814a29517 tempest-ProjectMemberTests-411164925 None] Lock "cinder-5ed6e326-27fc-4f84-97f9-b0bf0dd542e5-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:01:54 devstack sudo[126730]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bde33365-7931-4d77-8bd7-56ae08742d9a tempest-ProjectReaderTests-1152707596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f15cd4cc-8742-4035-8286-7fef4ff788e5 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f15cd4cc-8742-4035-8286-7fef4ff788e5.d7e7a02e-9214-4c2c-93ff-356e36728cf8" returned: 0 in 0.412s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:54 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-bde33365-7931-4d77-8bd7-56ae08742d9a tempest-ProjectReaderTests-1152707596 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f15cd4cc-8742-4035-8286-7fef4ff788e5.d7e7a02e-9214-4c2c-93ff-356e36728cf8 is being set with open permissions: ugo+rw Sep 08 07:01:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bde33365-7931-4d77-8bd7-56ae08742d9a tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f15cd4cc-8742-4035-8286-7fef4ff788e5.d7e7a02e-9214-4c2c-93ff-356e36728cf8 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:54 devstack sudo[126751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f15cd4cc-8742-4035-8286-7fef4ff788e5.d7e7a02e-9214-4c2c-93ff-356e36728cf8 Sep 08 07:01:54 devstack sudo[126751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:54 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-8282817d-4f0f-4bbc-b204-92c6dd554f06 tempest-ProjectMemberTests-411164925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:01:54 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8282817d-4f0f-4bbc-b204-92c6dd554f06 tempest-ProjectMemberTests-411164925 None] Flow 'volume_create_manager' (3f4e41e5-6616-44bd-9465-23dc8b91cd4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:01:54 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8282817d-4f0f-4bbc-b204-92c6dd554f06 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bb2ccd1-9ffe-4e50-856d-422ec3a488d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:54 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8282817d-4f0f-4bbc-b204-92c6dd554f06 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bb2ccd1-9ffe-4e50-856d-422ec3a488d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:01:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1072806978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d03a741-5eb8-46f0-9dfe-e89527fe99d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc639babed634473856ad52d77e5a6af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:01:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:01:54Z,use_quota=True,user_id='c850edcf996545b89f3d8d0b683570e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:54 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8282817d-4f0f-4bbc-b204-92c6dd554f06 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2d64443-106d-49bc-b27d-867fa0df37fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:54 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8282817d-4f0f-4bbc-b204-92c6dd554f06 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2d64443-106d-49bc-b27d-867fa0df37fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:54 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8282817d-4f0f-4bbc-b204-92c6dd554f06 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (196cf091-fe81-4d9c-b2d4-2ddece983f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:54 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8282817d-4f0f-4bbc-b204-92c6dd554f06 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (196cf091-fe81-4d9c-b2d4-2ddece983f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d03a741-5eb8-46f0-9dfe-e89527fe99d1', 'volume_name': 'volume-4d03a741-5eb8-46f0-9dfe-e89527fe99d1', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:54 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8282817d-4f0f-4bbc-b204-92c6dd554f06 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b48780de-839a-42da-85cb-1b611f8dd80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:54 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8282817d-4f0f-4bbc-b204-92c6dd554f06 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b48780de-839a-42da-85cb-1b611f8dd80a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:54 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8282817d-4f0f-4bbc-b204-92c6dd554f06 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d19b786-8553-4ba5-a503-b3466b0c6717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:54 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-8282817d-4f0f-4bbc-b204-92c6dd554f06 tempest-ProjectMemberTests-411164925 None] Volume 4d03a741-5eb8-46f0-9dfe-e89527fe99d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d03a741-5eb8-46f0-9dfe-e89527fe99d1', 'volume_size': 1} Sep 08 07:01:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8282817d-4f0f-4bbc-b204-92c6dd554f06 tempest-ProjectMemberTests-411164925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:54 devstack sudo[126751]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bde33365-7931-4d77-8bd7-56ae08742d9a tempest-ProjectReaderTests-1152707596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f15cd4cc-8742-4035-8286-7fef4ff788e5.d7e7a02e-9214-4c2c-93ff-356e36728cf8" returned: 0 in 0.270s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bde33365-7931-4d77-8bd7-56ae08742d9a tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f15cd4cc-8742-4035-8286-7fef4ff788e5.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:54 devstack sudo[126761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f15cd4cc-8742-4035-8286-7fef4ff788e5.info Sep 08 07:01:54 devstack sudo[126761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:54 devstack sudo[126761]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bde33365-7931-4d77-8bd7-56ae08742d9a tempest-ProjectReaderTests-1152707596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f15cd4cc-8742-4035-8286-7fef4ff788e5.info" returned: 0 in 0.257s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:54 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-bde33365-7931-4d77-8bd7-56ae08742d9a tempest-ProjectReaderTests-1152707596 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f15cd4cc-8742-4035-8286-7fef4ff788e5.info is being set with open permissions: ugo+rw Sep 08 07:01:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bde33365-7931-4d77-8bd7-56ae08742d9a tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f15cd4cc-8742-4035-8286-7fef4ff788e5.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:54 devstack sudo[126773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f15cd4cc-8742-4035-8286-7fef4ff788e5.info Sep 08 07:01:54 devstack sudo[126773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:55 devstack sudo[126773]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bde33365-7931-4d77-8bd7-56ae08742d9a tempest-ProjectReaderTests-1152707596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f15cd4cc-8742-4035-8286-7fef4ff788e5.info" returned: 0 in 0.261s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-bde33365-7931-4d77-8bd7-56ae08742d9a tempest-ProjectReaderTests-1152707596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.258s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8282817d-4f0f-4bbc-b204-92c6dd554f06 tempest-ProjectMemberTests-411164925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.665s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:55 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8282817d-4f0f-4bbc-b204-92c6dd554f06 tempest-ProjectMemberTests-411164925 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:01:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1072806978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d03a741-5eb8-46f0-9dfe-e89527fe99d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc639babed634473856ad52d77e5a6af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:01:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:01:54Z,use_quota=True,user_id='c850edcf996545b89f3d8d0b683570e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:01:55 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-8282817d-4f0f-4bbc-b204-92c6dd554f06 tempest-ProjectMemberTests-411164925 None] Creating volume 4d03a741-5eb8-46f0-9dfe-e89527fe99d1 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:01:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8282817d-4f0f-4bbc-b204-92c6dd554f06 tempest-ProjectMemberTests-411164925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8282817d-4f0f-4bbc-b204-92c6dd554f06 tempest-ProjectMemberTests-411164925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:55 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8282817d-4f0f-4bbc-b204-92c6dd554f06 tempest-ProjectMemberTests-411164925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:01:55 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8282817d-4f0f-4bbc-b204-92c6dd554f06 tempest-ProjectMemberTests-411164925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:01:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8282817d-4f0f-4bbc-b204-92c6dd554f06 tempest-ProjectMemberTests-411164925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:55 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8282817d-4f0f-4bbc-b204-92c6dd554f06 tempest-ProjectMemberTests-411164925 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:01:55 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-8282817d-4f0f-4bbc-b204-92c6dd554f06 tempest-ProjectMemberTests-411164925 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 07:01:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8282817d-4f0f-4bbc-b204-92c6dd554f06 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d03a741-5eb8-46f0-9dfe-e89527fe99d1 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:55 devstack sudo[126785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d03a741-5eb8-46f0-9dfe-e89527fe99d1 1073741824 Sep 08 07:01:55 devstack sudo[126785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:55 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-bde33365-7931-4d77-8bd7-56ae08742d9a tempest-ProjectReaderTests-1152707596 None] Create snapshot completed successfully Sep 08 07:01:55 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-07b0d93d-eacc-4362-b674-667b20fef633 tempest-CinderUnicodeTest-1861632318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:01:55 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-07b0d93d-eacc-4362-b674-667b20fef633 tempest-CinderUnicodeTest-1861632318 None] Flow 'volume_create_manager' (c75739ba-ae74-4c8d-84f5-f3930771b082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:01:55 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-07b0d93d-eacc-4362-b674-667b20fef633 tempest-CinderUnicodeTest-1861632318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a5bb5d1-0cb1-4ba3-8b9a-92379fab1482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:55 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-07b0d93d-eacc-4362-b674-667b20fef633 tempest-CinderUnicodeTest-1861632318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a5bb5d1-0cb1-4ba3-8b9a-92379fab1482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:01:55Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6e2bbf7-8a96-4fe2-8ab9-166832b45152,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8750d5f5d1648d9a1dea58dc6ac4a3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:01:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:01:56Z,use_quota=True,user_id='3b4ec939b9254d2fbfc6b71189a04f53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:55 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-07b0d93d-eacc-4362-b674-667b20fef633 tempest-CinderUnicodeTest-1861632318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecb9fc3f-f1f3-4f2e-90e4-7060a576b0c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:55 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-07b0d93d-eacc-4362-b674-667b20fef633 tempest-CinderUnicodeTest-1861632318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecb9fc3f-f1f3-4f2e-90e4-7060a576b0c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:55 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-07b0d93d-eacc-4362-b674-667b20fef633 tempest-CinderUnicodeTest-1861632318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6c5f028-87fa-431d-b918-af6d4c3f0d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:55 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-07b0d93d-eacc-4362-b674-667b20fef633 tempest-CinderUnicodeTest-1861632318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6c5f028-87fa-431d-b918-af6d4c3f0d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6e2bbf7-8a96-4fe2-8ab9-166832b45152', 'volume_name': 'volume-f6e2bbf7-8a96-4fe2-8ab9-166832b45152', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:55 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-07b0d93d-eacc-4362-b674-667b20fef633 tempest-CinderUnicodeTest-1861632318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a065b8f-1ec1-4e49-bcb7-18d79ef00a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:55 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-07b0d93d-eacc-4362-b674-667b20fef633 tempest-CinderUnicodeTest-1861632318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a065b8f-1ec1-4e49-bcb7-18d79ef00a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:55 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-07b0d93d-eacc-4362-b674-667b20fef633 tempest-CinderUnicodeTest-1861632318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64de6fc1-4429-4467-b8e8-9222268f3bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:55 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-07b0d93d-eacc-4362-b674-667b20fef633 tempest-CinderUnicodeTest-1861632318 None] Volume f6e2bbf7-8a96-4fe2-8ab9-166832b45152: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6e2bbf7-8a96-4fe2-8ab9-166832b45152', 'volume_size': 1} Sep 08 07:01:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-07b0d93d-eacc-4362-b674-667b20fef633 tempest-CinderUnicodeTest-1861632318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:55 devstack sudo[126785]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8282817d-4f0f-4bbc-b204-92c6dd554f06 tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d03a741-5eb8-46f0-9dfe-e89527fe99d1 1073741824" returned: 0 in 0.462s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8282817d-4f0f-4bbc-b204-92c6dd554f06 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d03a741-5eb8-46f0-9dfe-e89527fe99d1 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:55 devstack sudo[126807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d03a741-5eb8-46f0-9dfe-e89527fe99d1 Sep 08 07:01:55 devstack sudo[126807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:55 devstack sudo[126807]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8282817d-4f0f-4bbc-b204-92c6dd554f06 tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d03a741-5eb8-46f0-9dfe-e89527fe99d1" returned: 0 in 0.237s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:55 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8282817d-4f0f-4bbc-b204-92c6dd554f06 tempest-ProjectMemberTests-411164925 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:01:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8282817d-4f0f-4bbc-b204-92c6dd554f06 tempest-ProjectMemberTests-411164925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-07b0d93d-eacc-4362-b674-667b20fef633 tempest-CinderUnicodeTest-1861632318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.328s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:55 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-07b0d93d-eacc-4362-b674-667b20fef633 tempest-CinderUnicodeTest-1861632318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:01:55Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6e2bbf7-8a96-4fe2-8ab9-166832b45152,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8750d5f5d1648d9a1dea58dc6ac4a3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:01:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:01:56Z,use_quota=True,user_id='3b4ec939b9254d2fbfc6b71189a04f53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:01:55 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-07b0d93d-eacc-4362-b674-667b20fef633 tempest-CinderUnicodeTest-1861632318 None] Creating volume f6e2bbf7-8a96-4fe2-8ab9-166832b45152 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:01:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-07b0d93d-eacc-4362-b674-667b20fef633 tempest-CinderUnicodeTest-1861632318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-07b0d93d-eacc-4362-b674-667b20fef633 tempest-CinderUnicodeTest-1861632318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:55 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-07b0d93d-eacc-4362-b674-667b20fef633 tempest-CinderUnicodeTest-1861632318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:01:55 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-07b0d93d-eacc-4362-b674-667b20fef633 tempest-CinderUnicodeTest-1861632318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:01:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-07b0d93d-eacc-4362-b674-667b20fef633 tempest-CinderUnicodeTest-1861632318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:55 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-07b0d93d-eacc-4362-b674-667b20fef633 tempest-CinderUnicodeTest-1861632318 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:01:55 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-07b0d93d-eacc-4362-b674-667b20fef633 tempest-CinderUnicodeTest-1861632318 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 07:01:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-07b0d93d-eacc-4362-b674-667b20fef633 tempest-CinderUnicodeTest-1861632318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f6e2bbf7-8a96-4fe2-8ab9-166832b45152 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:56 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8282817d-4f0f-4bbc-b204-92c6dd554f06 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d19b786-8553-4ba5-a503-b3466b0c6717) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d03a741-5eb8-46f0-9dfe-e89527fe99d1', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:56 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8282817d-4f0f-4bbc-b204-92c6dd554f06 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad856c7b-1e42-40b8-9f1f-33ecc2936b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:56 devstack sudo[126816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f6e2bbf7-8a96-4fe2-8ab9-166832b45152 1073741824 Sep 08 07:01:56 devstack sudo[126816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:56 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-8282817d-4f0f-4bbc-b204-92c6dd554f06 tempest-ProjectMemberTests-411164925 None] Volume volume-4d03a741-5eb8-46f0-9dfe-e89527fe99d1 (4d03a741-5eb8-46f0-9dfe-e89527fe99d1): created successfully Sep 08 07:01:56 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8282817d-4f0f-4bbc-b204-92c6dd554f06 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad856c7b-1e42-40b8-9f1f-33ecc2936b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:56 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8282817d-4f0f-4bbc-b204-92c6dd554f06 tempest-ProjectMemberTests-411164925 None] Flow 'volume_create_manager' (3f4e41e5-6616-44bd-9465-23dc8b91cd4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:01:56 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-8282817d-4f0f-4bbc-b204-92c6dd554f06 tempest-ProjectMemberTests-411164925 None] Created volume successfully. Sep 08 07:01:56 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-bff4d1c6-c259-413f-994f-e656893093bc tempest-ProjectReaderTests-1152707596 None] Acquiring lock "cinder-d7e7a02e-9214-4c2c-93ff-356e36728cf8-delete_snapshot" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:01:56 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-bff4d1c6-c259-413f-994f-e656893093bc tempest-ProjectReaderTests-1152707596 None] Lock "cinder-d7e7a02e-9214-4c2c-93ff-356e36728cf8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:01:56 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-bff4d1c6-c259-413f-994f-e656893093bc tempest-ProjectReaderTests-1152707596 None] Acquiring lock "cinder-quobyte-f15cd4cc-8742-4035-8286-7fef4ff788e5" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:01:56 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-bff4d1c6-c259-413f-994f-e656893093bc tempest-ProjectReaderTests-1152707596 None] Lock "cinder-quobyte-f15cd4cc-8742-4035-8286-7fef4ff788e5" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:01:56 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-bff4d1c6-c259-413f-994f-e656893093bc tempest-ProjectReaderTests-1152707596 None] Acquiring lock "cinder-quobyte-d7e7a02e-9214-4c2c-93ff-356e36728cf8" by "_delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:01:56 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-bff4d1c6-c259-413f-994f-e656893093bc tempest-ProjectReaderTests-1152707596 None] Lock "cinder-quobyte-d7e7a02e-9214-4c2c-93ff-356e36728cf8" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:01:56 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-bff4d1c6-c259-413f-994f-e656893093bc tempest-ProjectReaderTests-1152707596 None] Deleting offline snapshot d7e7a02e-9214-4c2c-93ff-356e36728cf8 of volume f15cd4cc-8742-4035-8286-7fef4ff788e5 {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 07:01:56 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-bff4d1c6-c259-413f-994f-e656893093bc tempest-ProjectReaderTests-1152707596 None] snapshot_file for this snap is: volume-f15cd4cc-8742-4035-8286-7fef4ff788e5.d7e7a02e-9214-4c2c-93ff-356e36728cf8 {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 07:01:56 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[405fda1e-ffc8-4bf6-b97a-2693ecc2d025]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:01:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bff4d1c6-c259-413f-994f-e656893093bc tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f15cd4cc-8742-4035-8286-7fef4ff788e5.d7e7a02e-9214-4c2c-93ff-356e36728cf8 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:56 devstack sudo[126830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f15cd4cc-8742-4035-8286-7fef4ff788e5.d7e7a02e-9214-4c2c-93ff-356e36728cf8 Sep 08 07:01:56 devstack sudo[126830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:56 devstack sudo[126816]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-07b0d93d-eacc-4362-b674-667b20fef633 tempest-CinderUnicodeTest-1861632318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f6e2bbf7-8a96-4fe2-8ab9-166832b45152 1073741824" returned: 0 in 0.453s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-07b0d93d-eacc-4362-b674-667b20fef633 tempest-CinderUnicodeTest-1861632318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f6e2bbf7-8a96-4fe2-8ab9-166832b45152 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:56 devstack sudo[126839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f6e2bbf7-8a96-4fe2-8ab9-166832b45152 Sep 08 07:01:56 devstack sudo[126839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:56 devstack sudo[126830]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bff4d1c6-c259-413f-994f-e656893093bc tempest-ProjectReaderTests-1152707596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f15cd4cc-8742-4035-8286-7fef4ff788e5.d7e7a02e-9214-4c2c-93ff-356e36728cf8" returned: 0 in 0.423s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:56 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-bff4d1c6-c259-413f-994f-e656893093bc tempest-ProjectReaderTests-1152707596 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f15cd4cc-8742-4035-8286-7fef4ff788e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:01:56 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[156be74c-ac2b-4232-ad12-8a6088455d97]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:01:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bff4d1c6-c259-413f-994f-e656893093bc tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f15cd4cc-8742-4035-8286-7fef4ff788e5 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-c7a59518-f86b-465e-b848-12ed620d9894 tempest-ProjectMemberTests-411164925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:56 devstack sudo[126839]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-07b0d93d-eacc-4362-b674-667b20fef633 tempest-CinderUnicodeTest-1861632318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f6e2bbf7-8a96-4fe2-8ab9-166832b45152" returned: 0 in 0.292s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:56 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-07b0d93d-eacc-4362-b674-667b20fef633 tempest-CinderUnicodeTest-1861632318 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:01:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-07b0d93d-eacc-4362-b674-667b20fef633 tempest-CinderUnicodeTest-1861632318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-c7a59518-f86b-465e-b848-12ed620d9894 tempest-ProjectMemberTests-411164925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.014s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:56 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-07b0d93d-eacc-4362-b674-667b20fef633 tempest-CinderUnicodeTest-1861632318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64de6fc1-4429-4467-b8e8-9222268f3bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6e2bbf7-8a96-4fe2-8ab9-166832b45152', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:56 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-07b0d93d-eacc-4362-b674-667b20fef633 tempest-CinderUnicodeTest-1861632318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cd2fb5f-1caa-4caf-bdcf-7a6022941b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:56 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-c7a59518-f86b-465e-b848-12ed620d9894 tempest-ProjectMemberTests-411164925 None] Creating offline snapshot 7e6b9d12-78cf-4d41-9b31-e985984ea94e of volume 4d03a741-5eb8-46f0-9dfe-e89527fe99d1 {{(pid=87507) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 07:01:56 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-07b0d93d-eacc-4362-b674-667b20fef633 tempest-CinderUnicodeTest-1861632318 None] Volume volume-f6e2bbf7-8a96-4fe2-8ab9-166832b45152 (f6e2bbf7-8a96-4fe2-8ab9-166832b45152): created successfully Sep 08 07:01:56 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-07b0d93d-eacc-4362-b674-667b20fef633 tempest-CinderUnicodeTest-1861632318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cd2fb5f-1caa-4caf-bdcf-7a6022941b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:56 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-07b0d93d-eacc-4362-b674-667b20fef633 tempest-CinderUnicodeTest-1861632318 None] Flow 'volume_create_manager' (c75739ba-ae74-4c8d-84f5-f3930771b082) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:01:56 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b8d36c-bcf6-4b3f-be4c-259daee77ce1]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:01:56 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-c7a59518-f86b-465e-b848-12ed620d9894 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d03a741-5eb8-46f0-9dfe-e89527fe99d1 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:56 devstack sudo[126854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f15cd4cc-8742-4035-8286-7fef4ff788e5 Sep 08 07:01:56 devstack sudo[126854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:56 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-07b0d93d-eacc-4362-b674-667b20fef633 tempest-CinderUnicodeTest-1861632318 None] Created volume successfully. Sep 08 07:01:56 devstack sudo[126859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d03a741-5eb8-46f0-9dfe-e89527fe99d1 Sep 08 07:01:56 devstack sudo[126859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:57 devstack sudo[126854]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:57 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bff4d1c6-c259-413f-994f-e656893093bc tempest-ProjectReaderTests-1152707596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f15cd4cc-8742-4035-8286-7fef4ff788e5" returned: 0 in 0.366s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:57 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bff4d1c6-c259-413f-994f-e656893093bc tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f15cd4cc-8742-4035-8286-7fef4ff788e5.d7e7a02e-9214-4c2c-93ff-356e36728cf8 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:57 devstack sudo[126870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f15cd4cc-8742-4035-8286-7fef4ff788e5.d7e7a02e-9214-4c2c-93ff-356e36728cf8 Sep 08 07:01:57 devstack sudo[126870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:57 devstack sudo[126859]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:57 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-c7a59518-f86b-465e-b848-12ed620d9894 tempest-ProjectMemberTests-411164925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d03a741-5eb8-46f0-9dfe-e89527fe99d1" returned: 0 in 0.378s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:57 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-c7a59518-f86b-465e-b848-12ed620d9894 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d03a741-5eb8-46f0-9dfe-e89527fe99d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d03a741-5eb8-46f0-9dfe-e89527fe99d1.7e6b9d12-78cf-4d41-9b31-e985984ea94e 1G {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:57 devstack sudo[126881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d03a741-5eb8-46f0-9dfe-e89527fe99d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d03a741-5eb8-46f0-9dfe-e89527fe99d1.7e6b9d12-78cf-4d41-9b31-e985984ea94e 1G Sep 08 07:01:57 devstack sudo[126881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:57 devstack sudo[126870]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:57 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bff4d1c6-c259-413f-994f-e656893093bc tempest-ProjectReaderTests-1152707596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f15cd4cc-8742-4035-8286-7fef4ff788e5.d7e7a02e-9214-4c2c-93ff-356e36728cf8" returned: 0 in 0.339s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:57 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bff4d1c6-c259-413f-994f-e656893093bc tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f15cd4cc-8742-4035-8286-7fef4ff788e5.d7e7a02e-9214-4c2c-93ff-356e36728cf8 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:57 devstack sudo[126892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f15cd4cc-8742-4035-8286-7fef4ff788e5.d7e7a02e-9214-4c2c-93ff-356e36728cf8 Sep 08 07:01:57 devstack sudo[126892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:57 devstack sudo[126881]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:57 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-c7a59518-f86b-465e-b848-12ed620d9894 tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d03a741-5eb8-46f0-9dfe-e89527fe99d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d03a741-5eb8-46f0-9dfe-e89527fe99d1.7e6b9d12-78cf-4d41-9b31-e985984ea94e 1G" returned: 0 in 0.432s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:57 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-c7a59518-f86b-465e-b848-12ed620d9894 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d03a741-5eb8-46f0-9dfe-e89527fe99d1 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d03a741-5eb8-46f0-9dfe-e89527fe99d1.7e6b9d12-78cf-4d41-9b31-e985984ea94e {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:57 devstack sudo[126905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d03a741-5eb8-46f0-9dfe-e89527fe99d1 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d03a741-5eb8-46f0-9dfe-e89527fe99d1.7e6b9d12-78cf-4d41-9b31-e985984ea94e Sep 08 07:01:57 devstack sudo[126905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:57 devstack sudo[126892]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:57 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-bff4d1c6-c259-413f-994f-e656893093bc tempest-ProjectReaderTests-1152707596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f15cd4cc-8742-4035-8286-7fef4ff788e5.d7e7a02e-9214-4c2c-93ff-356e36728cf8" returned: 0 in 0.270s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:57 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-bff4d1c6-c259-413f-994f-e656893093bc tempest-ProjectReaderTests-1152707596 None] Lock "cinder-quobyte-d7e7a02e-9214-4c2c-93ff-356e36728cf8" released by "_delete_snapshot" :: held 1.530s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:01:57 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-bff4d1c6-c259-413f-994f-e656893093bc tempest-ProjectReaderTests-1152707596 None] Lock "cinder-quobyte-f15cd4cc-8742-4035-8286-7fef4ff788e5" released by "delete_snapshot" :: held 1.554s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:01:57 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-bff4d1c6-c259-413f-994f-e656893093bc tempest-ProjectReaderTests-1152707596 None] Created reservations ['a0c4f8ca-9e90-401b-afb6-e4b657c7fe3d', '8cc4a113-7464-410c-9c4d-fca724df978a', '93362bd6-4528-4234-b3ab-97d91a6af4c6', 'b3b1ea97-b683-4c2e-9649-ac97fab267d5'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:01:57 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-bff4d1c6-c259-413f-994f-e656893093bc tempest-ProjectReaderTests-1152707596 None] Delete snapshot completed successfully. Sep 08 07:01:57 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-bff4d1c6-c259-413f-994f-e656893093bc tempest-ProjectReaderTests-1152707596 None] Lock "cinder-d7e7a02e-9214-4c2c-93ff-356e36728cf8-delete_snapshot" released by "delete_snapshot" :: held 1.716s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:01:57 devstack sudo[126905]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:57 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-c7a59518-f86b-465e-b848-12ed620d9894 tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d03a741-5eb8-46f0-9dfe-e89527fe99d1 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d03a741-5eb8-46f0-9dfe-e89527fe99d1.7e6b9d12-78cf-4d41-9b31-e985984ea94e" returned: 0 in 0.320s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:57 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-c7a59518-f86b-465e-b848-12ed620d9894 tempest-ProjectMemberTests-411164925 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d03a741-5eb8-46f0-9dfe-e89527fe99d1.7e6b9d12-78cf-4d41-9b31-e985984ea94e is being set with open permissions: ugo+rw Sep 08 07:01:57 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-c7a59518-f86b-465e-b848-12ed620d9894 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d03a741-5eb8-46f0-9dfe-e89527fe99d1.7e6b9d12-78cf-4d41-9b31-e985984ea94e {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:58 devstack sudo[126919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d03a741-5eb8-46f0-9dfe-e89527fe99d1.7e6b9d12-78cf-4d41-9b31-e985984ea94e Sep 08 07:01:58 devstack sudo[126919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:58 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd90485f-0cfb-4e2c-95de-42c63fad5392 tempest-CinderUnicodeTest-1861632318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:01:58 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-dd90485f-0cfb-4e2c-95de-42c63fad5392 tempest-CinderUnicodeTest-1861632318 None] Flow 'volume_create_manager' (52798d48-a548-4bc8-8266-7c26aa4f8639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:01:58 devstack sudo[126919]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:58 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-dd90485f-0cfb-4e2c-95de-42c63fad5392 tempest-CinderUnicodeTest-1861632318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c9349ef-a53e-42a8-b401-289c22935f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:58 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-c7a59518-f86b-465e-b848-12ed620d9894 tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d03a741-5eb8-46f0-9dfe-e89527fe99d1.7e6b9d12-78cf-4d41-9b31-e985984ea94e" returned: 0 in 0.256s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:58 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-dd90485f-0cfb-4e2c-95de-42c63fad5392 tempest-CinderUnicodeTest-1861632318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c9349ef-a53e-42a8-b401-289c22935f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:01:58Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-544332041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=796c4ed8-a39b-410f-a7d2-842da5ad9f17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8750d5f5d1648d9a1dea58dc6ac4a3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:01:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:01:58Z,use_quota=True,user_id='3b4ec939b9254d2fbfc6b71189a04f53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:58 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-dd90485f-0cfb-4e2c-95de-42c63fad5392 tempest-CinderUnicodeTest-1861632318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58c01fd6-9067-4248-94dd-d89b42e0cd56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:58 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-dd90485f-0cfb-4e2c-95de-42c63fad5392 tempest-CinderUnicodeTest-1861632318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58c01fd6-9067-4248-94dd-d89b42e0cd56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:58 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-dd90485f-0cfb-4e2c-95de-42c63fad5392 tempest-CinderUnicodeTest-1861632318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b16b393-2b20-44fb-a01e-c13dbf484c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:58 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-dd90485f-0cfb-4e2c-95de-42c63fad5392 tempest-CinderUnicodeTest-1861632318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b16b393-2b20-44fb-a01e-c13dbf484c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '796c4ed8-a39b-410f-a7d2-842da5ad9f17', 'volume_name': 'volume-796c4ed8-a39b-410f-a7d2-842da5ad9f17', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:58 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-dd90485f-0cfb-4e2c-95de-42c63fad5392 tempest-CinderUnicodeTest-1861632318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52eae754-6750-4ffd-8c79-246933ddf7ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:58 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-dd90485f-0cfb-4e2c-95de-42c63fad5392 tempest-CinderUnicodeTest-1861632318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52eae754-6750-4ffd-8c79-246933ddf7ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:58 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-dd90485f-0cfb-4e2c-95de-42c63fad5392 tempest-CinderUnicodeTest-1861632318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e98bcc2-ec09-4749-a917-f3dfb099a606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:58 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-dd90485f-0cfb-4e2c-95de-42c63fad5392 tempest-CinderUnicodeTest-1861632318 None] Volume 796c4ed8-a39b-410f-a7d2-842da5ad9f17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-796c4ed8-a39b-410f-a7d2-842da5ad9f17', 'volume_size': 1} Sep 08 07:01:58 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-dd90485f-0cfb-4e2c-95de-42c63fad5392 tempest-CinderUnicodeTest-1861632318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:58 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-c7a59518-f86b-465e-b848-12ed620d9894 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d03a741-5eb8-46f0-9dfe-e89527fe99d1.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:58 devstack sudo[126936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d03a741-5eb8-46f0-9dfe-e89527fe99d1.info Sep 08 07:01:58 devstack sudo[126936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:58 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-5c38a148-b910-49cd-8c82-6da0cfd5efb6 tempest-ProjectReaderTests-1152707596 None] Acquiring lock "cinder-f15cd4cc-8742-4035-8286-7fef4ff788e5-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:01:58 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-5c38a148-b910-49cd-8c82-6da0cfd5efb6 tempest-ProjectReaderTests-1152707596 None] Lock "cinder-f15cd4cc-8742-4035-8286-7fef4ff788e5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:01:58 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-5c38a148-b910-49cd-8c82-6da0cfd5efb6 tempest-ProjectReaderTests-1152707596 None] Acquiring lock "cinder-quobyte-f15cd4cc-8742-4035-8286-7fef4ff788e5" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:01:58 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-5c38a148-b910-49cd-8c82-6da0cfd5efb6 tempest-ProjectReaderTests-1152707596 None] Lock "cinder-quobyte-f15cd4cc-8742-4035-8286-7fef4ff788e5" acquired by "delete_volume" :: waited 0.015s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:01:58 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90422fd-79b3-4337-8efd-fec1724be176]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:01:58 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5c38a148-b910-49cd-8c82-6da0cfd5efb6 tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f15cd4cc-8742-4035-8286-7fef4ff788e5 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:58 devstack sudo[126936]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:58 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-c7a59518-f86b-465e-b848-12ed620d9894 tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d03a741-5eb8-46f0-9dfe-e89527fe99d1.info" returned: 0 in 0.274s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:58 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-c7a59518-f86b-465e-b848-12ed620d9894 tempest-ProjectMemberTests-411164925 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d03a741-5eb8-46f0-9dfe-e89527fe99d1.info is being set with open permissions: ugo+rw Sep 08 07:01:58 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-c7a59518-f86b-465e-b848-12ed620d9894 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d03a741-5eb8-46f0-9dfe-e89527fe99d1.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:58 devstack sudo[126946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d03a741-5eb8-46f0-9dfe-e89527fe99d1.info Sep 08 07:01:58 devstack sudo[126946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:58 devstack sudo[126944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f15cd4cc-8742-4035-8286-7fef4ff788e5 Sep 08 07:01:58 devstack sudo[126944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:58 devstack sudo[126946]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:58 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-c7a59518-f86b-465e-b848-12ed620d9894 tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d03a741-5eb8-46f0-9dfe-e89527fe99d1.info" returned: 0 in 0.267s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:58 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-c7a59518-f86b-465e-b848-12ed620d9894 tempest-ProjectMemberTests-411164925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.107s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:58 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-dd90485f-0cfb-4e2c-95de-42c63fad5392 tempest-CinderUnicodeTest-1861632318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.587s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:58 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-dd90485f-0cfb-4e2c-95de-42c63fad5392 tempest-CinderUnicodeTest-1861632318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:01:58Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-544332041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=796c4ed8-a39b-410f-a7d2-842da5ad9f17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8750d5f5d1648d9a1dea58dc6ac4a3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:01:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:01:58Z,use_quota=True,user_id='3b4ec939b9254d2fbfc6b71189a04f53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:01:58 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-dd90485f-0cfb-4e2c-95de-42c63fad5392 tempest-CinderUnicodeTest-1861632318 None] Creating volume 796c4ed8-a39b-410f-a7d2-842da5ad9f17 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:01:58 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-dd90485f-0cfb-4e2c-95de-42c63fad5392 tempest-CinderUnicodeTest-1861632318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:58 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-dd90485f-0cfb-4e2c-95de-42c63fad5392 tempest-CinderUnicodeTest-1861632318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:58 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-dd90485f-0cfb-4e2c-95de-42c63fad5392 tempest-CinderUnicodeTest-1861632318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:01:58 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-dd90485f-0cfb-4e2c-95de-42c63fad5392 tempest-CinderUnicodeTest-1861632318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:01:58 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-dd90485f-0cfb-4e2c-95de-42c63fad5392 tempest-CinderUnicodeTest-1861632318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:58 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-dd90485f-0cfb-4e2c-95de-42c63fad5392 tempest-CinderUnicodeTest-1861632318 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:01:58 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-dd90485f-0cfb-4e2c-95de-42c63fad5392 tempest-CinderUnicodeTest-1861632318 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 07:01:58 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-dd90485f-0cfb-4e2c-95de-42c63fad5392 tempest-CinderUnicodeTest-1861632318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-796c4ed8-a39b-410f-a7d2-842da5ad9f17 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:58 devstack sudo[126944]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:58 devstack sudo[126962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-796c4ed8-a39b-410f-a7d2-842da5ad9f17 1073741824 Sep 08 07:01:58 devstack sudo[126962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:58 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5c38a148-b910-49cd-8c82-6da0cfd5efb6 tempest-ProjectReaderTests-1152707596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f15cd4cc-8742-4035-8286-7fef4ff788e5" returned: 0 in 0.384s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:58 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5c38a148-b910-49cd-8c82-6da0cfd5efb6 tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f15cd4cc-8742-4035-8286-7fef4ff788e5 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:58 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-c7a59518-f86b-465e-b848-12ed620d9894 tempest-ProjectMemberTests-411164925 None] Create snapshot completed successfully Sep 08 07:01:58 devstack sudo[126967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f15cd4cc-8742-4035-8286-7fef4ff788e5 Sep 08 07:01:58 devstack sudo[126967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:59 devstack sudo[126967]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:59 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5c38a148-b910-49cd-8c82-6da0cfd5efb6 tempest-ProjectReaderTests-1152707596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f15cd4cc-8742-4035-8286-7fef4ff788e5" returned: 0 in 0.253s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:59 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-5c38a148-b910-49cd-8c82-6da0cfd5efb6 tempest-ProjectReaderTests-1152707596 None] Lock "cinder-quobyte-f15cd4cc-8742-4035-8286-7fef4ff788e5" released by "delete_volume" :: held 0.704s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:01:59 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-5c38a148-b910-49cd-8c82-6da0cfd5efb6 tempest-ProjectReaderTests-1152707596 None] Created reservations ['23e6133d-f085-45bf-bb81-f57b232af0bd', '72f27f23-be28-4f9d-aaa3-6fbbfe3d682a', '3dea668d-1b1c-4e75-b3e4-39c8172ae849', '86c1eb2a-9f01-4bfb-9e8e-588d33366f0d'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:01:59 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-5c38a148-b910-49cd-8c82-6da0cfd5efb6 tempest-ProjectReaderTests-1152707596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:01:59 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-5c38a148-b910-49cd-8c82-6da0cfd5efb6 tempest-ProjectReaderTests-1152707596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:01:59 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-5c38a148-b910-49cd-8c82-6da0cfd5efb6 tempest-ProjectReaderTests-1152707596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:01:59 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-5c38a148-b910-49cd-8c82-6da0cfd5efb6 tempest-ProjectReaderTests-1152707596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:01:59 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-5c38a148-b910-49cd-8c82-6da0cfd5efb6 tempest-ProjectReaderTests-1152707596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:59 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5c38a148-b910-49cd-8c82-6da0cfd5efb6 tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:59 devstack sudo[126962]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:59 devstack sudo[126987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 07:01:59 devstack sudo[126987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:59 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-dd90485f-0cfb-4e2c-95de-42c63fad5392 tempest-CinderUnicodeTest-1861632318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-796c4ed8-a39b-410f-a7d2-842da5ad9f17 1073741824" returned: 0 in 0.457s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:59 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-dd90485f-0cfb-4e2c-95de-42c63fad5392 tempest-CinderUnicodeTest-1861632318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-796c4ed8-a39b-410f-a7d2-842da5ad9f17 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:01:59 devstack sudo[126989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-796c4ed8-a39b-410f-a7d2-842da5ad9f17 Sep 08 07:01:59 devstack sudo[126989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:01:59 devstack sudo[126987]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:59 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5c38a148-b910-49cd-8c82-6da0cfd5efb6 tempest-ProjectReaderTests-1152707596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.267s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:59 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-5c38a148-b910-49cd-8c82-6da0cfd5efb6 tempest-ProjectReaderTests-1152707596 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:01:59 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-5c38a148-b910-49cd-8c82-6da0cfd5efb6 tempest-ProjectReaderTests-1152707596 None] Deleted volume successfully. Sep 08 07:01:59 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-5c38a148-b910-49cd-8c82-6da0cfd5efb6 tempest-ProjectReaderTests-1152707596 None] Lock "cinder-f15cd4cc-8742-4035-8286-7fef4ff788e5-delete_volume" released by "delete_volume" :: held 1.222s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:01:59 devstack sudo[126989]: pam_unix(sudo:session): session closed for user root Sep 08 07:01:59 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-dd90485f-0cfb-4e2c-95de-42c63fad5392 tempest-CinderUnicodeTest-1861632318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-796c4ed8-a39b-410f-a7d2-842da5ad9f17" returned: 0 in 0.277s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:01:59 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-dd90485f-0cfb-4e2c-95de-42c63fad5392 tempest-CinderUnicodeTest-1861632318 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:01:59 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-dd90485f-0cfb-4e2c-95de-42c63fad5392 tempest-CinderUnicodeTest-1861632318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:01:59 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-dd90485f-0cfb-4e2c-95de-42c63fad5392 tempest-CinderUnicodeTest-1861632318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e98bcc2-ec09-4749-a917-f3dfb099a606) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-796c4ed8-a39b-410f-a7d2-842da5ad9f17', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:59 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-dd90485f-0cfb-4e2c-95de-42c63fad5392 tempest-CinderUnicodeTest-1861632318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff83cc7d-4064-479d-8bb6-f17e5ba910ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:01:59 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-dd90485f-0cfb-4e2c-95de-42c63fad5392 tempest-CinderUnicodeTest-1861632318 None] Volume volume-796c4ed8-a39b-410f-a7d2-842da5ad9f17 (796c4ed8-a39b-410f-a7d2-842da5ad9f17): created successfully Sep 08 07:01:59 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-dd90485f-0cfb-4e2c-95de-42c63fad5392 tempest-CinderUnicodeTest-1861632318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff83cc7d-4064-479d-8bb6-f17e5ba910ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:01:59 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-dd90485f-0cfb-4e2c-95de-42c63fad5392 tempest-CinderUnicodeTest-1861632318 None] Flow 'volume_create_manager' (52798d48-a548-4bc8-8266-7c26aa4f8639) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:01:59 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-dd90485f-0cfb-4e2c-95de-42c63fad5392 tempest-CinderUnicodeTest-1861632318 None] Created volume successfully. Sep 08 07:01:59 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-1a96e275-5199-48cb-863c-2b9182390508 tempest-ProjectMemberTests-411164925 None] Acquiring lock "cinder-7e6b9d12-78cf-4d41-9b31-e985984ea94e-delete_snapshot" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:01:59 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-1a96e275-5199-48cb-863c-2b9182390508 tempest-ProjectMemberTests-411164925 None] Lock "cinder-7e6b9d12-78cf-4d41-9b31-e985984ea94e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:01:59 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-1a96e275-5199-48cb-863c-2b9182390508 tempest-ProjectMemberTests-411164925 None] Acquiring lock "cinder-quobyte-4d03a741-5eb8-46f0-9dfe-e89527fe99d1" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:01:59 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-1a96e275-5199-48cb-863c-2b9182390508 tempest-ProjectMemberTests-411164925 None] Lock "cinder-quobyte-4d03a741-5eb8-46f0-9dfe-e89527fe99d1" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:01:59 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-1a96e275-5199-48cb-863c-2b9182390508 tempest-ProjectMemberTests-411164925 None] Acquiring lock "cinder-quobyte-7e6b9d12-78cf-4d41-9b31-e985984ea94e" by "_delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:01:59 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-1a96e275-5199-48cb-863c-2b9182390508 tempest-ProjectMemberTests-411164925 None] Lock "cinder-quobyte-7e6b9d12-78cf-4d41-9b31-e985984ea94e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:01:59 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-1a96e275-5199-48cb-863c-2b9182390508 tempest-ProjectMemberTests-411164925 None] Deleting offline snapshot 7e6b9d12-78cf-4d41-9b31-e985984ea94e of volume 4d03a741-5eb8-46f0-9dfe-e89527fe99d1 {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 07:01:59 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-1a96e275-5199-48cb-863c-2b9182390508 tempest-ProjectMemberTests-411164925 None] snapshot_file for this snap is: volume-4d03a741-5eb8-46f0-9dfe-e89527fe99d1.7e6b9d12-78cf-4d41-9b31-e985984ea94e {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 07:02:00 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[137f9743-34fe-42e5-9ee8-3c61cba4dd8e]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:02:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1a96e275-5199-48cb-863c-2b9182390508 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d03a741-5eb8-46f0-9dfe-e89527fe99d1.7e6b9d12-78cf-4d41-9b31-e985984ea94e {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:00 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb142625-b393-4a67-b4f9-a4b772499b57 tempest-ProjectReaderTests-1152707596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:02:00 devstack sudo[127011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d03a741-5eb8-46f0-9dfe-e89527fe99d1.7e6b9d12-78cf-4d41-9b31-e985984ea94e Sep 08 07:02:00 devstack sudo[127011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:00 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-eb142625-b393-4a67-b4f9-a4b772499b57 tempest-ProjectReaderTests-1152707596 None] Flow 'volume_create_manager' (380cdc92-c154-4e6e-8703-71043e39ab74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:02:00 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-eb142625-b393-4a67-b4f9-a4b772499b57 tempest-ProjectReaderTests-1152707596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47bcbc04-efcc-4c5a-97aa-7a0d309f5dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:00 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-eb142625-b393-4a67-b4f9-a4b772499b57 tempest-ProjectReaderTests-1152707596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47bcbc04-efcc-4c5a-97aa-7a0d309f5dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:02:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1734522437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9052380-5344-470f-8b6f-6b8fae111f26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c6367f07ddf4a4cb92e17a1b8b6bb5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:02:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:02:00Z,use_quota=True,user_id='0b8690b455d34f248f0182e09db083f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:00 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-eb142625-b393-4a67-b4f9-a4b772499b57 tempest-ProjectReaderTests-1152707596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a14307ac-9d51-44c0-9070-d67ad93b82ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:00 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-eb142625-b393-4a67-b4f9-a4b772499b57 tempest-ProjectReaderTests-1152707596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a14307ac-9d51-44c0-9070-d67ad93b82ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:00 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-eb142625-b393-4a67-b4f9-a4b772499b57 tempest-ProjectReaderTests-1152707596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0587b965-2c5f-463f-8a11-e8cf9603acae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:00 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-eb142625-b393-4a67-b4f9-a4b772499b57 tempest-ProjectReaderTests-1152707596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0587b965-2c5f-463f-8a11-e8cf9603acae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9052380-5344-470f-8b6f-6b8fae111f26', 'volume_name': 'volume-f9052380-5344-470f-8b6f-6b8fae111f26', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:00 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-eb142625-b393-4a67-b4f9-a4b772499b57 tempest-ProjectReaderTests-1152707596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (325fd1d7-e721-4bf7-8938-b7d49c6d4806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:00 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-eb142625-b393-4a67-b4f9-a4b772499b57 tempest-ProjectReaderTests-1152707596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (325fd1d7-e721-4bf7-8938-b7d49c6d4806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:00 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-eb142625-b393-4a67-b4f9-a4b772499b57 tempest-ProjectReaderTests-1152707596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f698feb-df33-4a50-b5ed-4c060d51f17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:00 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-eb142625-b393-4a67-b4f9-a4b772499b57 tempest-ProjectReaderTests-1152707596 None] Volume f9052380-5344-470f-8b6f-6b8fae111f26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9052380-5344-470f-8b6f-6b8fae111f26', 'volume_size': 1} Sep 08 07:02:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-eb142625-b393-4a67-b4f9-a4b772499b57 tempest-ProjectReaderTests-1152707596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:02:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-eb142625-b393-4a67-b4f9-a4b772499b57 tempest-ProjectReaderTests-1152707596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:02:00 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-eb142625-b393-4a67-b4f9-a4b772499b57 tempest-ProjectReaderTests-1152707596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:02:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1734522437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9052380-5344-470f-8b6f-6b8fae111f26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c6367f07ddf4a4cb92e17a1b8b6bb5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:02:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:02:00Z,use_quota=True,user_id='0b8690b455d34f248f0182e09db083f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:02:00 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-eb142625-b393-4a67-b4f9-a4b772499b57 tempest-ProjectReaderTests-1152707596 None] Creating volume f9052380-5344-470f-8b6f-6b8fae111f26 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:02:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-eb142625-b393-4a67-b4f9-a4b772499b57 tempest-ProjectReaderTests-1152707596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:02:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-eb142625-b393-4a67-b4f9-a4b772499b57 tempest-ProjectReaderTests-1152707596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:02:00 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-eb142625-b393-4a67-b4f9-a4b772499b57 tempest-ProjectReaderTests-1152707596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:02:00 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-eb142625-b393-4a67-b4f9-a4b772499b57 tempest-ProjectReaderTests-1152707596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:02:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-eb142625-b393-4a67-b4f9-a4b772499b57 tempest-ProjectReaderTests-1152707596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:02:00 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-eb142625-b393-4a67-b4f9-a4b772499b57 tempest-ProjectReaderTests-1152707596 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:02:00 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-eb142625-b393-4a67-b4f9-a4b772499b57 tempest-ProjectReaderTests-1152707596 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 07:02:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-eb142625-b393-4a67-b4f9-a4b772499b57 tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f9052380-5344-470f-8b6f-6b8fae111f26 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:00 devstack sudo[127019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f9052380-5344-470f-8b6f-6b8fae111f26 1073741824 Sep 08 07:02:00 devstack sudo[127019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:00 devstack sudo[127011]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1a96e275-5199-48cb-863c-2b9182390508 tempest-ProjectMemberTests-411164925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d03a741-5eb8-46f0-9dfe-e89527fe99d1.7e6b9d12-78cf-4d41-9b31-e985984ea94e" returned: 0 in 0.389s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:00 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-1a96e275-5199-48cb-863c-2b9182390508 tempest-ProjectMemberTests-411164925 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d03a741-5eb8-46f0-9dfe-e89527fe99d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:02:00 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0705eb92-f547-4d20-9399-72c6fb66a6d7]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:02:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1a96e275-5199-48cb-863c-2b9182390508 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d03a741-5eb8-46f0-9dfe-e89527fe99d1 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:00 devstack sudo[127035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d03a741-5eb8-46f0-9dfe-e89527fe99d1 Sep 08 07:02:00 devstack sudo[127035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b2ac922c-c45c-4f46-8a79-edebe2a60b4c tempest-CinderUnicodeTest-1861632318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:02:00 devstack sudo[127019]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-eb142625-b393-4a67-b4f9-a4b772499b57 tempest-ProjectReaderTests-1152707596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f9052380-5344-470f-8b6f-6b8fae111f26 1073741824" returned: 0 in 0.477s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-eb142625-b393-4a67-b4f9-a4b772499b57 tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f9052380-5344-470f-8b6f-6b8fae111f26 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:00 devstack sudo[127047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f9052380-5344-470f-8b6f-6b8fae111f26 Sep 08 07:02:00 devstack sudo[127047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:00 devstack sudo[127035]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1a96e275-5199-48cb-863c-2b9182390508 tempest-ProjectMemberTests-411164925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d03a741-5eb8-46f0-9dfe-e89527fe99d1" returned: 0 in 0.380s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1a96e275-5199-48cb-863c-2b9182390508 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d03a741-5eb8-46f0-9dfe-e89527fe99d1.7e6b9d12-78cf-4d41-9b31-e985984ea94e {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:00 devstack sudo[127055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d03a741-5eb8-46f0-9dfe-e89527fe99d1.7e6b9d12-78cf-4d41-9b31-e985984ea94e Sep 08 07:02:00 devstack sudo[127055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:00 devstack sudo[127047]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-eb142625-b393-4a67-b4f9-a4b772499b57 tempest-ProjectReaderTests-1152707596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f9052380-5344-470f-8b6f-6b8fae111f26" returned: 0 in 0.253s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:00 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-eb142625-b393-4a67-b4f9-a4b772499b57 tempest-ProjectReaderTests-1152707596 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:02:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-eb142625-b393-4a67-b4f9-a4b772499b57 tempest-ProjectReaderTests-1152707596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:02:00 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b2ac922c-c45c-4f46-8a79-edebe2a60b4c tempest-CinderUnicodeTest-1861632318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.418s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:02:01 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-eb142625-b393-4a67-b4f9-a4b772499b57 tempest-ProjectReaderTests-1152707596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f698feb-df33-4a50-b5ed-4c060d51f17c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9052380-5344-470f-8b6f-6b8fae111f26', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:01 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-eb142625-b393-4a67-b4f9-a4b772499b57 tempest-ProjectReaderTests-1152707596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (573185db-acc8-4108-90dc-070313ca3510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:01 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-b2ac922c-c45c-4f46-8a79-edebe2a60b4c tempest-CinderUnicodeTest-1861632318 None] Creating offline snapshot 1f5ea058-8f6d-41de-97be-9108e9ac6c20 of volume 796c4ed8-a39b-410f-a7d2-842da5ad9f17 {{(pid=87507) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 07:02:01 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-eb142625-b393-4a67-b4f9-a4b772499b57 tempest-ProjectReaderTests-1152707596 None] Volume volume-f9052380-5344-470f-8b6f-6b8fae111f26 (f9052380-5344-470f-8b6f-6b8fae111f26): created successfully Sep 08 07:02:01 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-eb142625-b393-4a67-b4f9-a4b772499b57 tempest-ProjectReaderTests-1152707596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (573185db-acc8-4108-90dc-070313ca3510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:01 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-eb142625-b393-4a67-b4f9-a4b772499b57 tempest-ProjectReaderTests-1152707596 None] Flow 'volume_create_manager' (380cdc92-c154-4e6e-8703-71043e39ab74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:02:01 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be8edee-5acc-4126-87d1-460cdad35a35]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:02:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b2ac922c-c45c-4f46-8a79-edebe2a60b4c tempest-CinderUnicodeTest-1861632318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-796c4ed8-a39b-410f-a7d2-842da5ad9f17 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:01 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-eb142625-b393-4a67-b4f9-a4b772499b57 tempest-ProjectReaderTests-1152707596 None] Created volume successfully. Sep 08 07:02:01 devstack sudo[127055]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1a96e275-5199-48cb-863c-2b9182390508 tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d03a741-5eb8-46f0-9dfe-e89527fe99d1.7e6b9d12-78cf-4d41-9b31-e985984ea94e" returned: 0 in 0.348s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1a96e275-5199-48cb-863c-2b9182390508 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d03a741-5eb8-46f0-9dfe-e89527fe99d1.7e6b9d12-78cf-4d41-9b31-e985984ea94e {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:01 devstack sudo[127070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-796c4ed8-a39b-410f-a7d2-842da5ad9f17 Sep 08 07:02:01 devstack sudo[127070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:01 devstack sudo[127074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d03a741-5eb8-46f0-9dfe-e89527fe99d1.7e6b9d12-78cf-4d41-9b31-e985984ea94e Sep 08 07:02:01 devstack sudo[127074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:01 devstack sudo[127074]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-1a96e275-5199-48cb-863c-2b9182390508 tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d03a741-5eb8-46f0-9dfe-e89527fe99d1.7e6b9d12-78cf-4d41-9b31-e985984ea94e" returned: 0 in 0.253s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:01 devstack sudo[127070]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b2ac922c-c45c-4f46-8a79-edebe2a60b4c tempest-CinderUnicodeTest-1861632318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-796c4ed8-a39b-410f-a7d2-842da5ad9f17" returned: 0 in 0.393s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b2ac922c-c45c-4f46-8a79-edebe2a60b4c tempest-CinderUnicodeTest-1861632318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-796c4ed8-a39b-410f-a7d2-842da5ad9f17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-796c4ed8-a39b-410f-a7d2-842da5ad9f17.1f5ea058-8f6d-41de-97be-9108e9ac6c20 1G {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:01 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-1a96e275-5199-48cb-863c-2b9182390508 tempest-ProjectMemberTests-411164925 None] Lock "cinder-quobyte-7e6b9d12-78cf-4d41-9b31-e985984ea94e" released by "_delete_snapshot" :: held 1.480s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:02:01 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-1a96e275-5199-48cb-863c-2b9182390508 tempest-ProjectMemberTests-411164925 None] Lock "cinder-quobyte-4d03a741-5eb8-46f0-9dfe-e89527fe99d1" released by "delete_snapshot" :: held 1.504s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:02:01 devstack sudo[127089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-796c4ed8-a39b-410f-a7d2-842da5ad9f17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-796c4ed8-a39b-410f-a7d2-842da5ad9f17.1f5ea058-8f6d-41de-97be-9108e9ac6c20 1G Sep 08 07:02:01 devstack sudo[127089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:01 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-1a96e275-5199-48cb-863c-2b9182390508 tempest-ProjectMemberTests-411164925 None] Created reservations ['7be4f688-8cb2-4e6a-87c9-bca69451bd50', 'fddc134a-888f-428a-83ef-c59d40a2ffa0', 'bf42f2e8-e76d-4e0b-9f7b-94e690b7d3fb', '911e2980-9dd5-40d3-ac3a-64a0bab53633'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:02:01 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-1a96e275-5199-48cb-863c-2b9182390508 tempest-ProjectMemberTests-411164925 None] Delete snapshot completed successfully. Sep 08 07:02:01 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-1a96e275-5199-48cb-863c-2b9182390508 tempest-ProjectMemberTests-411164925 None] Lock "cinder-7e6b9d12-78cf-4d41-9b31-e985984ea94e-delete_snapshot" released by "delete_snapshot" :: held 1.673s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:02:01 devstack sudo[127089]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b2ac922c-c45c-4f46-8a79-edebe2a60b4c tempest-CinderUnicodeTest-1861632318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-796c4ed8-a39b-410f-a7d2-842da5ad9f17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-796c4ed8-a39b-410f-a7d2-842da5ad9f17.1f5ea058-8f6d-41de-97be-9108e9ac6c20 1G" returned: 0 in 0.408s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:01 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b2ac922c-c45c-4f46-8a79-edebe2a60b4c tempest-CinderUnicodeTest-1861632318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-796c4ed8-a39b-410f-a7d2-842da5ad9f17 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-796c4ed8-a39b-410f-a7d2-842da5ad9f17.1f5ea058-8f6d-41de-97be-9108e9ac6c20 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:01 devstack sudo[127107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-796c4ed8-a39b-410f-a7d2-842da5ad9f17 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-796c4ed8-a39b-410f-a7d2-842da5ad9f17.1f5ea058-8f6d-41de-97be-9108e9ac6c20 Sep 08 07:02:01 devstack sudo[127107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:02 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-d8797ea3-77d1-49f3-bdef-ba890a790147 tempest-ProjectMemberTests-411164925 None] Acquiring lock "cinder-4d03a741-5eb8-46f0-9dfe-e89527fe99d1-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:02:02 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-d8797ea3-77d1-49f3-bdef-ba890a790147 tempest-ProjectMemberTests-411164925 None] Lock "cinder-4d03a741-5eb8-46f0-9dfe-e89527fe99d1-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:02:02 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-d8797ea3-77d1-49f3-bdef-ba890a790147 tempest-ProjectMemberTests-411164925 None] Acquiring lock "cinder-quobyte-4d03a741-5eb8-46f0-9dfe-e89527fe99d1" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:02:02 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-d8797ea3-77d1-49f3-bdef-ba890a790147 tempest-ProjectMemberTests-411164925 None] Lock "cinder-quobyte-4d03a741-5eb8-46f0-9dfe-e89527fe99d1" acquired by "delete_volume" :: waited 0.025s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:02:02 devstack sudo[127107]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:02 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b2ac922c-c45c-4f46-8a79-edebe2a60b4c tempest-CinderUnicodeTest-1861632318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-796c4ed8-a39b-410f-a7d2-842da5ad9f17 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-796c4ed8-a39b-410f-a7d2-842da5ad9f17.1f5ea058-8f6d-41de-97be-9108e9ac6c20" returned: 0 in 0.372s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:02 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-b2ac922c-c45c-4f46-8a79-edebe2a60b4c tempest-CinderUnicodeTest-1861632318 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-796c4ed8-a39b-410f-a7d2-842da5ad9f17.1f5ea058-8f6d-41de-97be-9108e9ac6c20 is being set with open permissions: ugo+rw Sep 08 07:02:02 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b2ac922c-c45c-4f46-8a79-edebe2a60b4c tempest-CinderUnicodeTest-1861632318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-796c4ed8-a39b-410f-a7d2-842da5ad9f17.1f5ea058-8f6d-41de-97be-9108e9ac6c20 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:02 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[9634a0ba-65f9-4be1-baec-e4511469a7b3]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:02:02 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-d8797ea3-77d1-49f3-bdef-ba890a790147 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d03a741-5eb8-46f0-9dfe-e89527fe99d1 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:02 devstack sudo[127121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-796c4ed8-a39b-410f-a7d2-842da5ad9f17.1f5ea058-8f6d-41de-97be-9108e9ac6c20 Sep 08 07:02:02 devstack sudo[127121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:02 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a3dfcc81-7245-4e59-84ab-f9549b75e774 tempest-ProjectReaderTests-1152707596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:02:02 devstack sudo[127125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d03a741-5eb8-46f0-9dfe-e89527fe99d1 Sep 08 07:02:02 devstack sudo[127125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:02 devstack sudo[127121]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:02 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b2ac922c-c45c-4f46-8a79-edebe2a60b4c tempest-CinderUnicodeTest-1861632318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-796c4ed8-a39b-410f-a7d2-842da5ad9f17.1f5ea058-8f6d-41de-97be-9108e9ac6c20" returned: 0 in 0.294s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:02 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b2ac922c-c45c-4f46-8a79-edebe2a60b4c tempest-CinderUnicodeTest-1861632318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-796c4ed8-a39b-410f-a7d2-842da5ad9f17.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:02 devstack sudo[127138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-796c4ed8-a39b-410f-a7d2-842da5ad9f17.info Sep 08 07:02:02 devstack sudo[127138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:02 devstack sudo[127125]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:02 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-d8797ea3-77d1-49f3-bdef-ba890a790147 tempest-ProjectMemberTests-411164925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d03a741-5eb8-46f0-9dfe-e89527fe99d1" returned: 0 in 0.421s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:02 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-d8797ea3-77d1-49f3-bdef-ba890a790147 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d03a741-5eb8-46f0-9dfe-e89527fe99d1 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:02 devstack sudo[127146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d03a741-5eb8-46f0-9dfe-e89527fe99d1 Sep 08 07:02:02 devstack sudo[127146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:02 devstack sudo[127138]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:02 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b2ac922c-c45c-4f46-8a79-edebe2a60b4c tempest-CinderUnicodeTest-1861632318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-796c4ed8-a39b-410f-a7d2-842da5ad9f17.info" returned: 0 in 0.257s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:02 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-b2ac922c-c45c-4f46-8a79-edebe2a60b4c tempest-CinderUnicodeTest-1861632318 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-796c4ed8-a39b-410f-a7d2-842da5ad9f17.info is being set with open permissions: ugo+rw Sep 08 07:02:02 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b2ac922c-c45c-4f46-8a79-edebe2a60b4c tempest-CinderUnicodeTest-1861632318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-796c4ed8-a39b-410f-a7d2-842da5ad9f17.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:02 devstack sudo[127152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-796c4ed8-a39b-410f-a7d2-842da5ad9f17.info Sep 08 07:02:02 devstack sudo[127152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:02 devstack sudo[127146]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:02 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-d8797ea3-77d1-49f3-bdef-ba890a790147 tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-4d03a741-5eb8-46f0-9dfe-e89527fe99d1" returned: 0 in 0.246s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:02 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-d8797ea3-77d1-49f3-bdef-ba890a790147 tempest-ProjectMemberTests-411164925 None] Lock "cinder-quobyte-4d03a741-5eb8-46f0-9dfe-e89527fe99d1" released by "delete_volume" :: held 0.749s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:02:02 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-d8797ea3-77d1-49f3-bdef-ba890a790147 tempest-ProjectMemberTests-411164925 None] Created reservations ['f234dd74-ff05-46b9-a773-c2d0bfa9021c', '420e26e0-60d4-4525-add8-93ba12857c67', '45a04e98-57d8-43b9-8df2-ef683f84bc42', '976c8fdc-3da5-4246-b418-21b91f50d2eb'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:02:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-d8797ea3-77d1-49f3-bdef-ba890a790147 tempest-ProjectMemberTests-411164925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:02:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-d8797ea3-77d1-49f3-bdef-ba890a790147 tempest-ProjectMemberTests-411164925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:02:03 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-d8797ea3-77d1-49f3-bdef-ba890a790147 tempest-ProjectMemberTests-411164925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:02:03 devstack sudo[127152]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:03 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-d8797ea3-77d1-49f3-bdef-ba890a790147 tempest-ProjectMemberTests-411164925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:02:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-d8797ea3-77d1-49f3-bdef-ba890a790147 tempest-ProjectMemberTests-411164925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:02:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-d8797ea3-77d1-49f3-bdef-ba890a790147 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b2ac922c-c45c-4f46-8a79-edebe2a60b4c tempest-CinderUnicodeTest-1861632318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-796c4ed8-a39b-410f-a7d2-842da5ad9f17.info" returned: 0 in 0.258s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:03 devstack sudo[127165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 07:02:03 devstack sudo[127165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b2ac922c-c45c-4f46-8a79-edebe2a60b4c tempest-CinderUnicodeTest-1861632318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.110s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:02:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a3dfcc81-7245-4e59-84ab-f9549b75e774 tempest-ProjectReaderTests-1152707596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.723s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:02:03 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-a3dfcc81-7245-4e59-84ab-f9549b75e774 tempest-ProjectReaderTests-1152707596 None] Creating offline snapshot 8e417283-44cc-45ce-b513-f43f991ea4ff of volume f9052380-5344-470f-8b6f-6b8fae111f26 {{(pid=87507) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 07:02:03 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[a434e4a7-c21f-4810-992b-cec220c325f6]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:02:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a3dfcc81-7245-4e59-84ab-f9549b75e774 tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f9052380-5344-470f-8b6f-6b8fae111f26 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:03 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-b2ac922c-c45c-4f46-8a79-edebe2a60b4c tempest-CinderUnicodeTest-1861632318 None] Create snapshot completed successfully Sep 08 07:02:03 devstack sudo[127167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f9052380-5344-470f-8b6f-6b8fae111f26 Sep 08 07:02:03 devstack sudo[127167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:03 devstack sudo[127165]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-d8797ea3-77d1-49f3-bdef-ba890a790147 tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.274s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:03 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-d8797ea3-77d1-49f3-bdef-ba890a790147 tempest-ProjectMemberTests-411164925 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:02:03 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-d8797ea3-77d1-49f3-bdef-ba890a790147 tempest-ProjectMemberTests-411164925 None] Deleted volume successfully. Sep 08 07:02:03 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-d8797ea3-77d1-49f3-bdef-ba890a790147 tempest-ProjectMemberTests-411164925 None] Lock "cinder-4d03a741-5eb8-46f0-9dfe-e89527fe99d1-delete_volume" released by "delete_volume" :: held 1.259s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:02:03 devstack sudo[127167]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a3dfcc81-7245-4e59-84ab-f9549b75e774 tempest-ProjectReaderTests-1152707596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f9052380-5344-470f-8b6f-6b8fae111f26" returned: 0 in 0.415s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a3dfcc81-7245-4e59-84ab-f9549b75e774 tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f9052380-5344-470f-8b6f-6b8fae111f26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f9052380-5344-470f-8b6f-6b8fae111f26.8e417283-44cc-45ce-b513-f43f991ea4ff 1G {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:03 devstack sudo[127188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f9052380-5344-470f-8b6f-6b8fae111f26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f9052380-5344-470f-8b6f-6b8fae111f26.8e417283-44cc-45ce-b513-f43f991ea4ff 1G Sep 08 07:02:03 devstack sudo[127188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:03 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-5d1577ba-42ac-44c2-ab83-b72073b872dd tempest-CinderUnicodeTest-1861632318 None] Acquiring lock "cinder-1f5ea058-8f6d-41de-97be-9108e9ac6c20-delete_snapshot" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:02:03 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-5d1577ba-42ac-44c2-ab83-b72073b872dd tempest-CinderUnicodeTest-1861632318 None] Lock "cinder-1f5ea058-8f6d-41de-97be-9108e9ac6c20-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:02:03 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-5d1577ba-42ac-44c2-ab83-b72073b872dd tempest-CinderUnicodeTest-1861632318 None] Acquiring lock "cinder-quobyte-796c4ed8-a39b-410f-a7d2-842da5ad9f17" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:02:03 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-5d1577ba-42ac-44c2-ab83-b72073b872dd tempest-CinderUnicodeTest-1861632318 None] Lock "cinder-quobyte-796c4ed8-a39b-410f-a7d2-842da5ad9f17" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:02:03 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-5d1577ba-42ac-44c2-ab83-b72073b872dd tempest-CinderUnicodeTest-1861632318 None] Acquiring lock "cinder-quobyte-1f5ea058-8f6d-41de-97be-9108e9ac6c20" by "_delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:02:03 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-5eeb100f-7f9e-48f7-ab2e-a0e7024bc8d9 tempest-ProjectMemberTests-411164925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:02:03 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5eeb100f-7f9e-48f7-ab2e-a0e7024bc8d9 tempest-ProjectMemberTests-411164925 None] Flow 'volume_create_manager' (fbe02a43-48ba-41fd-badb-f9d5defb1fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:02:03 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5eeb100f-7f9e-48f7-ab2e-a0e7024bc8d9 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fff7536-dc39-4e75-b3b8-4347ee1155be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:03 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-5d1577ba-42ac-44c2-ab83-b72073b872dd tempest-CinderUnicodeTest-1861632318 None] Lock "cinder-quobyte-1f5ea058-8f6d-41de-97be-9108e9ac6c20" acquired by "_delete_snapshot" :: waited 0.061s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:02:03 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-5d1577ba-42ac-44c2-ab83-b72073b872dd tempest-CinderUnicodeTest-1861632318 None] Deleting offline snapshot 1f5ea058-8f6d-41de-97be-9108e9ac6c20 of volume 796c4ed8-a39b-410f-a7d2-842da5ad9f17 {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 07:02:03 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-5d1577ba-42ac-44c2-ab83-b72073b872dd tempest-CinderUnicodeTest-1861632318 None] snapshot_file for this snap is: volume-796c4ed8-a39b-410f-a7d2-842da5ad9f17.1f5ea058-8f6d-41de-97be-9108e9ac6c20 {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 07:02:03 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be8f1cb-1409-4268-9931-8812973c99aa]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:02:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5d1577ba-42ac-44c2-ab83-b72073b872dd tempest-CinderUnicodeTest-1861632318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-796c4ed8-a39b-410f-a7d2-842da5ad9f17.1f5ea058-8f6d-41de-97be-9108e9ac6c20 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:03 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5eeb100f-7f9e-48f7-ab2e-a0e7024bc8d9 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fff7536-dc39-4e75-b3b8-4347ee1155be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:02:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-967388795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc639babed634473856ad52d77e5a6af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:02:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:02:04Z,use_quota=True,user_id='c850edcf996545b89f3d8d0b683570e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:03 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5eeb100f-7f9e-48f7-ab2e-a0e7024bc8d9 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f6d3ba0-02d0-44ad-9ae4-15340948acb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:03 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5eeb100f-7f9e-48f7-ab2e-a0e7024bc8d9 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f6d3ba0-02d0-44ad-9ae4-15340948acb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:03 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5eeb100f-7f9e-48f7-ab2e-a0e7024bc8d9 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6260d79-2860-4da0-a0fb-86b699370b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:03 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5eeb100f-7f9e-48f7-ab2e-a0e7024bc8d9 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6260d79-2860-4da0-a0fb-86b699370b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd910f8d0-8b20-4c8f-9aed-b861cb7ba8bb', 'volume_name': 'volume-d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:03 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5eeb100f-7f9e-48f7-ab2e-a0e7024bc8d9 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b296eff-33e4-4290-864b-48c0c0cba232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:03 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5eeb100f-7f9e-48f7-ab2e-a0e7024bc8d9 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b296eff-33e4-4290-864b-48c0c0cba232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:03 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5eeb100f-7f9e-48f7-ab2e-a0e7024bc8d9 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cd2b771-2511-4ba3-9f4f-b7350c46e9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:03 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-5eeb100f-7f9e-48f7-ab2e-a0e7024bc8d9 tempest-ProjectMemberTests-411164925 None] Volume d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb', 'volume_size': 1} Sep 08 07:02:03 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-5eeb100f-7f9e-48f7-ab2e-a0e7024bc8d9 tempest-ProjectMemberTests-411164925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:02:04 devstack sudo[127188]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:04 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a3dfcc81-7245-4e59-84ab-f9549b75e774 tempest-ProjectReaderTests-1152707596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f9052380-5344-470f-8b6f-6b8fae111f26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f9052380-5344-470f-8b6f-6b8fae111f26.8e417283-44cc-45ce-b513-f43f991ea4ff 1G" returned: 0 in 0.447s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:04 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a3dfcc81-7245-4e59-84ab-f9549b75e774 tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9052380-5344-470f-8b6f-6b8fae111f26 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f9052380-5344-470f-8b6f-6b8fae111f26.8e417283-44cc-45ce-b513-f43f991ea4ff {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:04 devstack sudo[127203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-796c4ed8-a39b-410f-a7d2-842da5ad9f17.1f5ea058-8f6d-41de-97be-9108e9ac6c20 Sep 08 07:02:04 devstack sudo[127203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:04 devstack sudo[127208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9052380-5344-470f-8b6f-6b8fae111f26 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f9052380-5344-470f-8b6f-6b8fae111f26.8e417283-44cc-45ce-b513-f43f991ea4ff Sep 08 07:02:04 devstack sudo[127208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:04 devstack sudo[127203]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:04 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5d1577ba-42ac-44c2-ab83-b72073b872dd tempest-CinderUnicodeTest-1861632318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-796c4ed8-a39b-410f-a7d2-842da5ad9f17.1f5ea058-8f6d-41de-97be-9108e9ac6c20" returned: 0 in 0.382s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:04 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-5d1577ba-42ac-44c2-ab83-b72073b872dd tempest-CinderUnicodeTest-1861632318 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-796c4ed8-a39b-410f-a7d2-842da5ad9f17(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:02:04 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[183dbe7d-eaa8-4739-8cb7-e508f60bc310]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:02:04 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5d1577ba-42ac-44c2-ab83-b72073b872dd tempest-CinderUnicodeTest-1861632318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-796c4ed8-a39b-410f-a7d2-842da5ad9f17 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:04 devstack sudo[127208]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:04 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a3dfcc81-7245-4e59-84ab-f9549b75e774 tempest-ProjectReaderTests-1152707596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9052380-5344-470f-8b6f-6b8fae111f26 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f9052380-5344-470f-8b6f-6b8fae111f26.8e417283-44cc-45ce-b513-f43f991ea4ff" returned: 0 in 0.315s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:04 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-a3dfcc81-7245-4e59-84ab-f9549b75e774 tempest-ProjectReaderTests-1152707596 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f9052380-5344-470f-8b6f-6b8fae111f26.8e417283-44cc-45ce-b513-f43f991ea4ff is being set with open permissions: ugo+rw Sep 08 07:02:04 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a3dfcc81-7245-4e59-84ab-f9549b75e774 tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f9052380-5344-470f-8b6f-6b8fae111f26.8e417283-44cc-45ce-b513-f43f991ea4ff {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:04 devstack sudo[127226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f9052380-5344-470f-8b6f-6b8fae111f26.8e417283-44cc-45ce-b513-f43f991ea4ff Sep 08 07:02:04 devstack sudo[127226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:04 devstack sudo[127225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-796c4ed8-a39b-410f-a7d2-842da5ad9f17 Sep 08 07:02:04 devstack sudo[127225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:04 devstack sudo[127226]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:04 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a3dfcc81-7245-4e59-84ab-f9549b75e774 tempest-ProjectReaderTests-1152707596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f9052380-5344-470f-8b6f-6b8fae111f26.8e417283-44cc-45ce-b513-f43f991ea4ff" returned: 0 in 0.262s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:04 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a3dfcc81-7245-4e59-84ab-f9549b75e774 tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f9052380-5344-470f-8b6f-6b8fae111f26.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:04 devstack sudo[127241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f9052380-5344-470f-8b6f-6b8fae111f26.info Sep 08 07:02:04 devstack sudo[127241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:04 devstack sudo[127225]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:04 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5d1577ba-42ac-44c2-ab83-b72073b872dd tempest-CinderUnicodeTest-1861632318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-796c4ed8-a39b-410f-a7d2-842da5ad9f17" returned: 0 in 0.371s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:04 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5d1577ba-42ac-44c2-ab83-b72073b872dd tempest-CinderUnicodeTest-1861632318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-796c4ed8-a39b-410f-a7d2-842da5ad9f17.1f5ea058-8f6d-41de-97be-9108e9ac6c20 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:04 devstack sudo[127247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-796c4ed8-a39b-410f-a7d2-842da5ad9f17.1f5ea058-8f6d-41de-97be-9108e9ac6c20 Sep 08 07:02:04 devstack sudo[127247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:04 devstack sudo[127241]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:04 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a3dfcc81-7245-4e59-84ab-f9549b75e774 tempest-ProjectReaderTests-1152707596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f9052380-5344-470f-8b6f-6b8fae111f26.info" returned: 0 in 0.272s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:04 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-a3dfcc81-7245-4e59-84ab-f9549b75e774 tempest-ProjectReaderTests-1152707596 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f9052380-5344-470f-8b6f-6b8fae111f26.info is being set with open permissions: ugo+rw Sep 08 07:02:04 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a3dfcc81-7245-4e59-84ab-f9549b75e774 tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f9052380-5344-470f-8b6f-6b8fae111f26.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:04 devstack sudo[127256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f9052380-5344-470f-8b6f-6b8fae111f26.info Sep 08 07:02:04 devstack sudo[127256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:05 devstack sudo[127247]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:05 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5d1577ba-42ac-44c2-ab83-b72073b872dd tempest-CinderUnicodeTest-1861632318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-796c4ed8-a39b-410f-a7d2-842da5ad9f17.1f5ea058-8f6d-41de-97be-9108e9ac6c20" returned: 0 in 0.353s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:05 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5d1577ba-42ac-44c2-ab83-b72073b872dd tempest-CinderUnicodeTest-1861632318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-796c4ed8-a39b-410f-a7d2-842da5ad9f17.1f5ea058-8f6d-41de-97be-9108e9ac6c20 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:05 devstack sudo[127265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-796c4ed8-a39b-410f-a7d2-842da5ad9f17.1f5ea058-8f6d-41de-97be-9108e9ac6c20 Sep 08 07:02:05 devstack sudo[127265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:05 devstack sudo[127256]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:05 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a3dfcc81-7245-4e59-84ab-f9549b75e774 tempest-ProjectReaderTests-1152707596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f9052380-5344-470f-8b6f-6b8fae111f26.info" returned: 0 in 0.242s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:05 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a3dfcc81-7245-4e59-84ab-f9549b75e774 tempest-ProjectReaderTests-1152707596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.049s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:02:05 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-5eeb100f-7f9e-48f7-ab2e-a0e7024bc8d9 tempest-ProjectMemberTests-411164925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.200s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:02:05 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-5eeb100f-7f9e-48f7-ab2e-a0e7024bc8d9 tempest-ProjectMemberTests-411164925 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:02:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-967388795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc639babed634473856ad52d77e5a6af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:02:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:02:04Z,use_quota=True,user_id='c850edcf996545b89f3d8d0b683570e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:02:05 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-5eeb100f-7f9e-48f7-ab2e-a0e7024bc8d9 tempest-ProjectMemberTests-411164925 None] Creating volume d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:02:05 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-5eeb100f-7f9e-48f7-ab2e-a0e7024bc8d9 tempest-ProjectMemberTests-411164925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:02:05 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-5eeb100f-7f9e-48f7-ab2e-a0e7024bc8d9 tempest-ProjectMemberTests-411164925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:02:05 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-5eeb100f-7f9e-48f7-ab2e-a0e7024bc8d9 tempest-ProjectMemberTests-411164925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:02:05 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-5eeb100f-7f9e-48f7-ab2e-a0e7024bc8d9 tempest-ProjectMemberTests-411164925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:02:05 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-5eeb100f-7f9e-48f7-ab2e-a0e7024bc8d9 tempest-ProjectMemberTests-411164925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:02:05 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-5eeb100f-7f9e-48f7-ab2e-a0e7024bc8d9 tempest-ProjectMemberTests-411164925 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:02:05 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-5eeb100f-7f9e-48f7-ab2e-a0e7024bc8d9 tempest-ProjectMemberTests-411164925 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 07:02:05 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5eeb100f-7f9e-48f7-ab2e-a0e7024bc8d9 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:05 devstack sudo[127272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb 1073741824 Sep 08 07:02:05 devstack sudo[127272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:05 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-a3dfcc81-7245-4e59-84ab-f9549b75e774 tempest-ProjectReaderTests-1152707596 None] Create snapshot completed successfully Sep 08 07:02:05 devstack sudo[127265]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:05 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5d1577ba-42ac-44c2-ab83-b72073b872dd tempest-CinderUnicodeTest-1861632318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-796c4ed8-a39b-410f-a7d2-842da5ad9f17.1f5ea058-8f6d-41de-97be-9108e9ac6c20" returned: 0 in 0.270s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:05 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-5d1577ba-42ac-44c2-ab83-b72073b872dd tempest-CinderUnicodeTest-1861632318 None] Lock "cinder-quobyte-1f5ea058-8f6d-41de-97be-9108e9ac6c20" released by "_delete_snapshot" :: held 1.481s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:02:05 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-5d1577ba-42ac-44c2-ab83-b72073b872dd tempest-CinderUnicodeTest-1861632318 None] Lock "cinder-quobyte-796c4ed8-a39b-410f-a7d2-842da5ad9f17" released by "delete_snapshot" :: held 1.552s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:02:05 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-5d1577ba-42ac-44c2-ab83-b72073b872dd tempest-CinderUnicodeTest-1861632318 None] Created reservations ['5ca70a5a-ab72-4afb-969e-673de76319f1', '6205a3f5-56a3-4904-baee-7a97429d102e', '5b255bc6-c070-4be8-891e-8607a16729b7', '879228ea-56bc-4d99-b430-df6d4f857f26'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:02:05 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-5d1577ba-42ac-44c2-ab83-b72073b872dd tempest-CinderUnicodeTest-1861632318 None] Delete snapshot completed successfully. Sep 08 07:02:05 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-5d1577ba-42ac-44c2-ab83-b72073b872dd tempest-CinderUnicodeTest-1861632318 None] Lock "cinder-1f5ea058-8f6d-41de-97be-9108e9ac6c20-delete_snapshot" released by "delete_snapshot" :: held 1.711s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:02:05 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-f5024606-914e-4b42-bf10-4a4b73277ccf tempest-ProjectReaderTests-1152707596 None] Acquiring lock "cinder-8e417283-44cc-45ce-b513-f43f991ea4ff-delete_snapshot" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:02:05 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-f5024606-914e-4b42-bf10-4a4b73277ccf tempest-ProjectReaderTests-1152707596 None] Lock "cinder-8e417283-44cc-45ce-b513-f43f991ea4ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:02:05 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-f5024606-914e-4b42-bf10-4a4b73277ccf tempest-ProjectReaderTests-1152707596 None] Acquiring lock "cinder-quobyte-f9052380-5344-470f-8b6f-6b8fae111f26" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:02:05 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-f5024606-914e-4b42-bf10-4a4b73277ccf tempest-ProjectReaderTests-1152707596 None] Lock "cinder-quobyte-f9052380-5344-470f-8b6f-6b8fae111f26" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:02:05 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-f5024606-914e-4b42-bf10-4a4b73277ccf tempest-ProjectReaderTests-1152707596 None] Acquiring lock "cinder-quobyte-8e417283-44cc-45ce-b513-f43f991ea4ff" by "_delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:02:05 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-f5024606-914e-4b42-bf10-4a4b73277ccf tempest-ProjectReaderTests-1152707596 None] Lock "cinder-quobyte-8e417283-44cc-45ce-b513-f43f991ea4ff" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:02:05 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-f5024606-914e-4b42-bf10-4a4b73277ccf tempest-ProjectReaderTests-1152707596 None] Deleting offline snapshot 8e417283-44cc-45ce-b513-f43f991ea4ff of volume f9052380-5344-470f-8b6f-6b8fae111f26 {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 07:02:05 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-f5024606-914e-4b42-bf10-4a4b73277ccf tempest-ProjectReaderTests-1152707596 None] snapshot_file for this snap is: volume-f9052380-5344-470f-8b6f-6b8fae111f26.8e417283-44cc-45ce-b513-f43f991ea4ff {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 07:02:05 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f11ed97-a2c0-4a69-ba6d-7392f3121613]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:02:05 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f5024606-914e-4b42-bf10-4a4b73277ccf tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f9052380-5344-470f-8b6f-6b8fae111f26.8e417283-44cc-45ce-b513-f43f991ea4ff {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:05 devstack sudo[127272]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:05 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5eeb100f-7f9e-48f7-ab2e-a0e7024bc8d9 tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb 1073741824" returned: 0 in 0.500s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:05 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5eeb100f-7f9e-48f7-ab2e-a0e7024bc8d9 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:05 devstack sudo[127297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb Sep 08 07:02:05 devstack sudo[127297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:05 devstack sudo[127293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f9052380-5344-470f-8b6f-6b8fae111f26.8e417283-44cc-45ce-b513-f43f991ea4ff Sep 08 07:02:05 devstack sudo[127293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:05 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-2127b011-686c-4a01-8653-362c80bd98f7 tempest-CinderUnicodeTest-1861632318 None] Acquiring lock "cinder-796c4ed8-a39b-410f-a7d2-842da5ad9f17-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:02:05 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-2127b011-686c-4a01-8653-362c80bd98f7 tempest-CinderUnicodeTest-1861632318 None] Lock "cinder-796c4ed8-a39b-410f-a7d2-842da5ad9f17-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:02:05 devstack sudo[127297]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:05 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5eeb100f-7f9e-48f7-ab2e-a0e7024bc8d9 tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb" returned: 0 in 0.262s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:05 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-5eeb100f-7f9e-48f7-ab2e-a0e7024bc8d9 tempest-ProjectMemberTests-411164925 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:02:05 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-5eeb100f-7f9e-48f7-ab2e-a0e7024bc8d9 tempest-ProjectMemberTests-411164925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:02:05 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5eeb100f-7f9e-48f7-ab2e-a0e7024bc8d9 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cd2b771-2511-4ba3-9f4f-b7350c46e9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:05 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5eeb100f-7f9e-48f7-ab2e-a0e7024bc8d9 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bca0d2d3-e1e1-452c-89e0-fc774f4c3007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:06 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-5eeb100f-7f9e-48f7-ab2e-a0e7024bc8d9 tempest-ProjectMemberTests-411164925 None] Volume volume-d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb (d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb): created successfully Sep 08 07:02:06 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5eeb100f-7f9e-48f7-ab2e-a0e7024bc8d9 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bca0d2d3-e1e1-452c-89e0-fc774f4c3007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:06 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-5eeb100f-7f9e-48f7-ab2e-a0e7024bc8d9 tempest-ProjectMemberTests-411164925 None] Flow 'volume_create_manager' (fbe02a43-48ba-41fd-badb-f9d5defb1fac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:02:06 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-2127b011-686c-4a01-8653-362c80bd98f7 tempest-CinderUnicodeTest-1861632318 None] Acquiring lock "cinder-quobyte-796c4ed8-a39b-410f-a7d2-842da5ad9f17" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:02:06 devstack sudo[127293]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:06 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f5024606-914e-4b42-bf10-4a4b73277ccf tempest-ProjectReaderTests-1152707596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f9052380-5344-470f-8b6f-6b8fae111f26.8e417283-44cc-45ce-b513-f43f991ea4ff" returned: 0 in 0.393s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:06 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-f5024606-914e-4b42-bf10-4a4b73277ccf tempest-ProjectReaderTests-1152707596 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9052380-5344-470f-8b6f-6b8fae111f26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:02:06 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-2127b011-686c-4a01-8653-362c80bd98f7 tempest-CinderUnicodeTest-1861632318 None] Lock "cinder-quobyte-796c4ed8-a39b-410f-a7d2-842da5ad9f17" acquired by "delete_volume" :: waited 0.034s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:02:06 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-5eeb100f-7f9e-48f7-ab2e-a0e7024bc8d9 tempest-ProjectMemberTests-411164925 None] Created volume successfully. Sep 08 07:02:06 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fcb54e1-5774-43a9-bcad-faea38afd3f8]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:02:06 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f5024606-914e-4b42-bf10-4a4b73277ccf tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f9052380-5344-470f-8b6f-6b8fae111f26 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:06 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f8d933-4c19-4d86-b9b4-0063361c728b]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:02:06 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2127b011-686c-4a01-8653-362c80bd98f7 tempest-CinderUnicodeTest-1861632318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-796c4ed8-a39b-410f-a7d2-842da5ad9f17 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:06 devstack sudo[127316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f9052380-5344-470f-8b6f-6b8fae111f26 Sep 08 07:02:06 devstack sudo[127316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:06 devstack sudo[127317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-796c4ed8-a39b-410f-a7d2-842da5ad9f17 Sep 08 07:02:06 devstack sudo[127317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:06 devstack sudo[127316]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:06 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f5024606-914e-4b42-bf10-4a4b73277ccf tempest-ProjectReaderTests-1152707596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f9052380-5344-470f-8b6f-6b8fae111f26" returned: 0 in 0.362s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:06 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f5024606-914e-4b42-bf10-4a4b73277ccf tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f9052380-5344-470f-8b6f-6b8fae111f26.8e417283-44cc-45ce-b513-f43f991ea4ff {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:06 devstack sudo[127335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f9052380-5344-470f-8b6f-6b8fae111f26.8e417283-44cc-45ce-b513-f43f991ea4ff Sep 08 07:02:06 devstack sudo[127335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:06 devstack sudo[127317]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:06 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2127b011-686c-4a01-8653-362c80bd98f7 tempest-CinderUnicodeTest-1861632318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-796c4ed8-a39b-410f-a7d2-842da5ad9f17" returned: 0 in 0.383s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:06 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2127b011-686c-4a01-8653-362c80bd98f7 tempest-CinderUnicodeTest-1861632318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-796c4ed8-a39b-410f-a7d2-842da5ad9f17 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:06 devstack sudo[127340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-796c4ed8-a39b-410f-a7d2-842da5ad9f17 Sep 08 07:02:06 devstack sudo[127340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:06 devstack sudo[127340]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:06 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2127b011-686c-4a01-8653-362c80bd98f7 tempest-CinderUnicodeTest-1861632318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-796c4ed8-a39b-410f-a7d2-842da5ad9f17" returned: 0 in 0.268s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:06 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-2127b011-686c-4a01-8653-362c80bd98f7 tempest-CinderUnicodeTest-1861632318 None] Lock "cinder-quobyte-796c4ed8-a39b-410f-a7d2-842da5ad9f17" released by "delete_volume" :: held 0.721s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:02:06 devstack sudo[127335]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:06 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f5024606-914e-4b42-bf10-4a4b73277ccf tempest-ProjectReaderTests-1152707596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f9052380-5344-470f-8b6f-6b8fae111f26.8e417283-44cc-45ce-b513-f43f991ea4ff" returned: 0 in 0.345s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:06 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f5024606-914e-4b42-bf10-4a4b73277ccf tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f9052380-5344-470f-8b6f-6b8fae111f26.8e417283-44cc-45ce-b513-f43f991ea4ff {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:06 devstack sudo[127356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f9052380-5344-470f-8b6f-6b8fae111f26.8e417283-44cc-45ce-b513-f43f991ea4ff Sep 08 07:02:06 devstack sudo[127356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:06 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-2127b011-686c-4a01-8653-362c80bd98f7 tempest-CinderUnicodeTest-1861632318 None] Created reservations ['034ef0bc-39ee-45e9-9783-2d832a1a7bca', '4d3a8727-0b3e-4620-8bc6-f411c1d10ecc', 'b87c2bbf-be9f-4d69-8264-b28b4e90680e', '7279d9fd-8562-48d1-9d92-ba2b012b878e'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:02:06 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-2127b011-686c-4a01-8653-362c80bd98f7 tempest-CinderUnicodeTest-1861632318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:02:06 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-2127b011-686c-4a01-8653-362c80bd98f7 tempest-CinderUnicodeTest-1861632318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:02:06 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-2127b011-686c-4a01-8653-362c80bd98f7 tempest-CinderUnicodeTest-1861632318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:02:06 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-2127b011-686c-4a01-8653-362c80bd98f7 tempest-CinderUnicodeTest-1861632318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:02:06 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-2127b011-686c-4a01-8653-362c80bd98f7 tempest-CinderUnicodeTest-1861632318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:02:06 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2127b011-686c-4a01-8653-362c80bd98f7 tempest-CinderUnicodeTest-1861632318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:06 devstack sudo[127361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 07:02:06 devstack sudo[127361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:07 devstack sudo[127356]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-f5024606-914e-4b42-bf10-4a4b73277ccf tempest-ProjectReaderTests-1152707596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f9052380-5344-470f-8b6f-6b8fae111f26.8e417283-44cc-45ce-b513-f43f991ea4ff" returned: 0 in 0.323s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:07 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-3f93e092-a76e-417a-8c49-0ebd5a5be7f9 tempest-CinderUnicodeTest-1861632318 None] Acquiring lock "cinder-f6e2bbf7-8a96-4fe2-8ab9-166832b45152-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:02:07 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-f5024606-914e-4b42-bf10-4a4b73277ccf tempest-ProjectReaderTests-1152707596 None] Lock "cinder-quobyte-8e417283-44cc-45ce-b513-f43f991ea4ff" released by "_delete_snapshot" :: held 1.558s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:02:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-86f462b1-ea95-4080-b2f9-4b7cd7a0008f tempest-ProjectMemberTests-411164925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:02:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-86f462b1-ea95-4080-b2f9-4b7cd7a0008f tempest-ProjectMemberTests-411164925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:02:07 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-3f93e092-a76e-417a-8c49-0ebd5a5be7f9 tempest-CinderUnicodeTest-1861632318 None] Lock "cinder-f6e2bbf7-8a96-4fe2-8ab9-166832b45152-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:02:07 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-f5024606-914e-4b42-bf10-4a4b73277ccf tempest-ProjectReaderTests-1152707596 None] Lock "cinder-quobyte-f9052380-5344-470f-8b6f-6b8fae111f26" released by "delete_snapshot" :: held 1.611s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:02:07 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-86f462b1-ea95-4080-b2f9-4b7cd7a0008f tempest-ProjectMemberTests-411164925 None] Creating offline snapshot 3cbe72bf-f360-475a-af55-34744974ef88 of volume d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb {{(pid=87507) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 07:02:07 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f927218a-308c-40fd-b959-63f01d7cd531]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:02:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-86f462b1-ea95-4080-b2f9-4b7cd7a0008f tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:07 devstack sudo[127361]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:07 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-3f93e092-a76e-417a-8c49-0ebd5a5be7f9 tempest-CinderUnicodeTest-1861632318 None] Acquiring lock "cinder-quobyte-f6e2bbf7-8a96-4fe2-8ab9-166832b45152" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:02:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2127b011-686c-4a01-8653-362c80bd98f7 tempest-CinderUnicodeTest-1861632318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.349s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:07 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-2127b011-686c-4a01-8653-362c80bd98f7 tempest-CinderUnicodeTest-1861632318 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:02:07 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-2127b011-686c-4a01-8653-362c80bd98f7 tempest-CinderUnicodeTest-1861632318 None] Deleted volume successfully. Sep 08 07:02:07 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-3f93e092-a76e-417a-8c49-0ebd5a5be7f9 tempest-CinderUnicodeTest-1861632318 None] Lock "cinder-quobyte-f6e2bbf7-8a96-4fe2-8ab9-166832b45152" acquired by "delete_volume" :: waited 0.035s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:02:07 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-2127b011-686c-4a01-8653-362c80bd98f7 tempest-CinderUnicodeTest-1861632318 None] Lock "cinder-796c4ed8-a39b-410f-a7d2-842da5ad9f17-delete_volume" released by "delete_volume" :: held 1.400s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:02:07 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b73caff0-624c-4827-9ba9-759937e8932f]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:02:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3f93e092-a76e-417a-8c49-0ebd5a5be7f9 tempest-CinderUnicodeTest-1861632318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f6e2bbf7-8a96-4fe2-8ab9-166832b45152 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:07 devstack sudo[127374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb Sep 08 07:02:07 devstack sudo[127374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:07 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-f5024606-914e-4b42-bf10-4a4b73277ccf tempest-ProjectReaderTests-1152707596 None] Created reservations ['4ecb78e5-a2e4-4134-b99f-b4c8d6a6dd37', '74809b10-b2df-4a98-932a-9aa1c072aadc', 'c7f1ac29-7628-4528-af02-0b9a011d8933', 'cf45f935-d870-43c0-8265-8e89c8cf1497'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:02:07 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-f5024606-914e-4b42-bf10-4a4b73277ccf tempest-ProjectReaderTests-1152707596 None] Delete snapshot completed successfully. Sep 08 07:02:07 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-f5024606-914e-4b42-bf10-4a4b73277ccf tempest-ProjectReaderTests-1152707596 None] Lock "cinder-8e417283-44cc-45ce-b513-f43f991ea4ff-delete_snapshot" released by "delete_snapshot" :: held 1.859s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:02:07 devstack sudo[127378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f6e2bbf7-8a96-4fe2-8ab9-166832b45152 Sep 08 07:02:07 devstack sudo[127378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:07 devstack sudo[127374]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-86f462b1-ea95-4080-b2f9-4b7cd7a0008f tempest-ProjectMemberTests-411164925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb" returned: 0 in 0.410s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-86f462b1-ea95-4080-b2f9-4b7cd7a0008f tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb.3cbe72bf-f360-475a-af55-34744974ef88 1G {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:07 devstack sudo[127394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb.3cbe72bf-f360-475a-af55-34744974ef88 1G Sep 08 07:02:07 devstack sudo[127394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:07 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-92e2c910-d1ff-4a05-888c-e5e0b568f9e2 tempest-ProjectReaderTests-1152707596 None] Acquiring lock "cinder-f9052380-5344-470f-8b6f-6b8fae111f26-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:02:07 devstack sudo[127378]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3f93e092-a76e-417a-8c49-0ebd5a5be7f9 tempest-CinderUnicodeTest-1861632318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f6e2bbf7-8a96-4fe2-8ab9-166832b45152" returned: 0 in 0.396s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3f93e092-a76e-417a-8c49-0ebd5a5be7f9 tempest-CinderUnicodeTest-1861632318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f6e2bbf7-8a96-4fe2-8ab9-166832b45152 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:07 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-92e2c910-d1ff-4a05-888c-e5e0b568f9e2 tempest-ProjectReaderTests-1152707596 None] Lock "cinder-f9052380-5344-470f-8b6f-6b8fae111f26-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:02:07 devstack sudo[127402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f6e2bbf7-8a96-4fe2-8ab9-166832b45152 Sep 08 07:02:07 devstack sudo[127402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:07 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-92e2c910-d1ff-4a05-888c-e5e0b568f9e2 tempest-ProjectReaderTests-1152707596 None] Acquiring lock "cinder-quobyte-f9052380-5344-470f-8b6f-6b8fae111f26" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:02:07 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-92e2c910-d1ff-4a05-888c-e5e0b568f9e2 tempest-ProjectReaderTests-1152707596 None] Lock "cinder-quobyte-f9052380-5344-470f-8b6f-6b8fae111f26" acquired by "delete_volume" :: waited 0.021s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:02:07 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[34789d7c-5429-49be-bfd3-a733f3ee78aa]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:02:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-92e2c910-d1ff-4a05-888c-e5e0b568f9e2 tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f9052380-5344-470f-8b6f-6b8fae111f26 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:08 devstack sudo[127409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f9052380-5344-470f-8b6f-6b8fae111f26 Sep 08 07:02:08 devstack sudo[127409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:08 devstack sudo[127402]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:08 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3f93e092-a76e-417a-8c49-0ebd5a5be7f9 tempest-CinderUnicodeTest-1861632318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f6e2bbf7-8a96-4fe2-8ab9-166832b45152" returned: 0 in 0.292s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:08 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-3f93e092-a76e-417a-8c49-0ebd5a5be7f9 tempest-CinderUnicodeTest-1861632318 None] Lock "cinder-quobyte-f6e2bbf7-8a96-4fe2-8ab9-166832b45152" released by "delete_volume" :: held 0.746s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:02:08 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-3f93e092-a76e-417a-8c49-0ebd5a5be7f9 tempest-CinderUnicodeTest-1861632318 None] Created reservations ['747da735-a01d-40cc-8794-e4a6081d52e4', '64cfe91f-5995-465a-90da-d2b245fc7965', 'df38c11b-6c56-42f9-86fc-cddf919f6dcc', '9522c7ae-36fd-4230-b212-328ff226f5e6'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:02:08 devstack sudo[127394]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:08 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-86f462b1-ea95-4080-b2f9-4b7cd7a0008f tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb.3cbe72bf-f360-475a-af55-34744974ef88 1G" returned: 0 in 0.478s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:08 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-86f462b1-ea95-4080-b2f9-4b7cd7a0008f tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb.3cbe72bf-f360-475a-af55-34744974ef88 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:08 devstack sudo[127423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb.3cbe72bf-f360-475a-af55-34744974ef88 Sep 08 07:02:08 devstack sudo[127423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:08 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-3f93e092-a76e-417a-8c49-0ebd5a5be7f9 tempest-CinderUnicodeTest-1861632318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:02:08 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-3f93e092-a76e-417a-8c49-0ebd5a5be7f9 tempest-CinderUnicodeTest-1861632318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:02:08 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-3f93e092-a76e-417a-8c49-0ebd5a5be7f9 tempest-CinderUnicodeTest-1861632318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:02:08 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-3f93e092-a76e-417a-8c49-0ebd5a5be7f9 tempest-CinderUnicodeTest-1861632318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:02:08 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-3f93e092-a76e-417a-8c49-0ebd5a5be7f9 tempest-CinderUnicodeTest-1861632318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:02:08 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3f93e092-a76e-417a-8c49-0ebd5a5be7f9 tempest-CinderUnicodeTest-1861632318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:08 devstack sudo[127430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 07:02:08 devstack sudo[127430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:08 devstack sudo[127409]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:08 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-92e2c910-d1ff-4a05-888c-e5e0b568f9e2 tempest-ProjectReaderTests-1152707596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f9052380-5344-470f-8b6f-6b8fae111f26" returned: 0 in 0.430s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:08 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-92e2c910-d1ff-4a05-888c-e5e0b568f9e2 tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f9052380-5344-470f-8b6f-6b8fae111f26 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:08 devstack sudo[127436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f9052380-5344-470f-8b6f-6b8fae111f26 Sep 08 07:02:08 devstack sudo[127436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:08 devstack sudo[127423]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:08 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-86f462b1-ea95-4080-b2f9-4b7cd7a0008f tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb.3cbe72bf-f360-475a-af55-34744974ef88" returned: 0 in 0.330s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:08 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-86f462b1-ea95-4080-b2f9-4b7cd7a0008f tempest-ProjectMemberTests-411164925 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb.3cbe72bf-f360-475a-af55-34744974ef88 is being set with open permissions: ugo+rw Sep 08 07:02:08 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-86f462b1-ea95-4080-b2f9-4b7cd7a0008f tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb.3cbe72bf-f360-475a-af55-34744974ef88 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:08 devstack sudo[127446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb.3cbe72bf-f360-475a-af55-34744974ef88 Sep 08 07:02:08 devstack sudo[127446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:08 devstack sudo[127430]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:08 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-3f93e092-a76e-417a-8c49-0ebd5a5be7f9 tempest-CinderUnicodeTest-1861632318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.301s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:08 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-3f93e092-a76e-417a-8c49-0ebd5a5be7f9 tempest-CinderUnicodeTest-1861632318 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:02:08 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-3f93e092-a76e-417a-8c49-0ebd5a5be7f9 tempest-CinderUnicodeTest-1861632318 None] Deleted volume successfully. Sep 08 07:02:08 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-3f93e092-a76e-417a-8c49-0ebd5a5be7f9 tempest-CinderUnicodeTest-1861632318 None] Lock "cinder-f6e2bbf7-8a96-4fe2-8ab9-166832b45152-delete_volume" released by "delete_volume" :: held 1.365s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:02:08 devstack sudo[127436]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:08 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-92e2c910-d1ff-4a05-888c-e5e0b568f9e2 tempest-ProjectReaderTests-1152707596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f9052380-5344-470f-8b6f-6b8fae111f26" returned: 0 in 0.306s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:08 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-92e2c910-d1ff-4a05-888c-e5e0b568f9e2 tempest-ProjectReaderTests-1152707596 None] Lock "cinder-quobyte-f9052380-5344-470f-8b6f-6b8fae111f26" released by "delete_volume" :: held 0.804s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:02:08 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-92e2c910-d1ff-4a05-888c-e5e0b568f9e2 tempest-ProjectReaderTests-1152707596 None] Created reservations ['b0a8306f-a7b6-41cd-ba62-04f77fc09c61', '9b5e4f71-3b8a-46f5-a62c-eaf8b2fa3e4f', '49d8035f-a098-4ea3-af55-7a66d509f5c6', 'ef36fd45-2c9a-4eb5-8a29-61acb92c90c5'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:02:08 devstack sudo[127446]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:08 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-86f462b1-ea95-4080-b2f9-4b7cd7a0008f tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb.3cbe72bf-f360-475a-af55-34744974ef88" returned: 0 in 0.310s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:08 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-92e2c910-d1ff-4a05-888c-e5e0b568f9e2 tempest-ProjectReaderTests-1152707596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:02:08 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-92e2c910-d1ff-4a05-888c-e5e0b568f9e2 tempest-ProjectReaderTests-1152707596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:02:08 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-92e2c910-d1ff-4a05-888c-e5e0b568f9e2 tempest-ProjectReaderTests-1152707596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:02:08 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-92e2c910-d1ff-4a05-888c-e5e0b568f9e2 tempest-ProjectReaderTests-1152707596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:02:08 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-92e2c910-d1ff-4a05-888c-e5e0b568f9e2 tempest-ProjectReaderTests-1152707596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:02:08 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-92e2c910-d1ff-4a05-888c-e5e0b568f9e2 tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:08 devstack sudo[127461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 07:02:08 devstack sudo[127461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:08 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-86f462b1-ea95-4080-b2f9-4b7cd7a0008f tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:08 devstack sudo[127464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb.info Sep 08 07:02:08 devstack sudo[127464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:09 devstack sudo[127461]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:09 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-92e2c910-d1ff-4a05-888c-e5e0b568f9e2 tempest-ProjectReaderTests-1152707596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.289s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:09 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-92e2c910-d1ff-4a05-888c-e5e0b568f9e2 tempest-ProjectReaderTests-1152707596 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:02:09 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-92e2c910-d1ff-4a05-888c-e5e0b568f9e2 tempest-ProjectReaderTests-1152707596 None] Deleted volume successfully. Sep 08 07:02:09 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-92e2c910-d1ff-4a05-888c-e5e0b568f9e2 tempest-ProjectReaderTests-1152707596 None] Lock "cinder-f9052380-5344-470f-8b6f-6b8fae111f26-delete_volume" released by "delete_volume" :: held 1.390s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:02:09 devstack sudo[127464]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:09 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-86f462b1-ea95-4080-b2f9-4b7cd7a0008f tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb.info" returned: 0 in 0.378s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:09 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-86f462b1-ea95-4080-b2f9-4b7cd7a0008f tempest-ProjectMemberTests-411164925 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb.info is being set with open permissions: ugo+rw Sep 08 07:02:09 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-86f462b1-ea95-4080-b2f9-4b7cd7a0008f tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:09 devstack sudo[127481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb.info Sep 08 07:02:09 devstack sudo[127481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:09 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b215b5a-6c12-45fe-9df8-3fedbc1be421 tempest-ProjectReaderTests-1152707596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:02:09 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2b215b5a-6c12-45fe-9df8-3fedbc1be421 tempest-ProjectReaderTests-1152707596 None] Flow 'volume_create_manager' (e9b1200f-1941-4546-99e2-d4225d89dd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:02:09 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2b215b5a-6c12-45fe-9df8-3fedbc1be421 tempest-ProjectReaderTests-1152707596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (489f9816-b760-4a96-b3a9-4b574c6e11cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:09 devstack sudo[127481]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:09 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-86f462b1-ea95-4080-b2f9-4b7cd7a0008f tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb.info" returned: 0 in 0.332s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:09 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-86f462b1-ea95-4080-b2f9-4b7cd7a0008f tempest-ProjectMemberTests-411164925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.384s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:02:09 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2b215b5a-6c12-45fe-9df8-3fedbc1be421 tempest-ProjectReaderTests-1152707596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (489f9816-b760-4a96-b3a9-4b574c6e11cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:02:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-272172987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad27f358-0d91-4ca2-ba43-af67c68e06dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c6367f07ddf4a4cb92e17a1b8b6bb5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:02:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:02:09Z,use_quota=True,user_id='0b8690b455d34f248f0182e09db083f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:09 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2b215b5a-6c12-45fe-9df8-3fedbc1be421 tempest-ProjectReaderTests-1152707596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe62786d-9627-4997-82a1-de39ec50f2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:09 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2b215b5a-6c12-45fe-9df8-3fedbc1be421 tempest-ProjectReaderTests-1152707596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe62786d-9627-4997-82a1-de39ec50f2a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:09 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2b215b5a-6c12-45fe-9df8-3fedbc1be421 tempest-ProjectReaderTests-1152707596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2522abc5-fdb8-4043-b05a-5fbffa759eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:09 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2b215b5a-6c12-45fe-9df8-3fedbc1be421 tempest-ProjectReaderTests-1152707596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2522abc5-fdb8-4043-b05a-5fbffa759eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad27f358-0d91-4ca2-ba43-af67c68e06dc', 'volume_name': 'volume-ad27f358-0d91-4ca2-ba43-af67c68e06dc', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:09 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2b215b5a-6c12-45fe-9df8-3fedbc1be421 tempest-ProjectReaderTests-1152707596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3953121e-97fb-49d2-a7db-9a765f11c309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:09 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2b215b5a-6c12-45fe-9df8-3fedbc1be421 tempest-ProjectReaderTests-1152707596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3953121e-97fb-49d2-a7db-9a765f11c309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:09 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2b215b5a-6c12-45fe-9df8-3fedbc1be421 tempest-ProjectReaderTests-1152707596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1358a13d-f3f5-4870-9562-db6daf6b62b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:09 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-2b215b5a-6c12-45fe-9df8-3fedbc1be421 tempest-ProjectReaderTests-1152707596 None] Volume ad27f358-0d91-4ca2-ba43-af67c68e06dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad27f358-0d91-4ca2-ba43-af67c68e06dc', 'volume_size': 1} Sep 08 07:02:09 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-2b215b5a-6c12-45fe-9df8-3fedbc1be421 tempest-ProjectReaderTests-1152707596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:02:09 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-2b215b5a-6c12-45fe-9df8-3fedbc1be421 tempest-ProjectReaderTests-1152707596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:02:09 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-2b215b5a-6c12-45fe-9df8-3fedbc1be421 tempest-ProjectReaderTests-1152707596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:02:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-272172987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad27f358-0d91-4ca2-ba43-af67c68e06dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c6367f07ddf4a4cb92e17a1b8b6bb5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:02:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:02:09Z,use_quota=True,user_id='0b8690b455d34f248f0182e09db083f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:02:09 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-2b215b5a-6c12-45fe-9df8-3fedbc1be421 tempest-ProjectReaderTests-1152707596 None] Creating volume ad27f358-0d91-4ca2-ba43-af67c68e06dc {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:02:09 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-2b215b5a-6c12-45fe-9df8-3fedbc1be421 tempest-ProjectReaderTests-1152707596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:02:09 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-2b215b5a-6c12-45fe-9df8-3fedbc1be421 tempest-ProjectReaderTests-1152707596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:02:09 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-2b215b5a-6c12-45fe-9df8-3fedbc1be421 tempest-ProjectReaderTests-1152707596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:02:09 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-2b215b5a-6c12-45fe-9df8-3fedbc1be421 tempest-ProjectReaderTests-1152707596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:02:09 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-2b215b5a-6c12-45fe-9df8-3fedbc1be421 tempest-ProjectReaderTests-1152707596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:02:09 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-2b215b5a-6c12-45fe-9df8-3fedbc1be421 tempest-ProjectReaderTests-1152707596 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:02:09 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-2b215b5a-6c12-45fe-9df8-3fedbc1be421 tempest-ProjectReaderTests-1152707596 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 07:02:09 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2b215b5a-6c12-45fe-9df8-3fedbc1be421 tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ad27f358-0d91-4ca2-ba43-af67c68e06dc 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:09 devstack sudo[127496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ad27f358-0d91-4ca2-ba43-af67c68e06dc 1073741824 Sep 08 07:02:09 devstack sudo[127496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:09 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-86f462b1-ea95-4080-b2f9-4b7cd7a0008f tempest-ProjectMemberTests-411164925 None] Create snapshot completed successfully Sep 08 07:02:10 devstack sudo[127496]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:10 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2b215b5a-6c12-45fe-9df8-3fedbc1be421 tempest-ProjectReaderTests-1152707596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ad27f358-0d91-4ca2-ba43-af67c68e06dc 1073741824" returned: 0 in 0.487s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:10 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2b215b5a-6c12-45fe-9df8-3fedbc1be421 tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ad27f358-0d91-4ca2-ba43-af67c68e06dc {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:10 devstack sudo[127517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ad27f358-0d91-4ca2-ba43-af67c68e06dc Sep 08 07:02:10 devstack sudo[127517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:10 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-81953ea5-d8f2-4de8-ae4a-71f0e5b5a22b tempest-ProjectMemberTests-411164925 None] Acquiring lock "cinder-3cbe72bf-f360-475a-af55-34744974ef88-delete_snapshot" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:02:10 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-81953ea5-d8f2-4de8-ae4a-71f0e5b5a22b tempest-ProjectMemberTests-411164925 None] Lock "cinder-3cbe72bf-f360-475a-af55-34744974ef88-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:02:10 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-81953ea5-d8f2-4de8-ae4a-71f0e5b5a22b tempest-ProjectMemberTests-411164925 None] Acquiring lock "cinder-quobyte-d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:02:10 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-81953ea5-d8f2-4de8-ae4a-71f0e5b5a22b tempest-ProjectMemberTests-411164925 None] Lock "cinder-quobyte-d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:02:10 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-81953ea5-d8f2-4de8-ae4a-71f0e5b5a22b tempest-ProjectMemberTests-411164925 None] Acquiring lock "cinder-quobyte-3cbe72bf-f360-475a-af55-34744974ef88" by "_delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:02:10 devstack sudo[127517]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:10 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-2b215b5a-6c12-45fe-9df8-3fedbc1be421 tempest-ProjectReaderTests-1152707596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ad27f358-0d91-4ca2-ba43-af67c68e06dc" returned: 0 in 0.303s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:10 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-2b215b5a-6c12-45fe-9df8-3fedbc1be421 tempest-ProjectReaderTests-1152707596 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:02:10 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-2b215b5a-6c12-45fe-9df8-3fedbc1be421 tempest-ProjectReaderTests-1152707596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:02:10 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-81953ea5-d8f2-4de8-ae4a-71f0e5b5a22b tempest-ProjectMemberTests-411164925 None] Lock "cinder-quobyte-3cbe72bf-f360-475a-af55-34744974ef88" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:02:10 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-81953ea5-d8f2-4de8-ae4a-71f0e5b5a22b tempest-ProjectMemberTests-411164925 None] Deleting offline snapshot 3cbe72bf-f360-475a-af55-34744974ef88 of volume d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 07:02:10 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-81953ea5-d8f2-4de8-ae4a-71f0e5b5a22b tempest-ProjectMemberTests-411164925 None] snapshot_file for this snap is: volume-d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb.3cbe72bf-f360-475a-af55-34744974ef88 {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 07:02:10 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2b215b5a-6c12-45fe-9df8-3fedbc1be421 tempest-ProjectReaderTests-1152707596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1358a13d-f3f5-4870-9562-db6daf6b62b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad27f358-0d91-4ca2-ba43-af67c68e06dc', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:10 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2b215b5a-6c12-45fe-9df8-3fedbc1be421 tempest-ProjectReaderTests-1152707596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34380992-40fa-4ef1-9953-8f04dff7a941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:10 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e332ecb-50c5-4100-8a97-63b135a38c8c]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:02:10 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-81953ea5-d8f2-4de8-ae4a-71f0e5b5a22b tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb.3cbe72bf-f360-475a-af55-34744974ef88 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:10 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-2b215b5a-6c12-45fe-9df8-3fedbc1be421 tempest-ProjectReaderTests-1152707596 None] Volume volume-ad27f358-0d91-4ca2-ba43-af67c68e06dc (ad27f358-0d91-4ca2-ba43-af67c68e06dc): created successfully Sep 08 07:02:10 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2b215b5a-6c12-45fe-9df8-3fedbc1be421 tempest-ProjectReaderTests-1152707596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34380992-40fa-4ef1-9953-8f04dff7a941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:10 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-2b215b5a-6c12-45fe-9df8-3fedbc1be421 tempest-ProjectReaderTests-1152707596 None] Flow 'volume_create_manager' (e9b1200f-1941-4546-99e2-d4225d89dd39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:02:10 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-2b215b5a-6c12-45fe-9df8-3fedbc1be421 tempest-ProjectReaderTests-1152707596 None] Created volume successfully. Sep 08 07:02:10 devstack sudo[127529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb.3cbe72bf-f360-475a-af55-34744974ef88 Sep 08 07:02:10 devstack sudo[127529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:10 devstack sudo[127529]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:10 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-81953ea5-d8f2-4de8-ae4a-71f0e5b5a22b tempest-ProjectMemberTests-411164925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb.3cbe72bf-f360-475a-af55-34744974ef88" returned: 0 in 0.360s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:10 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-81953ea5-d8f2-4de8-ae4a-71f0e5b5a22b tempest-ProjectMemberTests-411164925 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:02:10 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77081f3-df67-4307-b0a4-a5eb7da3e884]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:02:10 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-81953ea5-d8f2-4de8-ae4a-71f0e5b5a22b tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:10 devstack sudo[127546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb Sep 08 07:02:10 devstack sudo[127546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:11 devstack sudo[127546]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-81953ea5-d8f2-4de8-ae4a-71f0e5b5a22b tempest-ProjectMemberTests-411164925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb" returned: 0 in 0.343s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-81953ea5-d8f2-4de8-ae4a-71f0e5b5a22b tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb.3cbe72bf-f360-475a-af55-34744974ef88 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:11 devstack sudo[127563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb.3cbe72bf-f360-475a-af55-34744974ef88 Sep 08 07:02:11 devstack sudo[127563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:11 devstack sudo[127563]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-81953ea5-d8f2-4de8-ae4a-71f0e5b5a22b tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb.3cbe72bf-f360-475a-af55-34744974ef88" returned: 0 in 0.338s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-81953ea5-d8f2-4de8-ae4a-71f0e5b5a22b tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb.3cbe72bf-f360-475a-af55-34744974ef88 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:11 devstack sudo[127577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb.3cbe72bf-f360-475a-af55-34744974ef88 Sep 08 07:02:11 devstack sudo[127577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a374277f-b7a1-475b-be90-1f58e33314ca tempest-ProjectReaderTests-1152707596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:02:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a374277f-b7a1-475b-be90-1f58e33314ca tempest-ProjectReaderTests-1152707596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:02:11 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-a374277f-b7a1-475b-be90-1f58e33314ca tempest-ProjectReaderTests-1152707596 None] Creating offline snapshot 99de6346-7e4e-4e81-9a66-62e21ba7e4fa of volume ad27f358-0d91-4ca2-ba43-af67c68e06dc {{(pid=87507) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 07:02:11 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25886a3-18ac-469e-8ab5-34e855676048]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:02:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a374277f-b7a1-475b-be90-1f58e33314ca tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ad27f358-0d91-4ca2-ba43-af67c68e06dc {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:11 devstack sudo[127577]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-81953ea5-d8f2-4de8-ae4a-71f0e5b5a22b tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb.3cbe72bf-f360-475a-af55-34744974ef88" returned: 0 in 0.268s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:11 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-81953ea5-d8f2-4de8-ae4a-71f0e5b5a22b tempest-ProjectMemberTests-411164925 None] Lock "cinder-quobyte-3cbe72bf-f360-475a-af55-34744974ef88" released by "_delete_snapshot" :: held 1.404s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:02:11 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-81953ea5-d8f2-4de8-ae4a-71f0e5b5a22b tempest-ProjectMemberTests-411164925 None] Lock "cinder-quobyte-d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb" released by "delete_snapshot" :: held 1.433s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:02:11 devstack sudo[127585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ad27f358-0d91-4ca2-ba43-af67c68e06dc Sep 08 07:02:11 devstack sudo[127585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:11 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-81953ea5-d8f2-4de8-ae4a-71f0e5b5a22b tempest-ProjectMemberTests-411164925 None] Created reservations ['46cf66ed-b676-4dfe-b0ca-8c718f77800b', '1be272d1-4695-4151-ab52-e230d83c9f53', '413f2343-568e-431f-ae21-da070b48ef07', '4d43e141-a670-4d62-882c-6a15aae500fd'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:02:12 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-81953ea5-d8f2-4de8-ae4a-71f0e5b5a22b tempest-ProjectMemberTests-411164925 None] Delete snapshot completed successfully. Sep 08 07:02:12 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-81953ea5-d8f2-4de8-ae4a-71f0e5b5a22b tempest-ProjectMemberTests-411164925 None] Lock "cinder-3cbe72bf-f360-475a-af55-34744974ef88-delete_snapshot" released by "delete_snapshot" :: held 1.598s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:02:12 devstack sudo[127585]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:12 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a374277f-b7a1-475b-be90-1f58e33314ca tempest-ProjectReaderTests-1152707596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ad27f358-0d91-4ca2-ba43-af67c68e06dc" returned: 0 in 0.366s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:12 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a374277f-b7a1-475b-be90-1f58e33314ca tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ad27f358-0d91-4ca2-ba43-af67c68e06dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ad27f358-0d91-4ca2-ba43-af67c68e06dc.99de6346-7e4e-4e81-9a66-62e21ba7e4fa 1G {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:12 devstack sudo[127603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ad27f358-0d91-4ca2-ba43-af67c68e06dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ad27f358-0d91-4ca2-ba43-af67c68e06dc.99de6346-7e4e-4e81-9a66-62e21ba7e4fa 1G Sep 08 07:02:12 devstack sudo[127603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:12 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-b00e315f-2b3b-49a3-b427-bb90de25f054 tempest-ProjectMemberTests-411164925 None] Acquiring lock "cinder-d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:02:12 devstack sudo[127603]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:12 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a374277f-b7a1-475b-be90-1f58e33314ca tempest-ProjectReaderTests-1152707596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ad27f358-0d91-4ca2-ba43-af67c68e06dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ad27f358-0d91-4ca2-ba43-af67c68e06dc.99de6346-7e4e-4e81-9a66-62e21ba7e4fa 1G" returned: 0 in 0.401s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:12 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a374277f-b7a1-475b-be90-1f58e33314ca tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad27f358-0d91-4ca2-ba43-af67c68e06dc -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ad27f358-0d91-4ca2-ba43-af67c68e06dc.99de6346-7e4e-4e81-9a66-62e21ba7e4fa {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:12 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-b00e315f-2b3b-49a3-b427-bb90de25f054 tempest-ProjectMemberTests-411164925 None] Lock "cinder-d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:02:12 devstack sudo[127620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad27f358-0d91-4ca2-ba43-af67c68e06dc -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ad27f358-0d91-4ca2-ba43-af67c68e06dc.99de6346-7e4e-4e81-9a66-62e21ba7e4fa Sep 08 07:02:12 devstack sudo[127620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:12 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-b00e315f-2b3b-49a3-b427-bb90de25f054 tempest-ProjectMemberTests-411164925 None] Acquiring lock "cinder-quobyte-d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:02:12 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-b00e315f-2b3b-49a3-b427-bb90de25f054 tempest-ProjectMemberTests-411164925 None] Lock "cinder-quobyte-d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb" acquired by "delete_volume" :: waited 0.014s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:02:12 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b816aa08-50a0-4a11-abdc-cb257acc3b70]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:02:12 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b00e315f-2b3b-49a3-b427-bb90de25f054 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:12 devstack sudo[127625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb Sep 08 07:02:12 devstack sudo[127625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:12 devstack sudo[127620]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:12 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a374277f-b7a1-475b-be90-1f58e33314ca tempest-ProjectReaderTests-1152707596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad27f358-0d91-4ca2-ba43-af67c68e06dc -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ad27f358-0d91-4ca2-ba43-af67c68e06dc.99de6346-7e4e-4e81-9a66-62e21ba7e4fa" returned: 0 in 0.317s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:12 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-a374277f-b7a1-475b-be90-1f58e33314ca tempest-ProjectReaderTests-1152707596 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ad27f358-0d91-4ca2-ba43-af67c68e06dc.99de6346-7e4e-4e81-9a66-62e21ba7e4fa is being set with open permissions: ugo+rw Sep 08 07:02:12 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a374277f-b7a1-475b-be90-1f58e33314ca tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ad27f358-0d91-4ca2-ba43-af67c68e06dc.99de6346-7e4e-4e81-9a66-62e21ba7e4fa {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:12 devstack sudo[127636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ad27f358-0d91-4ca2-ba43-af67c68e06dc.99de6346-7e4e-4e81-9a66-62e21ba7e4fa Sep 08 07:02:12 devstack sudo[127636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:13 devstack sudo[127625]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b00e315f-2b3b-49a3-b427-bb90de25f054 tempest-ProjectMemberTests-411164925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb" returned: 0 in 0.376s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b00e315f-2b3b-49a3-b427-bb90de25f054 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:13 devstack sudo[127647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb Sep 08 07:02:13 devstack sudo[127647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:13 devstack sudo[127636]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a374277f-b7a1-475b-be90-1f58e33314ca tempest-ProjectReaderTests-1152707596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ad27f358-0d91-4ca2-ba43-af67c68e06dc.99de6346-7e4e-4e81-9a66-62e21ba7e4fa" returned: 0 in 0.253s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a374277f-b7a1-475b-be90-1f58e33314ca tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ad27f358-0d91-4ca2-ba43-af67c68e06dc.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:13 devstack sudo[127653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ad27f358-0d91-4ca2-ba43-af67c68e06dc.info Sep 08 07:02:13 devstack sudo[127653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:13 devstack sudo[127647]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b00e315f-2b3b-49a3-b427-bb90de25f054 tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb" returned: 0 in 0.255s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:13 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-b00e315f-2b3b-49a3-b427-bb90de25f054 tempest-ProjectMemberTests-411164925 None] Lock "cinder-quobyte-d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb" released by "delete_volume" :: held 0.690s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:02:13 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-b00e315f-2b3b-49a3-b427-bb90de25f054 tempest-ProjectMemberTests-411164925 None] Created reservations ['8a7bb716-17bd-4769-a7d4-c5156ee18ff7', '0e7f3458-59a0-444b-92b8-f32266b59366', '8eaacc23-f0a2-4d23-bb94-60078e2d608d', '4518151d-098e-44f7-be7a-acee05dcd1eb'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:02:13 devstack sudo[127653]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a374277f-b7a1-475b-be90-1f58e33314ca tempest-ProjectReaderTests-1152707596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ad27f358-0d91-4ca2-ba43-af67c68e06dc.info" returned: 0 in 0.270s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:13 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-a374277f-b7a1-475b-be90-1f58e33314ca tempest-ProjectReaderTests-1152707596 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ad27f358-0d91-4ca2-ba43-af67c68e06dc.info is being set with open permissions: ugo+rw Sep 08 07:02:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a374277f-b7a1-475b-be90-1f58e33314ca tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ad27f358-0d91-4ca2-ba43-af67c68e06dc.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b00e315f-2b3b-49a3-b427-bb90de25f054 tempest-ProjectMemberTests-411164925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:02:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b00e315f-2b3b-49a3-b427-bb90de25f054 tempest-ProjectMemberTests-411164925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:02:13 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-b00e315f-2b3b-49a3-b427-bb90de25f054 tempest-ProjectMemberTests-411164925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:02:13 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-b00e315f-2b3b-49a3-b427-bb90de25f054 tempest-ProjectMemberTests-411164925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:02:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b00e315f-2b3b-49a3-b427-bb90de25f054 tempest-ProjectMemberTests-411164925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:02:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b00e315f-2b3b-49a3-b427-bb90de25f054 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:13 devstack sudo[127664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ad27f358-0d91-4ca2-ba43-af67c68e06dc.info Sep 08 07:02:13 devstack sudo[127664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:13 devstack sudo[127668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 07:02:13 devstack sudo[127668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:13 devstack sudo[127664]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a374277f-b7a1-475b-be90-1f58e33314ca tempest-ProjectReaderTests-1152707596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ad27f358-0d91-4ca2-ba43-af67c68e06dc.info" returned: 0 in 0.268s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:13 devstack sudo[127668]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a374277f-b7a1-475b-be90-1f58e33314ca tempest-ProjectReaderTests-1152707596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.964s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:02:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b00e315f-2b3b-49a3-b427-bb90de25f054 tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.262s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:13 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-b00e315f-2b3b-49a3-b427-bb90de25f054 tempest-ProjectMemberTests-411164925 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:02:13 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-b00e315f-2b3b-49a3-b427-bb90de25f054 tempest-ProjectMemberTests-411164925 None] Deleted volume successfully. Sep 08 07:02:13 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-a374277f-b7a1-475b-be90-1f58e33314ca tempest-ProjectReaderTests-1152707596 None] Create snapshot completed successfully Sep 08 07:02:13 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-b00e315f-2b3b-49a3-b427-bb90de25f054 tempest-ProjectMemberTests-411164925 None] Lock "cinder-d910f8d0-8b20-4c8f-9aed-b861cb7ba8bb-delete_volume" released by "delete_volume" :: held 1.188s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:02:13 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-7444058f-a5da-4541-a59f-039e8446872f tempest-ProjectReaderTests-1152707596 None] Acquiring lock "cinder-99de6346-7e4e-4e81-9a66-62e21ba7e4fa-delete_snapshot" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:02:13 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-7444058f-a5da-4541-a59f-039e8446872f tempest-ProjectReaderTests-1152707596 None] Lock "cinder-99de6346-7e4e-4e81-9a66-62e21ba7e4fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:02:13 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-7444058f-a5da-4541-a59f-039e8446872f tempest-ProjectReaderTests-1152707596 None] Acquiring lock "cinder-quobyte-ad27f358-0d91-4ca2-ba43-af67c68e06dc" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:02:13 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-7444058f-a5da-4541-a59f-039e8446872f tempest-ProjectReaderTests-1152707596 None] Lock "cinder-quobyte-ad27f358-0d91-4ca2-ba43-af67c68e06dc" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:02:13 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-7444058f-a5da-4541-a59f-039e8446872f tempest-ProjectReaderTests-1152707596 None] Acquiring lock "cinder-quobyte-99de6346-7e4e-4e81-9a66-62e21ba7e4fa" by "_delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:02:13 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-7444058f-a5da-4541-a59f-039e8446872f tempest-ProjectReaderTests-1152707596 None] Lock "cinder-quobyte-99de6346-7e4e-4e81-9a66-62e21ba7e4fa" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:02:13 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-7444058f-a5da-4541-a59f-039e8446872f tempest-ProjectReaderTests-1152707596 None] Deleting offline snapshot 99de6346-7e4e-4e81-9a66-62e21ba7e4fa of volume ad27f358-0d91-4ca2-ba43-af67c68e06dc {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 07:02:13 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-7444058f-a5da-4541-a59f-039e8446872f tempest-ProjectReaderTests-1152707596 None] snapshot_file for this snap is: volume-ad27f358-0d91-4ca2-ba43-af67c68e06dc.99de6346-7e4e-4e81-9a66-62e21ba7e4fa {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 07:02:13 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[23afcfc2-be22-44ee-b027-50ce4a758ec5]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:02:13 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7444058f-a5da-4541-a59f-039e8446872f tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ad27f358-0d91-4ca2-ba43-af67c68e06dc.99de6346-7e4e-4e81-9a66-62e21ba7e4fa {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:14 devstack sudo[127687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ad27f358-0d91-4ca2-ba43-af67c68e06dc.99de6346-7e4e-4e81-9a66-62e21ba7e4fa Sep 08 07:02:14 devstack sudo[127687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:14 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0f210f5-b679-4ff9-8995-64245d789f57 tempest-ProjectMemberTests-411164925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:02:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-d0f210f5-b679-4ff9-8995-64245d789f57 tempest-ProjectMemberTests-411164925 None] Flow 'volume_create_manager' (665b7c0a-6251-4211-992f-c4882d9ae93c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:02:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-d0f210f5-b679-4ff9-8995-64245d789f57 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68ae0c52-a1c8-40e8-b3b9-d3535a5b0fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-d0f210f5-b679-4ff9-8995-64245d789f57 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68ae0c52-a1c8-40e8-b3b9-d3535a5b0fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:02:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1190702773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eb44e1e-bd9b-483a-9172-4de012d453dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc639babed634473856ad52d77e5a6af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:02:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:02:14Z,use_quota=True,user_id='c850edcf996545b89f3d8d0b683570e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-d0f210f5-b679-4ff9-8995-64245d789f57 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a641f69-4475-439d-9dce-5d6cc11a69d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-d0f210f5-b679-4ff9-8995-64245d789f57 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a641f69-4475-439d-9dce-5d6cc11a69d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-d0f210f5-b679-4ff9-8995-64245d789f57 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87ebfc70-6940-4881-b876-670d5e5431f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-d0f210f5-b679-4ff9-8995-64245d789f57 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87ebfc70-6940-4881-b876-670d5e5431f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9eb44e1e-bd9b-483a-9172-4de012d453dc', 'volume_name': 'volume-9eb44e1e-bd9b-483a-9172-4de012d453dc', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-d0f210f5-b679-4ff9-8995-64245d789f57 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdf281b4-8f43-4542-9b6d-3f6edeba5635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-d0f210f5-b679-4ff9-8995-64245d789f57 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdf281b4-8f43-4542-9b6d-3f6edeba5635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:14 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-d0f210f5-b679-4ff9-8995-64245d789f57 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f07ddb95-d09b-4d9a-8553-0a93bd0a8d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:14 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-d0f210f5-b679-4ff9-8995-64245d789f57 tempest-ProjectMemberTests-411164925 None] Volume 9eb44e1e-bd9b-483a-9172-4de012d453dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9eb44e1e-bd9b-483a-9172-4de012d453dc', 'volume_size': 1} Sep 08 07:02:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-d0f210f5-b679-4ff9-8995-64245d789f57 tempest-ProjectMemberTests-411164925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:02:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-d0f210f5-b679-4ff9-8995-64245d789f57 tempest-ProjectMemberTests-411164925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:02:14 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-d0f210f5-b679-4ff9-8995-64245d789f57 tempest-ProjectMemberTests-411164925 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:02:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1190702773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eb44e1e-bd9b-483a-9172-4de012d453dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc639babed634473856ad52d77e5a6af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:02:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:02:14Z,use_quota=True,user_id='c850edcf996545b89f3d8d0b683570e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:02:14 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-d0f210f5-b679-4ff9-8995-64245d789f57 tempest-ProjectMemberTests-411164925 None] Creating volume 9eb44e1e-bd9b-483a-9172-4de012d453dc {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:02:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-d0f210f5-b679-4ff9-8995-64245d789f57 tempest-ProjectMemberTests-411164925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:02:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-d0f210f5-b679-4ff9-8995-64245d789f57 tempest-ProjectMemberTests-411164925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:02:14 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-d0f210f5-b679-4ff9-8995-64245d789f57 tempest-ProjectMemberTests-411164925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:02:14 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-d0f210f5-b679-4ff9-8995-64245d789f57 tempest-ProjectMemberTests-411164925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:02:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-d0f210f5-b679-4ff9-8995-64245d789f57 tempest-ProjectMemberTests-411164925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:02:14 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-d0f210f5-b679-4ff9-8995-64245d789f57 tempest-ProjectMemberTests-411164925 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:02:14 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-d0f210f5-b679-4ff9-8995-64245d789f57 tempest-ProjectMemberTests-411164925 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 07:02:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-d0f210f5-b679-4ff9-8995-64245d789f57 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9eb44e1e-bd9b-483a-9172-4de012d453dc 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:14 devstack sudo[127698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9eb44e1e-bd9b-483a-9172-4de012d453dc 1073741824 Sep 08 07:02:14 devstack sudo[127698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:14 devstack sudo[127687]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7444058f-a5da-4541-a59f-039e8446872f tempest-ProjectReaderTests-1152707596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ad27f358-0d91-4ca2-ba43-af67c68e06dc.99de6346-7e4e-4e81-9a66-62e21ba7e4fa" returned: 0 in 0.401s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:14 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-7444058f-a5da-4541-a59f-039e8446872f tempest-ProjectReaderTests-1152707596 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad27f358-0d91-4ca2-ba43-af67c68e06dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:02:14 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3139d5-e844-4b16-accb-4bb7c92f5f1d]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:02:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7444058f-a5da-4541-a59f-039e8446872f tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ad27f358-0d91-4ca2-ba43-af67c68e06dc {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:14 devstack sudo[127706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ad27f358-0d91-4ca2-ba43-af67c68e06dc Sep 08 07:02:14 devstack sudo[127706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:14 devstack sudo[127698]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-d0f210f5-b679-4ff9-8995-64245d789f57 tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9eb44e1e-bd9b-483a-9172-4de012d453dc 1073741824" returned: 0 in 0.430s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-d0f210f5-b679-4ff9-8995-64245d789f57 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9eb44e1e-bd9b-483a-9172-4de012d453dc {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:14 devstack sudo[127706]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7444058f-a5da-4541-a59f-039e8446872f tempest-ProjectReaderTests-1152707596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ad27f358-0d91-4ca2-ba43-af67c68e06dc" returned: 0 in 0.369s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:14 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7444058f-a5da-4541-a59f-039e8446872f tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ad27f358-0d91-4ca2-ba43-af67c68e06dc.99de6346-7e4e-4e81-9a66-62e21ba7e4fa {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:14 devstack sudo[127727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9eb44e1e-bd9b-483a-9172-4de012d453dc Sep 08 07:02:14 devstack sudo[127727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:14 devstack sudo[127728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ad27f358-0d91-4ca2-ba43-af67c68e06dc.99de6346-7e4e-4e81-9a66-62e21ba7e4fa Sep 08 07:02:14 devstack sudo[127728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:15 devstack sudo[127727]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-d0f210f5-b679-4ff9-8995-64245d789f57 tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9eb44e1e-bd9b-483a-9172-4de012d453dc" returned: 0 in 0.253s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:15 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-d0f210f5-b679-4ff9-8995-64245d789f57 tempest-ProjectMemberTests-411164925 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:02:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-d0f210f5-b679-4ff9-8995-64245d789f57 tempest-ProjectMemberTests-411164925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:02:15 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-d0f210f5-b679-4ff9-8995-64245d789f57 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f07ddb95-d09b-4d9a-8553-0a93bd0a8d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9eb44e1e-bd9b-483a-9172-4de012d453dc', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:15 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-d0f210f5-b679-4ff9-8995-64245d789f57 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f916d840-75f4-4a1b-a720-fc563f14a395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:15 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-d0f210f5-b679-4ff9-8995-64245d789f57 tempest-ProjectMemberTests-411164925 None] Volume volume-9eb44e1e-bd9b-483a-9172-4de012d453dc (9eb44e1e-bd9b-483a-9172-4de012d453dc): created successfully Sep 08 07:02:15 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-d0f210f5-b679-4ff9-8995-64245d789f57 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f916d840-75f4-4a1b-a720-fc563f14a395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:15 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-d0f210f5-b679-4ff9-8995-64245d789f57 tempest-ProjectMemberTests-411164925 None] Flow 'volume_create_manager' (665b7c0a-6251-4211-992f-c4882d9ae93c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:02:15 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-d0f210f5-b679-4ff9-8995-64245d789f57 tempest-ProjectMemberTests-411164925 None] Created volume successfully. Sep 08 07:02:15 devstack sudo[127728]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7444058f-a5da-4541-a59f-039e8446872f tempest-ProjectReaderTests-1152707596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ad27f358-0d91-4ca2-ba43-af67c68e06dc.99de6346-7e4e-4e81-9a66-62e21ba7e4fa" returned: 0 in 0.356s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7444058f-a5da-4541-a59f-039e8446872f tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ad27f358-0d91-4ca2-ba43-af67c68e06dc.99de6346-7e4e-4e81-9a66-62e21ba7e4fa {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:15 devstack sudo[127744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ad27f358-0d91-4ca2-ba43-af67c68e06dc.99de6346-7e4e-4e81-9a66-62e21ba7e4fa Sep 08 07:02:15 devstack sudo[127744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-0febbb2b-cca5-4537-9296-f5e8726e23fb tempest-ProjectMemberTests-411164925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:02:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-0febbb2b-cca5-4537-9296-f5e8726e23fb tempest-ProjectMemberTests-411164925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:02:15 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-0febbb2b-cca5-4537-9296-f5e8726e23fb tempest-ProjectMemberTests-411164925 None] Creating offline snapshot ddf85d42-7654-4cfd-9d63-eb5bb937ca98 of volume 9eb44e1e-bd9b-483a-9172-4de012d453dc {{(pid=87507) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 07:02:15 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[144f97d0-93a2-4caf-9e2d-ca78720ebdff]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:02:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0febbb2b-cca5-4537-9296-f5e8726e23fb tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9eb44e1e-bd9b-483a-9172-4de012d453dc {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:15 devstack sudo[127744]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7444058f-a5da-4541-a59f-039e8446872f tempest-ProjectReaderTests-1152707596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ad27f358-0d91-4ca2-ba43-af67c68e06dc.99de6346-7e4e-4e81-9a66-62e21ba7e4fa" returned: 0 in 0.266s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:15 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-7444058f-a5da-4541-a59f-039e8446872f tempest-ProjectReaderTests-1152707596 None] Lock "cinder-quobyte-99de6346-7e4e-4e81-9a66-62e21ba7e4fa" released by "_delete_snapshot" :: held 1.493s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:02:15 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-7444058f-a5da-4541-a59f-039e8446872f tempest-ProjectReaderTests-1152707596 None] Lock "cinder-quobyte-ad27f358-0d91-4ca2-ba43-af67c68e06dc" released by "delete_snapshot" :: held 1.518s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:02:15 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-7444058f-a5da-4541-a59f-039e8446872f tempest-ProjectReaderTests-1152707596 None] Created reservations ['bca71204-901b-439c-a981-642029b5191d', '5a0a09f6-7fc7-4837-bf11-1ab2ec1904b8', '6a2342ca-341b-4287-9953-a62e5f21974a', 'a0d02b73-a502-4132-90cf-1b9ff30625f9'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:02:15 devstack sudo[127756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9eb44e1e-bd9b-483a-9172-4de012d453dc Sep 08 07:02:15 devstack sudo[127756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:15 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-7444058f-a5da-4541-a59f-039e8446872f tempest-ProjectReaderTests-1152707596 None] Delete snapshot completed successfully. Sep 08 07:02:15 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-7444058f-a5da-4541-a59f-039e8446872f tempest-ProjectReaderTests-1152707596 None] Lock "cinder-99de6346-7e4e-4e81-9a66-62e21ba7e4fa-delete_snapshot" released by "delete_snapshot" :: held 1.651s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:02:15 devstack sudo[127756]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0febbb2b-cca5-4537-9296-f5e8726e23fb tempest-ProjectMemberTests-411164925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9eb44e1e-bd9b-483a-9172-4de012d453dc" returned: 0 in 0.367s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:15 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0febbb2b-cca5-4537-9296-f5e8726e23fb tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9eb44e1e-bd9b-483a-9172-4de012d453dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9eb44e1e-bd9b-483a-9172-4de012d453dc.ddf85d42-7654-4cfd-9d63-eb5bb937ca98 1G {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:15 devstack sudo[127773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9eb44e1e-bd9b-483a-9172-4de012d453dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9eb44e1e-bd9b-483a-9172-4de012d453dc.ddf85d42-7654-4cfd-9d63-eb5bb937ca98 1G Sep 08 07:02:15 devstack sudo[127773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:16 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-8e632db4-0659-4687-b2d5-2f8d44720723 tempest-ProjectReaderTests-1152707596 None] Acquiring lock "cinder-ad27f358-0d91-4ca2-ba43-af67c68e06dc-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:02:16 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-8e632db4-0659-4687-b2d5-2f8d44720723 tempest-ProjectReaderTests-1152707596 None] Lock "cinder-ad27f358-0d91-4ca2-ba43-af67c68e06dc-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:02:16 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-8e632db4-0659-4687-b2d5-2f8d44720723 tempest-ProjectReaderTests-1152707596 None] Acquiring lock "cinder-quobyte-ad27f358-0d91-4ca2-ba43-af67c68e06dc" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:02:16 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-8e632db4-0659-4687-b2d5-2f8d44720723 tempest-ProjectReaderTests-1152707596 None] Lock "cinder-quobyte-ad27f358-0d91-4ca2-ba43-af67c68e06dc" acquired by "delete_volume" :: waited 0.031s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:02:16 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b6f98e-c082-47ca-bb3c-55c9e60d72d7]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:02:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8e632db4-0659-4687-b2d5-2f8d44720723 tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ad27f358-0d91-4ca2-ba43-af67c68e06dc {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:16 devstack sudo[127773]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0febbb2b-cca5-4537-9296-f5e8726e23fb tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9eb44e1e-bd9b-483a-9172-4de012d453dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9eb44e1e-bd9b-483a-9172-4de012d453dc.ddf85d42-7654-4cfd-9d63-eb5bb937ca98 1G" returned: 0 in 0.448s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0febbb2b-cca5-4537-9296-f5e8726e23fb tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9eb44e1e-bd9b-483a-9172-4de012d453dc -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9eb44e1e-bd9b-483a-9172-4de012d453dc.ddf85d42-7654-4cfd-9d63-eb5bb937ca98 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:16 devstack sudo[127792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9eb44e1e-bd9b-483a-9172-4de012d453dc -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9eb44e1e-bd9b-483a-9172-4de012d453dc.ddf85d42-7654-4cfd-9d63-eb5bb937ca98 Sep 08 07:02:16 devstack sudo[127792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:16 devstack sudo[127791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ad27f358-0d91-4ca2-ba43-af67c68e06dc Sep 08 07:02:16 devstack sudo[127791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:16 devstack sudo[127792]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0febbb2b-cca5-4537-9296-f5e8726e23fb tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9eb44e1e-bd9b-483a-9172-4de012d453dc -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9eb44e1e-bd9b-483a-9172-4de012d453dc.ddf85d42-7654-4cfd-9d63-eb5bb937ca98" returned: 0 in 0.296s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:16 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-0febbb2b-cca5-4537-9296-f5e8726e23fb tempest-ProjectMemberTests-411164925 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9eb44e1e-bd9b-483a-9172-4de012d453dc.ddf85d42-7654-4cfd-9d63-eb5bb937ca98 is being set with open permissions: ugo+rw Sep 08 07:02:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0febbb2b-cca5-4537-9296-f5e8726e23fb tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9eb44e1e-bd9b-483a-9172-4de012d453dc.ddf85d42-7654-4cfd-9d63-eb5bb937ca98 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:16 devstack sudo[127810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9eb44e1e-bd9b-483a-9172-4de012d453dc.ddf85d42-7654-4cfd-9d63-eb5bb937ca98 Sep 08 07:02:16 devstack sudo[127810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:16 devstack sudo[127791]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8e632db4-0659-4687-b2d5-2f8d44720723 tempest-ProjectReaderTests-1152707596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ad27f358-0d91-4ca2-ba43-af67c68e06dc" returned: 0 in 0.362s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8e632db4-0659-4687-b2d5-2f8d44720723 tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ad27f358-0d91-4ca2-ba43-af67c68e06dc {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:16 devstack sudo[127814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ad27f358-0d91-4ca2-ba43-af67c68e06dc Sep 08 07:02:16 devstack sudo[127814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:16 devstack sudo[127810]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0febbb2b-cca5-4537-9296-f5e8726e23fb tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9eb44e1e-bd9b-483a-9172-4de012d453dc.ddf85d42-7654-4cfd-9d63-eb5bb937ca98" returned: 0 in 0.252s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0febbb2b-cca5-4537-9296-f5e8726e23fb tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9eb44e1e-bd9b-483a-9172-4de012d453dc.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:16 devstack sudo[127814]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8e632db4-0659-4687-b2d5-2f8d44720723 tempest-ProjectReaderTests-1152707596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ad27f358-0d91-4ca2-ba43-af67c68e06dc" returned: 0 in 0.252s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:16 devstack sudo[127825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9eb44e1e-bd9b-483a-9172-4de012d453dc.info Sep 08 07:02:16 devstack sudo[127825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:16 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-8e632db4-0659-4687-b2d5-2f8d44720723 tempest-ProjectReaderTests-1152707596 None] Lock "cinder-quobyte-ad27f358-0d91-4ca2-ba43-af67c68e06dc" released by "delete_volume" :: held 0.676s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:02:16 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-8e632db4-0659-4687-b2d5-2f8d44720723 tempest-ProjectReaderTests-1152707596 None] Created reservations ['1a1161f0-b70c-4f3f-a01b-787ee5aaebb7', '3e81f952-557d-4adc-9275-bb176d09a1ea', 'a0b84584-52ae-4240-a685-f0664bbfa980', '230232ba-56b9-4dd8-90cb-21697dcfb66f'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:02:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8e632db4-0659-4687-b2d5-2f8d44720723 tempest-ProjectReaderTests-1152707596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:02:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8e632db4-0659-4687-b2d5-2f8d44720723 tempest-ProjectReaderTests-1152707596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:02:16 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8e632db4-0659-4687-b2d5-2f8d44720723 tempest-ProjectReaderTests-1152707596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:02:16 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8e632db4-0659-4687-b2d5-2f8d44720723 tempest-ProjectReaderTests-1152707596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:02:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8e632db4-0659-4687-b2d5-2f8d44720723 tempest-ProjectReaderTests-1152707596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:02:16 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8e632db4-0659-4687-b2d5-2f8d44720723 tempest-ProjectReaderTests-1152707596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:16 devstack sudo[127830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 07:02:16 devstack sudo[127830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:17 devstack sudo[127825]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0febbb2b-cca5-4537-9296-f5e8726e23fb tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9eb44e1e-bd9b-483a-9172-4de012d453dc.info" returned: 0 in 0.254s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:17 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-0febbb2b-cca5-4537-9296-f5e8726e23fb tempest-ProjectMemberTests-411164925 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9eb44e1e-bd9b-483a-9172-4de012d453dc.info is being set with open permissions: ugo+rw Sep 08 07:02:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0febbb2b-cca5-4537-9296-f5e8726e23fb tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9eb44e1e-bd9b-483a-9172-4de012d453dc.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:17 devstack sudo[127836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9eb44e1e-bd9b-483a-9172-4de012d453dc.info Sep 08 07:02:17 devstack sudo[127836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:17 devstack sudo[127830]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8e632db4-0659-4687-b2d5-2f8d44720723 tempest-ProjectReaderTests-1152707596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.255s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:17 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-8e632db4-0659-4687-b2d5-2f8d44720723 tempest-ProjectReaderTests-1152707596 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:02:17 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-8e632db4-0659-4687-b2d5-2f8d44720723 tempest-ProjectReaderTests-1152707596 None] Deleted volume successfully. Sep 08 07:02:17 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-8e632db4-0659-4687-b2d5-2f8d44720723 tempest-ProjectReaderTests-1152707596 None] Lock "cinder-ad27f358-0d91-4ca2-ba43-af67c68e06dc-delete_volume" released by "delete_volume" :: held 1.152s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:02:17 devstack sudo[127836]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0febbb2b-cca5-4537-9296-f5e8726e23fb tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9eb44e1e-bd9b-483a-9172-4de012d453dc.info" returned: 0 in 0.260s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-0febbb2b-cca5-4537-9296-f5e8726e23fb tempest-ProjectMemberTests-411164925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.955s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:02:17 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-0febbb2b-cca5-4537-9296-f5e8726e23fb tempest-ProjectMemberTests-411164925 None] Create snapshot completed successfully Sep 08 07:02:17 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-784142da-ded8-4ced-87cf-ce5dedb5d88a tempest-ProjectMemberTests-411164925 None] Acquiring lock "cinder-ddf85d42-7654-4cfd-9d63-eb5bb937ca98-delete_snapshot" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:02:17 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-784142da-ded8-4ced-87cf-ce5dedb5d88a tempest-ProjectMemberTests-411164925 None] Lock "cinder-ddf85d42-7654-4cfd-9d63-eb5bb937ca98-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:02:17 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-784142da-ded8-4ced-87cf-ce5dedb5d88a tempest-ProjectMemberTests-411164925 None] Acquiring lock "cinder-quobyte-9eb44e1e-bd9b-483a-9172-4de012d453dc" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:02:17 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-784142da-ded8-4ced-87cf-ce5dedb5d88a tempest-ProjectMemberTests-411164925 None] Lock "cinder-quobyte-9eb44e1e-bd9b-483a-9172-4de012d453dc" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:02:17 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-784142da-ded8-4ced-87cf-ce5dedb5d88a tempest-ProjectMemberTests-411164925 None] Acquiring lock "cinder-quobyte-ddf85d42-7654-4cfd-9d63-eb5bb937ca98" by "_delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:02:17 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-784142da-ded8-4ced-87cf-ce5dedb5d88a tempest-ProjectMemberTests-411164925 None] Lock "cinder-quobyte-ddf85d42-7654-4cfd-9d63-eb5bb937ca98" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:02:17 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-784142da-ded8-4ced-87cf-ce5dedb5d88a tempest-ProjectMemberTests-411164925 None] Deleting offline snapshot ddf85d42-7654-4cfd-9d63-eb5bb937ca98 of volume 9eb44e1e-bd9b-483a-9172-4de012d453dc {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 07:02:17 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-784142da-ded8-4ced-87cf-ce5dedb5d88a tempest-ProjectMemberTests-411164925 None] snapshot_file for this snap is: volume-9eb44e1e-bd9b-483a-9172-4de012d453dc.ddf85d42-7654-4cfd-9d63-eb5bb937ca98 {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 07:02:17 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea280169-37c9-4d7e-afa3-de81a3c188be]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:02:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-784142da-ded8-4ced-87cf-ce5dedb5d88a tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9eb44e1e-bd9b-483a-9172-4de012d453dc.ddf85d42-7654-4cfd-9d63-eb5bb937ca98 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:17 devstack sudo[127858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9eb44e1e-bd9b-483a-9172-4de012d453dc.ddf85d42-7654-4cfd-9d63-eb5bb937ca98 Sep 08 07:02:17 devstack sudo[127858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:17 devstack sudo[127858]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:17 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-784142da-ded8-4ced-87cf-ce5dedb5d88a tempest-ProjectMemberTests-411164925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9eb44e1e-bd9b-483a-9172-4de012d453dc.ddf85d42-7654-4cfd-9d63-eb5bb937ca98" returned: 0 in 0.382s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:17 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-784142da-ded8-4ced-87cf-ce5dedb5d88a tempest-ProjectMemberTests-411164925 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9eb44e1e-bd9b-483a-9172-4de012d453dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:02:18 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1da590-290d-4be6-acdf-ae03819fa37c]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:02:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-784142da-ded8-4ced-87cf-ce5dedb5d88a tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9eb44e1e-bd9b-483a-9172-4de012d453dc {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:18 devstack sudo[127875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9eb44e1e-bd9b-483a-9172-4de012d453dc Sep 08 07:02:18 devstack sudo[127875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:18 devstack sudo[127875]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-784142da-ded8-4ced-87cf-ce5dedb5d88a tempest-ProjectMemberTests-411164925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9eb44e1e-bd9b-483a-9172-4de012d453dc" returned: 0 in 0.387s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-784142da-ded8-4ced-87cf-ce5dedb5d88a tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9eb44e1e-bd9b-483a-9172-4de012d453dc.ddf85d42-7654-4cfd-9d63-eb5bb937ca98 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:18 devstack sudo[127892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9eb44e1e-bd9b-483a-9172-4de012d453dc.ddf85d42-7654-4cfd-9d63-eb5bb937ca98 Sep 08 07:02:18 devstack sudo[127892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:18 devstack sudo[127892]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-784142da-ded8-4ced-87cf-ce5dedb5d88a tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9eb44e1e-bd9b-483a-9172-4de012d453dc.ddf85d42-7654-4cfd-9d63-eb5bb937ca98" returned: 0 in 0.375s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:18 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-784142da-ded8-4ced-87cf-ce5dedb5d88a tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9eb44e1e-bd9b-483a-9172-4de012d453dc.ddf85d42-7654-4cfd-9d63-eb5bb937ca98 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:18 devstack sudo[127909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9eb44e1e-bd9b-483a-9172-4de012d453dc.ddf85d42-7654-4cfd-9d63-eb5bb937ca98 Sep 08 07:02:18 devstack sudo[127909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:19 devstack sudo[127909]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-784142da-ded8-4ced-87cf-ce5dedb5d88a tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9eb44e1e-bd9b-483a-9172-4de012d453dc.ddf85d42-7654-4cfd-9d63-eb5bb937ca98" returned: 0 in 0.273s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:19 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-784142da-ded8-4ced-87cf-ce5dedb5d88a tempest-ProjectMemberTests-411164925 None] Lock "cinder-quobyte-ddf85d42-7654-4cfd-9d63-eb5bb937ca98" released by "_delete_snapshot" :: held 1.510s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:02:19 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-784142da-ded8-4ced-87cf-ce5dedb5d88a tempest-ProjectMemberTests-411164925 None] Lock "cinder-quobyte-9eb44e1e-bd9b-483a-9172-4de012d453dc" released by "delete_snapshot" :: held 1.538s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:02:19 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-784142da-ded8-4ced-87cf-ce5dedb5d88a tempest-ProjectMemberTests-411164925 None] Created reservations ['60855588-9e7c-4f1f-80b8-34e16a37abd4', 'debe0d07-cb3f-4803-8673-cee26029a999', 'ae8da979-2fd1-497f-b284-0284960d10e7', '430ca761-836e-4ed4-9eb8-31cbb689d22d'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:02:19 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-784142da-ded8-4ced-87cf-ce5dedb5d88a tempest-ProjectMemberTests-411164925 None] Delete snapshot completed successfully. Sep 08 07:02:19 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-784142da-ded8-4ced-87cf-ce5dedb5d88a tempest-ProjectMemberTests-411164925 None] Lock "cinder-ddf85d42-7654-4cfd-9d63-eb5bb937ca98-delete_snapshot" released by "delete_snapshot" :: held 1.719s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:02:19 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-b611065f-12bd-4736-a46c-00e041914ffc tempest-ProjectMemberTests-411164925 None] Acquiring lock "cinder-9eb44e1e-bd9b-483a-9172-4de012d453dc-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:02:19 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-b611065f-12bd-4736-a46c-00e041914ffc tempest-ProjectMemberTests-411164925 None] Lock "cinder-9eb44e1e-bd9b-483a-9172-4de012d453dc-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:02:19 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-b611065f-12bd-4736-a46c-00e041914ffc tempest-ProjectMemberTests-411164925 None] Acquiring lock "cinder-quobyte-9eb44e1e-bd9b-483a-9172-4de012d453dc" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:02:19 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-b611065f-12bd-4736-a46c-00e041914ffc tempest-ProjectMemberTests-411164925 None] Lock "cinder-quobyte-9eb44e1e-bd9b-483a-9172-4de012d453dc" acquired by "delete_volume" :: waited 0.017s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:02:19 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[195331f2-c6ad-4154-aaed-695a90c57808]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:02:19 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b611065f-12bd-4736-a46c-00e041914ffc tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9eb44e1e-bd9b-483a-9172-4de012d453dc {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:19 devstack sudo[127944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9eb44e1e-bd9b-483a-9172-4de012d453dc Sep 08 07:02:19 devstack sudo[127944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:20 devstack cinder-volume[87507]: DEBUG oslo_service.periodic_task [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87507) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 07:02:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:02:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:02:20 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:02:20 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:02:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:02:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:20 devstack sudo[127957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 07:02:20 devstack sudo[127957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:20 devstack sudo[127944]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b611065f-12bd-4736-a46c-00e041914ffc tempest-ProjectMemberTests-411164925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9eb44e1e-bd9b-483a-9172-4de012d453dc" returned: 0 in 0.384s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b611065f-12bd-4736-a46c-00e041914ffc tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9eb44e1e-bd9b-483a-9172-4de012d453dc {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:20 devstack sudo[127963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9eb44e1e-bd9b-483a-9172-4de012d453dc Sep 08 07:02:20 devstack sudo[127963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:20 devstack sudo[127957]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.272s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:20 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:02:20 devstack cinder-volume[87507]: DEBUG oslo_service.periodic_task [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Running periodic task VolumeManager._thread_info {{(pid=87507) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 07:02:20 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] thread count: 29 {{(pid=87507) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 07:02:20 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] thread info: [<_MainThread(MainThread, started 127913129345152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87507) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 07:02:20 devstack sudo[127963]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b611065f-12bd-4736-a46c-00e041914ffc tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-9eb44e1e-bd9b-483a-9172-4de012d453dc" returned: 0 in 0.278s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:20 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-b611065f-12bd-4736-a46c-00e041914ffc tempest-ProjectMemberTests-411164925 None] Lock "cinder-quobyte-9eb44e1e-bd9b-483a-9172-4de012d453dc" released by "delete_volume" :: held 0.723s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:02:20 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-b611065f-12bd-4736-a46c-00e041914ffc tempest-ProjectMemberTests-411164925 None] Created reservations ['97f89801-41a4-4f7b-b810-a2adda6bee06', 'bb110b75-0f55-468a-b469-c898def9c661', '567ecd85-2077-4ec0-8935-90114fc6f939', 'bbec1ecd-29af-48c4-b579-19e30d40d389'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:02:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b611065f-12bd-4736-a46c-00e041914ffc tempest-ProjectMemberTests-411164925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:02:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b611065f-12bd-4736-a46c-00e041914ffc tempest-ProjectMemberTests-411164925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:02:20 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-b611065f-12bd-4736-a46c-00e041914ffc tempest-ProjectMemberTests-411164925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:02:20 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-b611065f-12bd-4736-a46c-00e041914ffc tempest-ProjectMemberTests-411164925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:02:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-b611065f-12bd-4736-a46c-00e041914ffc tempest-ProjectMemberTests-411164925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:02:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b611065f-12bd-4736-a46c-00e041914ffc tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:20 devstack sudo[127980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 07:02:20 devstack sudo[127980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:20 devstack sudo[127980]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b611065f-12bd-4736-a46c-00e041914ffc tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.253s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:20 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-b611065f-12bd-4736-a46c-00e041914ffc tempest-ProjectMemberTests-411164925 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:02:20 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-b611065f-12bd-4736-a46c-00e041914ffc tempest-ProjectMemberTests-411164925 None] Deleted volume successfully. Sep 08 07:02:20 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-b611065f-12bd-4736-a46c-00e041914ffc tempest-ProjectMemberTests-411164925 None] Lock "cinder-9eb44e1e-bd9b-483a-9172-4de012d453dc-delete_volume" released by "delete_volume" :: held 1.220s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:02:21 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e481093-f422-495e-92cd-86997d513f1a tempest-ProjectMemberTests-411164925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:02:21 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9e481093-f422-495e-92cd-86997d513f1a tempest-ProjectMemberTests-411164925 None] Flow 'volume_create_manager' (14bcc6e4-b616-4daf-b7e4-1b57ab3deb2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:02:21 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9e481093-f422-495e-92cd-86997d513f1a tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e1d67ff-5040-4e70-afab-bbdeb7c0c5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:21 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9e481093-f422-495e-92cd-86997d513f1a tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e1d67ff-5040-4e70-afab-bbdeb7c0c5d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:02:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1130708869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff7205d0-6727-4f5a-839e-850216eae762,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc639babed634473856ad52d77e5a6af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:02:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:02:21Z,use_quota=True,user_id='c850edcf996545b89f3d8d0b683570e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:21 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9e481093-f422-495e-92cd-86997d513f1a tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24d0cff4-44a4-433b-ad53-1edd6e7a7b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:21 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9e481093-f422-495e-92cd-86997d513f1a tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24d0cff4-44a4-433b-ad53-1edd6e7a7b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:21 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9e481093-f422-495e-92cd-86997d513f1a tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (099517e5-9bfe-4df8-bbad-e14cd802a107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:21 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9e481093-f422-495e-92cd-86997d513f1a tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (099517e5-9bfe-4df8-bbad-e14cd802a107) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff7205d0-6727-4f5a-839e-850216eae762', 'volume_name': 'volume-ff7205d0-6727-4f5a-839e-850216eae762', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:21 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9e481093-f422-495e-92cd-86997d513f1a tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8a1448d-d3cc-4103-9462-ea0f94ddcc8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:21 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9e481093-f422-495e-92cd-86997d513f1a tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8a1448d-d3cc-4103-9462-ea0f94ddcc8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:21 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9e481093-f422-495e-92cd-86997d513f1a tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce996a10-e6dc-47ac-8225-77a8bccb6bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:21 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-9e481093-f422-495e-92cd-86997d513f1a tempest-ProjectMemberTests-411164925 None] Volume ff7205d0-6727-4f5a-839e-850216eae762: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff7205d0-6727-4f5a-839e-850216eae762', 'volume_size': 1} Sep 08 07:02:21 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-9e481093-f422-495e-92cd-86997d513f1a tempest-ProjectMemberTests-411164925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:02:21 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-9e481093-f422-495e-92cd-86997d513f1a tempest-ProjectMemberTests-411164925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:02:21 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-9e481093-f422-495e-92cd-86997d513f1a tempest-ProjectMemberTests-411164925 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:02:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1130708869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff7205d0-6727-4f5a-839e-850216eae762,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc639babed634473856ad52d77e5a6af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:02:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:02:21Z,use_quota=True,user_id='c850edcf996545b89f3d8d0b683570e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:02:21 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-9e481093-f422-495e-92cd-86997d513f1a tempest-ProjectMemberTests-411164925 None] Creating volume ff7205d0-6727-4f5a-839e-850216eae762 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:02:21 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-9e481093-f422-495e-92cd-86997d513f1a tempest-ProjectMemberTests-411164925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:02:21 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-9e481093-f422-495e-92cd-86997d513f1a tempest-ProjectMemberTests-411164925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:02:21 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-9e481093-f422-495e-92cd-86997d513f1a tempest-ProjectMemberTests-411164925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:02:21 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-9e481093-f422-495e-92cd-86997d513f1a tempest-ProjectMemberTests-411164925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:02:21 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-9e481093-f422-495e-92cd-86997d513f1a tempest-ProjectMemberTests-411164925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:02:21 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-9e481093-f422-495e-92cd-86997d513f1a tempest-ProjectMemberTests-411164925 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:02:21 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-9e481093-f422-495e-92cd-86997d513f1a tempest-ProjectMemberTests-411164925 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 07:02:21 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9e481093-f422-495e-92cd-86997d513f1a tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ff7205d0-6727-4f5a-839e-850216eae762 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:21 devstack sudo[128004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ff7205d0-6727-4f5a-839e-850216eae762 1073741824 Sep 08 07:02:21 devstack sudo[128004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:21 devstack sudo[128004]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:21 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9e481093-f422-495e-92cd-86997d513f1a tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ff7205d0-6727-4f5a-839e-850216eae762 1073741824" returned: 0 in 0.403s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:21 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9e481093-f422-495e-92cd-86997d513f1a tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ff7205d0-6727-4f5a-839e-850216eae762 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:21 devstack sudo[128025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ff7205d0-6727-4f5a-839e-850216eae762 Sep 08 07:02:21 devstack sudo[128025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:22 devstack sudo[128025]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:22 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9e481093-f422-495e-92cd-86997d513f1a tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ff7205d0-6727-4f5a-839e-850216eae762" returned: 0 in 0.259s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:22 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-9e481093-f422-495e-92cd-86997d513f1a tempest-ProjectMemberTests-411164925 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:02:22 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-9e481093-f422-495e-92cd-86997d513f1a tempest-ProjectMemberTests-411164925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:02:22 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9e481093-f422-495e-92cd-86997d513f1a tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce996a10-e6dc-47ac-8225-77a8bccb6bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff7205d0-6727-4f5a-839e-850216eae762', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:22 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9e481093-f422-495e-92cd-86997d513f1a tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c05d3e7-9646-4def-962f-bc71531bfad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:22 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-9e481093-f422-495e-92cd-86997d513f1a tempest-ProjectMemberTests-411164925 None] Volume volume-ff7205d0-6727-4f5a-839e-850216eae762 (ff7205d0-6727-4f5a-839e-850216eae762): created successfully Sep 08 07:02:22 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9e481093-f422-495e-92cd-86997d513f1a tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c05d3e7-9646-4def-962f-bc71531bfad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:22 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9e481093-f422-495e-92cd-86997d513f1a tempest-ProjectMemberTests-411164925 None] Flow 'volume_create_manager' (14bcc6e4-b616-4daf-b7e4-1b57ab3deb2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:02:22 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-9e481093-f422-495e-92cd-86997d513f1a tempest-ProjectMemberTests-411164925 None] Created volume successfully. Sep 08 07:02:22 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-af3bb665-a3c8-44c8-936f-01f2f2c39af3 tempest-ProjectMemberTests-411164925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:02:22 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-af3bb665-a3c8-44c8-936f-01f2f2c39af3 tempest-ProjectMemberTests-411164925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:02:22 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-af3bb665-a3c8-44c8-936f-01f2f2c39af3 tempest-ProjectMemberTests-411164925 None] Creating offline snapshot d6d5f697-8315-4b07-8018-400fa4e04fc1 of volume ff7205d0-6727-4f5a-839e-850216eae762 {{(pid=87507) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 07:02:22 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2a25bf-4a44-4c9c-966d-0770f93e00db]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:02:22 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-af3bb665-a3c8-44c8-936f-01f2f2c39af3 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ff7205d0-6727-4f5a-839e-850216eae762 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:22 devstack sudo[128053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ff7205d0-6727-4f5a-839e-850216eae762 Sep 08 07:02:22 devstack sudo[128053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:23 devstack sudo[128053]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-af3bb665-a3c8-44c8-936f-01f2f2c39af3 tempest-ProjectMemberTests-411164925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ff7205d0-6727-4f5a-839e-850216eae762" returned: 0 in 0.356s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-af3bb665-a3c8-44c8-936f-01f2f2c39af3 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ff7205d0-6727-4f5a-839e-850216eae762,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ff7205d0-6727-4f5a-839e-850216eae762.d6d5f697-8315-4b07-8018-400fa4e04fc1 1G {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:23 devstack sudo[128070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ff7205d0-6727-4f5a-839e-850216eae762,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ff7205d0-6727-4f5a-839e-850216eae762.d6d5f697-8315-4b07-8018-400fa4e04fc1 1G Sep 08 07:02:23 devstack sudo[128070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:23 devstack sudo[128070]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-af3bb665-a3c8-44c8-936f-01f2f2c39af3 tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ff7205d0-6727-4f5a-839e-850216eae762,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ff7205d0-6727-4f5a-839e-850216eae762.d6d5f697-8315-4b07-8018-400fa4e04fc1 1G" returned: 0 in 0.393s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-af3bb665-a3c8-44c8-936f-01f2f2c39af3 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff7205d0-6727-4f5a-839e-850216eae762 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ff7205d0-6727-4f5a-839e-850216eae762.d6d5f697-8315-4b07-8018-400fa4e04fc1 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:23 devstack sudo[128089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff7205d0-6727-4f5a-839e-850216eae762 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ff7205d0-6727-4f5a-839e-850216eae762.d6d5f697-8315-4b07-8018-400fa4e04fc1 Sep 08 07:02:23 devstack sudo[128089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:23 devstack sudo[128089]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-af3bb665-a3c8-44c8-936f-01f2f2c39af3 tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff7205d0-6727-4f5a-839e-850216eae762 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ff7205d0-6727-4f5a-839e-850216eae762.d6d5f697-8315-4b07-8018-400fa4e04fc1" returned: 0 in 0.348s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:23 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-af3bb665-a3c8-44c8-936f-01f2f2c39af3 tempest-ProjectMemberTests-411164925 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ff7205d0-6727-4f5a-839e-850216eae762.d6d5f697-8315-4b07-8018-400fa4e04fc1 is being set with open permissions: ugo+rw Sep 08 07:02:23 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-af3bb665-a3c8-44c8-936f-01f2f2c39af3 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ff7205d0-6727-4f5a-839e-850216eae762.d6d5f697-8315-4b07-8018-400fa4e04fc1 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:23 devstack sudo[128103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ff7205d0-6727-4f5a-839e-850216eae762.d6d5f697-8315-4b07-8018-400fa4e04fc1 Sep 08 07:02:23 devstack sudo[128103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:24 devstack sudo[128103]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-af3bb665-a3c8-44c8-936f-01f2f2c39af3 tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ff7205d0-6727-4f5a-839e-850216eae762.d6d5f697-8315-4b07-8018-400fa4e04fc1" returned: 0 in 0.264s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-af3bb665-a3c8-44c8-936f-01f2f2c39af3 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ff7205d0-6727-4f5a-839e-850216eae762.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:24 devstack sudo[128115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ff7205d0-6727-4f5a-839e-850216eae762.info Sep 08 07:02:24 devstack sudo[128115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:24 devstack sudo[128115]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-af3bb665-a3c8-44c8-936f-01f2f2c39af3 tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ff7205d0-6727-4f5a-839e-850216eae762.info" returned: 0 in 0.272s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:24 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-af3bb665-a3c8-44c8-936f-01f2f2c39af3 tempest-ProjectMemberTests-411164925 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ff7205d0-6727-4f5a-839e-850216eae762.info is being set with open permissions: ugo+rw Sep 08 07:02:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-af3bb665-a3c8-44c8-936f-01f2f2c39af3 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ff7205d0-6727-4f5a-839e-850216eae762.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:24 devstack sudo[128127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ff7205d0-6727-4f5a-839e-850216eae762.info Sep 08 07:02:24 devstack sudo[128127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:24 devstack sudo[128127]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-af3bb665-a3c8-44c8-936f-01f2f2c39af3 tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ff7205d0-6727-4f5a-839e-850216eae762.info" returned: 0 in 0.261s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:24 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-af3bb665-a3c8-44c8-936f-01f2f2c39af3 tempest-ProjectMemberTests-411164925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.995s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:02:24 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-af3bb665-a3c8-44c8-936f-01f2f2c39af3 tempest-ProjectMemberTests-411164925 None] Create snapshot completed successfully Sep 08 07:02:25 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-349c3dd6-125f-4a19-be02-6c0781a6df5c tempest-ProjectMemberTests-411164925 None] Acquiring lock "cinder-d6d5f697-8315-4b07-8018-400fa4e04fc1-delete_snapshot" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:02:25 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-349c3dd6-125f-4a19-be02-6c0781a6df5c tempest-ProjectMemberTests-411164925 None] Lock "cinder-d6d5f697-8315-4b07-8018-400fa4e04fc1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:02:25 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-349c3dd6-125f-4a19-be02-6c0781a6df5c tempest-ProjectMemberTests-411164925 None] Acquiring lock "cinder-quobyte-ff7205d0-6727-4f5a-839e-850216eae762" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:02:25 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-349c3dd6-125f-4a19-be02-6c0781a6df5c tempest-ProjectMemberTests-411164925 None] Lock "cinder-quobyte-ff7205d0-6727-4f5a-839e-850216eae762" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:02:25 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-349c3dd6-125f-4a19-be02-6c0781a6df5c tempest-ProjectMemberTests-411164925 None] Acquiring lock "cinder-quobyte-d6d5f697-8315-4b07-8018-400fa4e04fc1" by "_delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:02:25 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-349c3dd6-125f-4a19-be02-6c0781a6df5c tempest-ProjectMemberTests-411164925 None] Lock "cinder-quobyte-d6d5f697-8315-4b07-8018-400fa4e04fc1" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:02:25 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-349c3dd6-125f-4a19-be02-6c0781a6df5c tempest-ProjectMemberTests-411164925 None] Deleting offline snapshot d6d5f697-8315-4b07-8018-400fa4e04fc1 of volume ff7205d0-6727-4f5a-839e-850216eae762 {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 07:02:25 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-349c3dd6-125f-4a19-be02-6c0781a6df5c tempest-ProjectMemberTests-411164925 None] snapshot_file for this snap is: volume-ff7205d0-6727-4f5a-839e-850216eae762.d6d5f697-8315-4b07-8018-400fa4e04fc1 {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 07:02:25 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9cedfc6-ce9c-443d-bf63-a78ff6f8769c]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:02:25 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-349c3dd6-125f-4a19-be02-6c0781a6df5c tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ff7205d0-6727-4f5a-839e-850216eae762.d6d5f697-8315-4b07-8018-400fa4e04fc1 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:25 devstack sudo[128172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ff7205d0-6727-4f5a-839e-850216eae762.d6d5f697-8315-4b07-8018-400fa4e04fc1 Sep 08 07:02:25 devstack sudo[128172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:26 devstack sudo[128172]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-349c3dd6-125f-4a19-be02-6c0781a6df5c tempest-ProjectMemberTests-411164925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ff7205d0-6727-4f5a-839e-850216eae762.d6d5f697-8315-4b07-8018-400fa4e04fc1" returned: 0 in 0.365s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:26 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-349c3dd6-125f-4a19-be02-6c0781a6df5c tempest-ProjectMemberTests-411164925 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff7205d0-6727-4f5a-839e-850216eae762(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:02:26 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[f127ef16-144e-4ad3-affd-392c310d30e9]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:02:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-349c3dd6-125f-4a19-be02-6c0781a6df5c tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ff7205d0-6727-4f5a-839e-850216eae762 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:26 devstack sudo[128189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ff7205d0-6727-4f5a-839e-850216eae762 Sep 08 07:02:26 devstack sudo[128189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:26 devstack sudo[128189]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-349c3dd6-125f-4a19-be02-6c0781a6df5c tempest-ProjectMemberTests-411164925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ff7205d0-6727-4f5a-839e-850216eae762" returned: 0 in 0.402s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-349c3dd6-125f-4a19-be02-6c0781a6df5c tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ff7205d0-6727-4f5a-839e-850216eae762.d6d5f697-8315-4b07-8018-400fa4e04fc1 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:26 devstack sudo[128206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ff7205d0-6727-4f5a-839e-850216eae762.d6d5f697-8315-4b07-8018-400fa4e04fc1 Sep 08 07:02:26 devstack sudo[128206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:26 devstack sudo[128206]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-349c3dd6-125f-4a19-be02-6c0781a6df5c tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ff7205d0-6727-4f5a-839e-850216eae762.d6d5f697-8315-4b07-8018-400fa4e04fc1" returned: 0 in 0.365s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:26 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-349c3dd6-125f-4a19-be02-6c0781a6df5c tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ff7205d0-6727-4f5a-839e-850216eae762.d6d5f697-8315-4b07-8018-400fa4e04fc1 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:26 devstack sudo[128221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ff7205d0-6727-4f5a-839e-850216eae762.d6d5f697-8315-4b07-8018-400fa4e04fc1 Sep 08 07:02:26 devstack sudo[128221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:27 devstack sudo[128221]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:27 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-349c3dd6-125f-4a19-be02-6c0781a6df5c tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ff7205d0-6727-4f5a-839e-850216eae762.d6d5f697-8315-4b07-8018-400fa4e04fc1" returned: 0 in 0.264s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:27 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-349c3dd6-125f-4a19-be02-6c0781a6df5c tempest-ProjectMemberTests-411164925 None] Lock "cinder-quobyte-d6d5f697-8315-4b07-8018-400fa4e04fc1" released by "_delete_snapshot" :: held 1.504s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:02:27 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-349c3dd6-125f-4a19-be02-6c0781a6df5c tempest-ProjectMemberTests-411164925 None] Lock "cinder-quobyte-ff7205d0-6727-4f5a-839e-850216eae762" released by "delete_snapshot" :: held 1.529s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:02:27 devstack cinder-volume[87507]: DEBUG dbcounter [-] [87507] Writing DB stats cinder:UPDATE=301,cinder:SELECT=240,cinder:INSERT=83,cinder:DELETE=27 {{(pid=87507) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:02:27 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-349c3dd6-125f-4a19-be02-6c0781a6df5c tempest-ProjectMemberTests-411164925 None] Created reservations ['d90a25ff-f1be-46e0-b9c8-0f65dcf742ed', '5ebd703a-291c-4c28-91ab-612a9c4ee839', 'dc55f4bd-582f-40f1-befa-b63a1cd6d33a', '3712fc5f-a0c9-42bb-b880-cd83c5c77cf3'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:02:27 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-349c3dd6-125f-4a19-be02-6c0781a6df5c tempest-ProjectMemberTests-411164925 None] Delete snapshot completed successfully. Sep 08 07:02:27 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-349c3dd6-125f-4a19-be02-6c0781a6df5c tempest-ProjectMemberTests-411164925 None] Lock "cinder-d6d5f697-8315-4b07-8018-400fa4e04fc1-delete_snapshot" released by "delete_snapshot" :: held 1.704s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:02:27 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-674c22ee-0758-43ff-8b86-05306dc01a46 tempest-ProjectMemberTests-411164925 None] Acquiring lock "cinder-ff7205d0-6727-4f5a-839e-850216eae762-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:02:27 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-674c22ee-0758-43ff-8b86-05306dc01a46 tempest-ProjectMemberTests-411164925 None] Lock "cinder-ff7205d0-6727-4f5a-839e-850216eae762-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:02:27 devstack cinder-volume[87507]: DEBUG dbcounter [-] [87507] Writing DB stats cinder:UPDATE=312,cinder:SELECT=234,cinder:DELETE=24,cinder:INSERT=82 {{(pid=87507) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:02:27 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-674c22ee-0758-43ff-8b86-05306dc01a46 tempest-ProjectMemberTests-411164925 None] Acquiring lock "cinder-quobyte-ff7205d0-6727-4f5a-839e-850216eae762" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:02:27 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-674c22ee-0758-43ff-8b86-05306dc01a46 tempest-ProjectMemberTests-411164925 None] Lock "cinder-quobyte-ff7205d0-6727-4f5a-839e-850216eae762" acquired by "delete_volume" :: waited 0.020s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:02:27 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e82d4d-9711-4dde-96ba-20f500325185]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:02:27 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-674c22ee-0758-43ff-8b86-05306dc01a46 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ff7205d0-6727-4f5a-839e-850216eae762 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:28 devstack sudo[128293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ff7205d0-6727-4f5a-839e-850216eae762 Sep 08 07:02:28 devstack sudo[128293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:28 devstack sudo[128293]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:28 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-674c22ee-0758-43ff-8b86-05306dc01a46 tempest-ProjectMemberTests-411164925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ff7205d0-6727-4f5a-839e-850216eae762" returned: 0 in 0.367s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:28 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-674c22ee-0758-43ff-8b86-05306dc01a46 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ff7205d0-6727-4f5a-839e-850216eae762 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:28 devstack sudo[128310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ff7205d0-6727-4f5a-839e-850216eae762 Sep 08 07:02:28 devstack sudo[128310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:28 devstack sudo[128310]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:28 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-674c22ee-0758-43ff-8b86-05306dc01a46 tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-ff7205d0-6727-4f5a-839e-850216eae762" returned: 0 in 0.261s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:28 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-674c22ee-0758-43ff-8b86-05306dc01a46 tempest-ProjectMemberTests-411164925 None] Lock "cinder-quobyte-ff7205d0-6727-4f5a-839e-850216eae762" released by "delete_volume" :: held 0.701s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:02:28 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-674c22ee-0758-43ff-8b86-05306dc01a46 tempest-ProjectMemberTests-411164925 None] Created reservations ['a9149d7a-3a36-4186-92c1-5418d99ff987', '94f453da-c383-475d-9f66-696359ee670d', '19b2e5fa-1f8e-4073-a194-070bcc292f0b', 'f398f9b4-1365-4ee0-b50c-abf75f1ceb03'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:02:28 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-674c22ee-0758-43ff-8b86-05306dc01a46 tempest-ProjectMemberTests-411164925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:02:28 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-674c22ee-0758-43ff-8b86-05306dc01a46 tempest-ProjectMemberTests-411164925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:02:28 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-674c22ee-0758-43ff-8b86-05306dc01a46 tempest-ProjectMemberTests-411164925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:02:28 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-674c22ee-0758-43ff-8b86-05306dc01a46 tempest-ProjectMemberTests-411164925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:02:28 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-674c22ee-0758-43ff-8b86-05306dc01a46 tempest-ProjectMemberTests-411164925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:02:28 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-674c22ee-0758-43ff-8b86-05306dc01a46 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:28 devstack sudo[128325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 07:02:28 devstack sudo[128325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:29 devstack sudo[128325]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:29 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-674c22ee-0758-43ff-8b86-05306dc01a46 tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.247s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:29 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-674c22ee-0758-43ff-8b86-05306dc01a46 tempest-ProjectMemberTests-411164925 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:02:29 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-674c22ee-0758-43ff-8b86-05306dc01a46 tempest-ProjectMemberTests-411164925 None] Deleted volume successfully. Sep 08 07:02:29 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-674c22ee-0758-43ff-8b86-05306dc01a46 tempest-ProjectMemberTests-411164925 None] Lock "cinder-ff7205d0-6727-4f5a-839e-850216eae762-delete_volume" released by "delete_volume" :: held 1.218s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:02:29 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d74edfd-555f-4806-8bd9-eb54bc703d0c tempest-ProjectMemberTests-411164925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:02:29 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9d74edfd-555f-4806-8bd9-eb54bc703d0c tempest-ProjectMemberTests-411164925 None] Flow 'volume_create_manager' (e0ef14bc-b4ac-4703-a5e0-d3adff3658ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:02:29 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9d74edfd-555f-4806-8bd9-eb54bc703d0c tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29879da8-422e-4d52-aedc-596bbb4aab85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:29 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9d74edfd-555f-4806-8bd9-eb54bc703d0c tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29879da8-422e-4d52-aedc-596bbb4aab85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:02:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1469318849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50249e6f-6ea5-4574-9cd0-6c46ad732c26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc639babed634473856ad52d77e5a6af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:02:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:02:30Z,use_quota=True,user_id='c850edcf996545b89f3d8d0b683570e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:29 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9d74edfd-555f-4806-8bd9-eb54bc703d0c tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f937c9a-8720-4e10-ada7-ee79e337df6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:29 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9d74edfd-555f-4806-8bd9-eb54bc703d0c tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f937c9a-8720-4e10-ada7-ee79e337df6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:29 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9d74edfd-555f-4806-8bd9-eb54bc703d0c tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9960718d-0939-4049-8788-91cfd2a1bf33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:29 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9d74edfd-555f-4806-8bd9-eb54bc703d0c tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9960718d-0939-4049-8788-91cfd2a1bf33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50249e6f-6ea5-4574-9cd0-6c46ad732c26', 'volume_name': 'volume-50249e6f-6ea5-4574-9cd0-6c46ad732c26', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:29 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9d74edfd-555f-4806-8bd9-eb54bc703d0c tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f15b933e-a3be-4c68-b512-9a11c215044b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:29 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9d74edfd-555f-4806-8bd9-eb54bc703d0c tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f15b933e-a3be-4c68-b512-9a11c215044b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:29 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9d74edfd-555f-4806-8bd9-eb54bc703d0c tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (238a15d7-0821-4359-b9f4-54460e4d1691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:29 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-9d74edfd-555f-4806-8bd9-eb54bc703d0c tempest-ProjectMemberTests-411164925 None] Volume 50249e6f-6ea5-4574-9cd0-6c46ad732c26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50249e6f-6ea5-4574-9cd0-6c46ad732c26', 'volume_size': 1} Sep 08 07:02:29 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-9d74edfd-555f-4806-8bd9-eb54bc703d0c tempest-ProjectMemberTests-411164925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:02:29 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-9d74edfd-555f-4806-8bd9-eb54bc703d0c tempest-ProjectMemberTests-411164925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:02:29 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-9d74edfd-555f-4806-8bd9-eb54bc703d0c tempest-ProjectMemberTests-411164925 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:02:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1469318849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50249e6f-6ea5-4574-9cd0-6c46ad732c26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc639babed634473856ad52d77e5a6af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:02:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:02:30Z,use_quota=True,user_id='c850edcf996545b89f3d8d0b683570e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:02:29 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-9d74edfd-555f-4806-8bd9-eb54bc703d0c tempest-ProjectMemberTests-411164925 None] Creating volume 50249e6f-6ea5-4574-9cd0-6c46ad732c26 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:02:29 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-9d74edfd-555f-4806-8bd9-eb54bc703d0c tempest-ProjectMemberTests-411164925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:02:29 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-9d74edfd-555f-4806-8bd9-eb54bc703d0c tempest-ProjectMemberTests-411164925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:02:29 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-9d74edfd-555f-4806-8bd9-eb54bc703d0c tempest-ProjectMemberTests-411164925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:02:29 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-9d74edfd-555f-4806-8bd9-eb54bc703d0c tempest-ProjectMemberTests-411164925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:02:29 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-9d74edfd-555f-4806-8bd9-eb54bc703d0c tempest-ProjectMemberTests-411164925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:02:29 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-9d74edfd-555f-4806-8bd9-eb54bc703d0c tempest-ProjectMemberTests-411164925 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:02:29 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-9d74edfd-555f-4806-8bd9-eb54bc703d0c tempest-ProjectMemberTests-411164925 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 07:02:29 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9d74edfd-555f-4806-8bd9-eb54bc703d0c tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-50249e6f-6ea5-4574-9cd0-6c46ad732c26 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:29 devstack sudo[128357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-50249e6f-6ea5-4574-9cd0-6c46ad732c26 1073741824 Sep 08 07:02:29 devstack sudo[128357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:30 devstack sudo[128357]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:30 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9d74edfd-555f-4806-8bd9-eb54bc703d0c tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-50249e6f-6ea5-4574-9cd0-6c46ad732c26 1073741824" returned: 0 in 0.415s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:30 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9d74edfd-555f-4806-8bd9-eb54bc703d0c tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-50249e6f-6ea5-4574-9cd0-6c46ad732c26 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:30 devstack sudo[128375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-50249e6f-6ea5-4574-9cd0-6c46ad732c26 Sep 08 07:02:30 devstack sudo[128375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:30 devstack sudo[128375]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:30 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-9d74edfd-555f-4806-8bd9-eb54bc703d0c tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-50249e6f-6ea5-4574-9cd0-6c46ad732c26" returned: 0 in 0.266s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:30 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-9d74edfd-555f-4806-8bd9-eb54bc703d0c tempest-ProjectMemberTests-411164925 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:02:30 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-9d74edfd-555f-4806-8bd9-eb54bc703d0c tempest-ProjectMemberTests-411164925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:02:30 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9d74edfd-555f-4806-8bd9-eb54bc703d0c tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (238a15d7-0821-4359-b9f4-54460e4d1691) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50249e6f-6ea5-4574-9cd0-6c46ad732c26', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:30 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9d74edfd-555f-4806-8bd9-eb54bc703d0c tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07361b68-e5e6-45c5-b921-31284b02618c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:30 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-9d74edfd-555f-4806-8bd9-eb54bc703d0c tempest-ProjectMemberTests-411164925 None] Volume volume-50249e6f-6ea5-4574-9cd0-6c46ad732c26 (50249e6f-6ea5-4574-9cd0-6c46ad732c26): created successfully Sep 08 07:02:30 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9d74edfd-555f-4806-8bd9-eb54bc703d0c tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07361b68-e5e6-45c5-b921-31284b02618c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:30 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-9d74edfd-555f-4806-8bd9-eb54bc703d0c tempest-ProjectMemberTests-411164925 None] Flow 'volume_create_manager' (e0ef14bc-b4ac-4703-a5e0-d3adff3658ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:02:30 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-9d74edfd-555f-4806-8bd9-eb54bc703d0c tempest-ProjectMemberTests-411164925 None] Created volume successfully. Sep 08 07:02:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-5d8c0e00-a85a-49fd-9fcd-e41ab8f05464 tempest-ProjectMemberTests-411164925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:02:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-5d8c0e00-a85a-49fd-9fcd-e41ab8f05464 tempest-ProjectMemberTests-411164925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:02:31 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-5d8c0e00-a85a-49fd-9fcd-e41ab8f05464 tempest-ProjectMemberTests-411164925 None] Creating offline snapshot c55afc98-aa61-4ef6-ba3f-027a0921c040 of volume 50249e6f-6ea5-4574-9cd0-6c46ad732c26 {{(pid=87507) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 07:02:31 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[337d241f-4d49-4372-bf3a-a19b61e499f3]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:02:31 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5d8c0e00-a85a-49fd-9fcd-e41ab8f05464 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-50249e6f-6ea5-4574-9cd0-6c46ad732c26 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:31 devstack sudo[128426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-50249e6f-6ea5-4574-9cd0-6c46ad732c26 Sep 08 07:02:31 devstack sudo[128426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:32 devstack sudo[128426]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5d8c0e00-a85a-49fd-9fcd-e41ab8f05464 tempest-ProjectMemberTests-411164925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-50249e6f-6ea5-4574-9cd0-6c46ad732c26" returned: 0 in 0.366s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5d8c0e00-a85a-49fd-9fcd-e41ab8f05464 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-50249e6f-6ea5-4574-9cd0-6c46ad732c26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-50249e6f-6ea5-4574-9cd0-6c46ad732c26.c55afc98-aa61-4ef6-ba3f-027a0921c040 1G {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:32 devstack sudo[128443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-50249e6f-6ea5-4574-9cd0-6c46ad732c26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-50249e6f-6ea5-4574-9cd0-6c46ad732c26.c55afc98-aa61-4ef6-ba3f-027a0921c040 1G Sep 08 07:02:32 devstack sudo[128443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:32 devstack sudo[128443]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5d8c0e00-a85a-49fd-9fcd-e41ab8f05464 tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-50249e6f-6ea5-4574-9cd0-6c46ad732c26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-50249e6f-6ea5-4574-9cd0-6c46ad732c26.c55afc98-aa61-4ef6-ba3f-027a0921c040 1G" returned: 0 in 0.455s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5d8c0e00-a85a-49fd-9fcd-e41ab8f05464 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50249e6f-6ea5-4574-9cd0-6c46ad732c26 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-50249e6f-6ea5-4574-9cd0-6c46ad732c26.c55afc98-aa61-4ef6-ba3f-027a0921c040 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:32 devstack sudo[128461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50249e6f-6ea5-4574-9cd0-6c46ad732c26 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-50249e6f-6ea5-4574-9cd0-6c46ad732c26.c55afc98-aa61-4ef6-ba3f-027a0921c040 Sep 08 07:02:32 devstack sudo[128461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:32 devstack sudo[128461]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5d8c0e00-a85a-49fd-9fcd-e41ab8f05464 tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50249e6f-6ea5-4574-9cd0-6c46ad732c26 -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-50249e6f-6ea5-4574-9cd0-6c46ad732c26.c55afc98-aa61-4ef6-ba3f-027a0921c040" returned: 0 in 0.332s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:32 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-5d8c0e00-a85a-49fd-9fcd-e41ab8f05464 tempest-ProjectMemberTests-411164925 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-50249e6f-6ea5-4574-9cd0-6c46ad732c26.c55afc98-aa61-4ef6-ba3f-027a0921c040 is being set with open permissions: ugo+rw Sep 08 07:02:32 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5d8c0e00-a85a-49fd-9fcd-e41ab8f05464 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-50249e6f-6ea5-4574-9cd0-6c46ad732c26.c55afc98-aa61-4ef6-ba3f-027a0921c040 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:32 devstack sudo[128479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-50249e6f-6ea5-4574-9cd0-6c46ad732c26.c55afc98-aa61-4ef6-ba3f-027a0921c040 Sep 08 07:02:32 devstack sudo[128479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:33 devstack sudo[128479]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5d8c0e00-a85a-49fd-9fcd-e41ab8f05464 tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-50249e6f-6ea5-4574-9cd0-6c46ad732c26.c55afc98-aa61-4ef6-ba3f-027a0921c040" returned: 0 in 0.252s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5d8c0e00-a85a-49fd-9fcd-e41ab8f05464 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-50249e6f-6ea5-4574-9cd0-6c46ad732c26.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:33 devstack sudo[128488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-50249e6f-6ea5-4574-9cd0-6c46ad732c26.info Sep 08 07:02:33 devstack sudo[128488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:33 devstack sudo[128488]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5d8c0e00-a85a-49fd-9fcd-e41ab8f05464 tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-50249e6f-6ea5-4574-9cd0-6c46ad732c26.info" returned: 0 in 0.267s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:33 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-5d8c0e00-a85a-49fd-9fcd-e41ab8f05464 tempest-ProjectMemberTests-411164925 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-50249e6f-6ea5-4574-9cd0-6c46ad732c26.info is being set with open permissions: ugo+rw Sep 08 07:02:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5d8c0e00-a85a-49fd-9fcd-e41ab8f05464 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-50249e6f-6ea5-4574-9cd0-6c46ad732c26.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:33 devstack sudo[128500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-50249e6f-6ea5-4574-9cd0-6c46ad732c26.info Sep 08 07:02:33 devstack sudo[128500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:33 devstack sudo[128500]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-5d8c0e00-a85a-49fd-9fcd-e41ab8f05464 tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-50249e6f-6ea5-4574-9cd0-6c46ad732c26.info" returned: 0 in 0.265s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:33 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-5d8c0e00-a85a-49fd-9fcd-e41ab8f05464 tempest-ProjectMemberTests-411164925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.021s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:02:33 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-5d8c0e00-a85a-49fd-9fcd-e41ab8f05464 tempest-ProjectMemberTests-411164925 None] Create snapshot completed successfully Sep 08 07:02:34 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-b361272e-61ec-41dd-8f4e-90067551d48d tempest-ProjectMemberTests-411164925 None] Acquiring lock "cinder-c55afc98-aa61-4ef6-ba3f-027a0921c040-delete_snapshot" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:02:34 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-b361272e-61ec-41dd-8f4e-90067551d48d tempest-ProjectMemberTests-411164925 None] Lock "cinder-c55afc98-aa61-4ef6-ba3f-027a0921c040-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:02:34 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-b361272e-61ec-41dd-8f4e-90067551d48d tempest-ProjectMemberTests-411164925 None] Acquiring lock "cinder-quobyte-50249e6f-6ea5-4574-9cd0-6c46ad732c26" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:02:34 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-b361272e-61ec-41dd-8f4e-90067551d48d tempest-ProjectMemberTests-411164925 None] Lock "cinder-quobyte-50249e6f-6ea5-4574-9cd0-6c46ad732c26" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:02:34 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-b361272e-61ec-41dd-8f4e-90067551d48d tempest-ProjectMemberTests-411164925 None] Acquiring lock "cinder-quobyte-c55afc98-aa61-4ef6-ba3f-027a0921c040" by "_delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:02:34 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-b361272e-61ec-41dd-8f4e-90067551d48d tempest-ProjectMemberTests-411164925 None] Lock "cinder-quobyte-c55afc98-aa61-4ef6-ba3f-027a0921c040" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:02:34 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-b361272e-61ec-41dd-8f4e-90067551d48d tempest-ProjectMemberTests-411164925 None] Deleting offline snapshot c55afc98-aa61-4ef6-ba3f-027a0921c040 of volume 50249e6f-6ea5-4574-9cd0-6c46ad732c26 {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 07:02:34 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-b361272e-61ec-41dd-8f4e-90067551d48d tempest-ProjectMemberTests-411164925 None] snapshot_file for this snap is: volume-50249e6f-6ea5-4574-9cd0-6c46ad732c26.c55afc98-aa61-4ef6-ba3f-027a0921c040 {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 07:02:34 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e60bb7-8daa-4dac-9d15-5604d9df4d9a]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:02:34 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b361272e-61ec-41dd-8f4e-90067551d48d tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-50249e6f-6ea5-4574-9cd0-6c46ad732c26.c55afc98-aa61-4ef6-ba3f-027a0921c040 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:35 devstack sudo[128548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-50249e6f-6ea5-4574-9cd0-6c46ad732c26.c55afc98-aa61-4ef6-ba3f-027a0921c040 Sep 08 07:02:35 devstack sudo[128548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:35 devstack sudo[128548]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b361272e-61ec-41dd-8f4e-90067551d48d tempest-ProjectMemberTests-411164925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-50249e6f-6ea5-4574-9cd0-6c46ad732c26.c55afc98-aa61-4ef6-ba3f-027a0921c040" returned: 0 in 0.379s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:35 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-b361272e-61ec-41dd-8f4e-90067551d48d tempest-ProjectMemberTests-411164925 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50249e6f-6ea5-4574-9cd0-6c46ad732c26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:02:35 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ea1fa4-905a-48aa-87b3-5c3a2bc2fd68]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:02:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b361272e-61ec-41dd-8f4e-90067551d48d tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-50249e6f-6ea5-4574-9cd0-6c46ad732c26 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:35 devstack sudo[128565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-50249e6f-6ea5-4574-9cd0-6c46ad732c26 Sep 08 07:02:35 devstack sudo[128565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:35 devstack sudo[128565]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b361272e-61ec-41dd-8f4e-90067551d48d tempest-ProjectMemberTests-411164925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-50249e6f-6ea5-4574-9cd0-6c46ad732c26" returned: 0 in 0.376s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:35 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b361272e-61ec-41dd-8f4e-90067551d48d tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-50249e6f-6ea5-4574-9cd0-6c46ad732c26.c55afc98-aa61-4ef6-ba3f-027a0921c040 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:35 devstack sudo[128582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-50249e6f-6ea5-4574-9cd0-6c46ad732c26.c55afc98-aa61-4ef6-ba3f-027a0921c040 Sep 08 07:02:35 devstack sudo[128582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:36 devstack sudo[128582]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b361272e-61ec-41dd-8f4e-90067551d48d tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-50249e6f-6ea5-4574-9cd0-6c46ad732c26.c55afc98-aa61-4ef6-ba3f-027a0921c040" returned: 0 in 0.342s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b361272e-61ec-41dd-8f4e-90067551d48d tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-50249e6f-6ea5-4574-9cd0-6c46ad732c26.c55afc98-aa61-4ef6-ba3f-027a0921c040 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:36 devstack sudo[128602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-50249e6f-6ea5-4574-9cd0-6c46ad732c26.c55afc98-aa61-4ef6-ba3f-027a0921c040 Sep 08 07:02:36 devstack sudo[128602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:36 devstack sudo[128602]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:36 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-b361272e-61ec-41dd-8f4e-90067551d48d tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-50249e6f-6ea5-4574-9cd0-6c46ad732c26.c55afc98-aa61-4ef6-ba3f-027a0921c040" returned: 0 in 0.259s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:36 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-b361272e-61ec-41dd-8f4e-90067551d48d tempest-ProjectMemberTests-411164925 None] Lock "cinder-quobyte-c55afc98-aa61-4ef6-ba3f-027a0921c040" released by "_delete_snapshot" :: held 1.447s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:02:36 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-b361272e-61ec-41dd-8f4e-90067551d48d tempest-ProjectMemberTests-411164925 None] Lock "cinder-quobyte-50249e6f-6ea5-4574-9cd0-6c46ad732c26" released by "delete_snapshot" :: held 1.473s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:02:36 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-b361272e-61ec-41dd-8f4e-90067551d48d tempest-ProjectMemberTests-411164925 None] Created reservations ['13b359af-da88-435a-a4bb-abefc34859e1', '8dd027e2-e55e-48c4-9bb5-431eda9b5b7b', '4dd44187-2ed5-493f-be5b-3de0848e1753', '2cac36ed-a7ee-4626-b425-b7c97a321402'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:02:36 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-b361272e-61ec-41dd-8f4e-90067551d48d tempest-ProjectMemberTests-411164925 None] Delete snapshot completed successfully. Sep 08 07:02:36 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-b361272e-61ec-41dd-8f4e-90067551d48d tempest-ProjectMemberTests-411164925 None] Lock "cinder-c55afc98-aa61-4ef6-ba3f-027a0921c040-delete_snapshot" released by "delete_snapshot" :: held 1.619s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:02:37 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-60e09ad3-add8-453d-bd40-9af8bf0c599d tempest-ProjectMemberTests-411164925 None] Acquiring lock "cinder-50249e6f-6ea5-4574-9cd0-6c46ad732c26-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:02:37 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-60e09ad3-add8-453d-bd40-9af8bf0c599d tempest-ProjectMemberTests-411164925 None] Lock "cinder-50249e6f-6ea5-4574-9cd0-6c46ad732c26-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:02:37 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-60e09ad3-add8-453d-bd40-9af8bf0c599d tempest-ProjectMemberTests-411164925 None] Acquiring lock "cinder-quobyte-50249e6f-6ea5-4574-9cd0-6c46ad732c26" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:02:37 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-60e09ad3-add8-453d-bd40-9af8bf0c599d tempest-ProjectMemberTests-411164925 None] Lock "cinder-quobyte-50249e6f-6ea5-4574-9cd0-6c46ad732c26" acquired by "delete_volume" :: waited 0.024s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:02:37 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[8193b1d7-657d-4d59-aa4f-5a15721b5dca]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:02:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-60e09ad3-add8-453d-bd40-9af8bf0c599d tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-50249e6f-6ea5-4574-9cd0-6c46ad732c26 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:37 devstack sudo[128638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-50249e6f-6ea5-4574-9cd0-6c46ad732c26 Sep 08 07:02:37 devstack sudo[128638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:37 devstack sudo[128638]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-60e09ad3-add8-453d-bd40-9af8bf0c599d tempest-ProjectMemberTests-411164925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-50249e6f-6ea5-4574-9cd0-6c46ad732c26" returned: 0 in 0.379s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-60e09ad3-add8-453d-bd40-9af8bf0c599d tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-50249e6f-6ea5-4574-9cd0-6c46ad732c26 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:37 devstack sudo[128655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-50249e6f-6ea5-4574-9cd0-6c46ad732c26 Sep 08 07:02:37 devstack sudo[128655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:37 devstack sudo[128655]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-60e09ad3-add8-453d-bd40-9af8bf0c599d tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-50249e6f-6ea5-4574-9cd0-6c46ad732c26" returned: 0 in 0.274s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:37 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-60e09ad3-add8-453d-bd40-9af8bf0c599d tempest-ProjectMemberTests-411164925 None] Lock "cinder-quobyte-50249e6f-6ea5-4574-9cd0-6c46ad732c26" released by "delete_volume" :: held 0.715s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:02:37 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-60e09ad3-add8-453d-bd40-9af8bf0c599d tempest-ProjectMemberTests-411164925 None] Created reservations ['f30b385b-984b-4305-8999-55dca8848d77', '88eb9729-fd77-4a01-a12e-b1d9f7ab0a22', '9d7d43d7-39cb-4cee-a4e2-6efa138e8c73', '5b89964d-971d-4782-a67e-4f2d742b889c'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:02:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-60e09ad3-add8-453d-bd40-9af8bf0c599d tempest-ProjectMemberTests-411164925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:02:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-60e09ad3-add8-453d-bd40-9af8bf0c599d tempest-ProjectMemberTests-411164925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:02:37 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-60e09ad3-add8-453d-bd40-9af8bf0c599d tempest-ProjectMemberTests-411164925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:02:37 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-60e09ad3-add8-453d-bd40-9af8bf0c599d tempest-ProjectMemberTests-411164925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:02:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-60e09ad3-add8-453d-bd40-9af8bf0c599d tempest-ProjectMemberTests-411164925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:02:37 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-60e09ad3-add8-453d-bd40-9af8bf0c599d tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:37 devstack sudo[128670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 07:02:37 devstack sudo[128670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:38 devstack sudo[128670]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-60e09ad3-add8-453d-bd40-9af8bf0c599d tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.291s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:38 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-60e09ad3-add8-453d-bd40-9af8bf0c599d tempest-ProjectMemberTests-411164925 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:02:38 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-60e09ad3-add8-453d-bd40-9af8bf0c599d tempest-ProjectMemberTests-411164925 None] Deleted volume successfully. Sep 08 07:02:38 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-60e09ad3-add8-453d-bd40-9af8bf0c599d tempest-ProjectMemberTests-411164925 None] Lock "cinder-50249e6f-6ea5-4574-9cd0-6c46ad732c26-delete_volume" released by "delete_volume" :: held 1.246s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:02:38 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-567a658f-37ab-4c64-bc5b-791d0e9aa5d5 tempest-ProjectMemberTests-411164925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:02:38 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-567a658f-37ab-4c64-bc5b-791d0e9aa5d5 tempest-ProjectMemberTests-411164925 None] Flow 'volume_create_manager' (bf9a2b47-1e85-44ef-9527-67030ee2606a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:02:38 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-567a658f-37ab-4c64-bc5b-791d0e9aa5d5 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90a416a4-e8b3-44f3-b4e8-8eeadfa6ca8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:38 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-567a658f-37ab-4c64-bc5b-791d0e9aa5d5 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90a416a4-e8b3-44f3-b4e8-8eeadfa6ca8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:02:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1732321084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f064024d-d6d7-4d70-98d8-58210577325b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc639babed634473856ad52d77e5a6af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:02:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:02:39Z,use_quota=True,user_id='c850edcf996545b89f3d8d0b683570e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:38 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-567a658f-37ab-4c64-bc5b-791d0e9aa5d5 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be9b1d58-09c5-498e-9f70-ec4bd042b063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:38 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-567a658f-37ab-4c64-bc5b-791d0e9aa5d5 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be9b1d58-09c5-498e-9f70-ec4bd042b063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:38 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-567a658f-37ab-4c64-bc5b-791d0e9aa5d5 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55422408-da7d-4ef2-ba16-1b4d467f171e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:38 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-567a658f-37ab-4c64-bc5b-791d0e9aa5d5 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55422408-da7d-4ef2-ba16-1b4d467f171e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f064024d-d6d7-4d70-98d8-58210577325b', 'volume_name': 'volume-f064024d-d6d7-4d70-98d8-58210577325b', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:38 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-567a658f-37ab-4c64-bc5b-791d0e9aa5d5 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd4679ac-9433-40e3-86c3-00e12d8ce3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:38 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-567a658f-37ab-4c64-bc5b-791d0e9aa5d5 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd4679ac-9433-40e3-86c3-00e12d8ce3c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:38 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-567a658f-37ab-4c64-bc5b-791d0e9aa5d5 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d8491da-1993-4d86-8201-bec412cd1c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:38 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-567a658f-37ab-4c64-bc5b-791d0e9aa5d5 tempest-ProjectMemberTests-411164925 None] Volume f064024d-d6d7-4d70-98d8-58210577325b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f064024d-d6d7-4d70-98d8-58210577325b', 'volume_size': 1} Sep 08 07:02:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-567a658f-37ab-4c64-bc5b-791d0e9aa5d5 tempest-ProjectMemberTests-411164925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:02:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-567a658f-37ab-4c64-bc5b-791d0e9aa5d5 tempest-ProjectMemberTests-411164925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:02:38 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-567a658f-37ab-4c64-bc5b-791d0e9aa5d5 tempest-ProjectMemberTests-411164925 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:02:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1732321084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f064024d-d6d7-4d70-98d8-58210577325b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc639babed634473856ad52d77e5a6af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:02:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:02:39Z,use_quota=True,user_id='c850edcf996545b89f3d8d0b683570e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:02:38 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-567a658f-37ab-4c64-bc5b-791d0e9aa5d5 tempest-ProjectMemberTests-411164925 None] Creating volume f064024d-d6d7-4d70-98d8-58210577325b {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:02:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-567a658f-37ab-4c64-bc5b-791d0e9aa5d5 tempest-ProjectMemberTests-411164925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:02:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-567a658f-37ab-4c64-bc5b-791d0e9aa5d5 tempest-ProjectMemberTests-411164925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:02:38 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-567a658f-37ab-4c64-bc5b-791d0e9aa5d5 tempest-ProjectMemberTests-411164925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:02:38 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-567a658f-37ab-4c64-bc5b-791d0e9aa5d5 tempest-ProjectMemberTests-411164925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:02:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-567a658f-37ab-4c64-bc5b-791d0e9aa5d5 tempest-ProjectMemberTests-411164925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:02:38 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-567a658f-37ab-4c64-bc5b-791d0e9aa5d5 tempest-ProjectMemberTests-411164925 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:02:38 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-567a658f-37ab-4c64-bc5b-791d0e9aa5d5 tempest-ProjectMemberTests-411164925 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 07:02:38 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-567a658f-37ab-4c64-bc5b-791d0e9aa5d5 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f064024d-d6d7-4d70-98d8-58210577325b 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:38 devstack sudo[128697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f064024d-d6d7-4d70-98d8-58210577325b 1073741824 Sep 08 07:02:38 devstack sudo[128697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:39 devstack sudo[128697]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-567a658f-37ab-4c64-bc5b-791d0e9aa5d5 tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f064024d-d6d7-4d70-98d8-58210577325b 1073741824" returned: 0 in 0.434s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-567a658f-37ab-4c64-bc5b-791d0e9aa5d5 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f064024d-d6d7-4d70-98d8-58210577325b {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:39 devstack sudo[128719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f064024d-d6d7-4d70-98d8-58210577325b Sep 08 07:02:39 devstack sudo[128719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:39 devstack sudo[128719]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-567a658f-37ab-4c64-bc5b-791d0e9aa5d5 tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f064024d-d6d7-4d70-98d8-58210577325b" returned: 0 in 0.260s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:39 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-567a658f-37ab-4c64-bc5b-791d0e9aa5d5 tempest-ProjectMemberTests-411164925 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:02:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-567a658f-37ab-4c64-bc5b-791d0e9aa5d5 tempest-ProjectMemberTests-411164925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:02:39 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-567a658f-37ab-4c64-bc5b-791d0e9aa5d5 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d8491da-1993-4d86-8201-bec412cd1c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f064024d-d6d7-4d70-98d8-58210577325b', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:39 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-567a658f-37ab-4c64-bc5b-791d0e9aa5d5 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2af11bd3-37b9-40e0-ae73-3e194d819c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:39 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-567a658f-37ab-4c64-bc5b-791d0e9aa5d5 tempest-ProjectMemberTests-411164925 None] Volume volume-f064024d-d6d7-4d70-98d8-58210577325b (f064024d-d6d7-4d70-98d8-58210577325b): created successfully Sep 08 07:02:39 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-567a658f-37ab-4c64-bc5b-791d0e9aa5d5 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2af11bd3-37b9-40e0-ae73-3e194d819c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:39 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-567a658f-37ab-4c64-bc5b-791d0e9aa5d5 tempest-ProjectMemberTests-411164925 None] Flow 'volume_create_manager' (bf9a2b47-1e85-44ef-9527-67030ee2606a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:02:39 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-567a658f-37ab-4c64-bc5b-791d0e9aa5d5 tempest-ProjectMemberTests-411164925 None] Created volume successfully. Sep 08 07:02:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-941d7e63-598f-4481-992f-9ef1e09e6173 tempest-ProjectMemberTests-411164925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:02:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-941d7e63-598f-4481-992f-9ef1e09e6173 tempest-ProjectMemberTests-411164925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:02:39 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-941d7e63-598f-4481-992f-9ef1e09e6173 tempest-ProjectMemberTests-411164925 None] Creating offline snapshot 40ffd684-f79a-4484-89b2-8210c8f2b76e of volume f064024d-d6d7-4d70-98d8-58210577325b {{(pid=87507) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 07:02:39 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5b18ae-1ff7-4b1a-b65f-a645d4d8fdef]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:02:39 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-941d7e63-598f-4481-992f-9ef1e09e6173 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f064024d-d6d7-4d70-98d8-58210577325b {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:40 devstack sudo[128740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f064024d-d6d7-4d70-98d8-58210577325b Sep 08 07:02:40 devstack sudo[128740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:40 devstack sudo[128740]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-941d7e63-598f-4481-992f-9ef1e09e6173 tempest-ProjectMemberTests-411164925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f064024d-d6d7-4d70-98d8-58210577325b" returned: 0 in 0.378s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-941d7e63-598f-4481-992f-9ef1e09e6173 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f064024d-d6d7-4d70-98d8-58210577325b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f064024d-d6d7-4d70-98d8-58210577325b.40ffd684-f79a-4484-89b2-8210c8f2b76e 1G {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:40 devstack sudo[128757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f064024d-d6d7-4d70-98d8-58210577325b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f064024d-d6d7-4d70-98d8-58210577325b.40ffd684-f79a-4484-89b2-8210c8f2b76e 1G Sep 08 07:02:40 devstack sudo[128757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:40 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-74f96b73-f6d6-4fe0-9781-21a7827bbf41 tempest-ProjectReaderTests-1480099582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:02:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-74f96b73-f6d6-4fe0-9781-21a7827bbf41 tempest-ProjectReaderTests-1480099582 None] Flow 'volume_create_manager' (c57c77b1-140e-4146-bb92-780803c43fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:02:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-74f96b73-f6d6-4fe0-9781-21a7827bbf41 tempest-ProjectReaderTests-1480099582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49221367-c94d-49ec-a8e0-81288766e023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-74f96b73-f6d6-4fe0-9781-21a7827bbf41 tempest-ProjectReaderTests-1480099582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49221367-c94d-49ec-a8e0-81288766e023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:02:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1402299606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4618329-d6a1-4ca5-ac3a-662752731e22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4772b6dc45c4c50a1d46113fafb3720',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:02:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:02:40Z,use_quota=True,user_id='6881a92c05fb4c2aaa59a6cc9a688449',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-74f96b73-f6d6-4fe0-9781-21a7827bbf41 tempest-ProjectReaderTests-1480099582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc16ee93-30fb-445a-ab28-d542c930515a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-74f96b73-f6d6-4fe0-9781-21a7827bbf41 tempest-ProjectReaderTests-1480099582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc16ee93-30fb-445a-ab28-d542c930515a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-74f96b73-f6d6-4fe0-9781-21a7827bbf41 tempest-ProjectReaderTests-1480099582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c18561c-6333-46b0-af90-46b707e804c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-74f96b73-f6d6-4fe0-9781-21a7827bbf41 tempest-ProjectReaderTests-1480099582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c18561c-6333-46b0-af90-46b707e804c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4618329-d6a1-4ca5-ac3a-662752731e22', 'volume_name': 'volume-a4618329-d6a1-4ca5-ac3a-662752731e22', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-74f96b73-f6d6-4fe0-9781-21a7827bbf41 tempest-ProjectReaderTests-1480099582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51f9d14c-dd36-409a-8de7-95098d966fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-74f96b73-f6d6-4fe0-9781-21a7827bbf41 tempest-ProjectReaderTests-1480099582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51f9d14c-dd36-409a-8de7-95098d966fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:40 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-74f96b73-f6d6-4fe0-9781-21a7827bbf41 tempest-ProjectReaderTests-1480099582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e8b7a40-c0d9-4e98-8021-fb7749bf5465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:40 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-74f96b73-f6d6-4fe0-9781-21a7827bbf41 tempest-ProjectReaderTests-1480099582 None] Volume a4618329-d6a1-4ca5-ac3a-662752731e22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4618329-d6a1-4ca5-ac3a-662752731e22', 'volume_size': 1} Sep 08 07:02:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-74f96b73-f6d6-4fe0-9781-21a7827bbf41 tempest-ProjectReaderTests-1480099582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:02:40 devstack sudo[128757]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-941d7e63-598f-4481-992f-9ef1e09e6173 tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f064024d-d6d7-4d70-98d8-58210577325b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f064024d-d6d7-4d70-98d8-58210577325b.40ffd684-f79a-4484-89b2-8210c8f2b76e 1G" returned: 0 in 0.409s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-941d7e63-598f-4481-992f-9ef1e09e6173 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f064024d-d6d7-4d70-98d8-58210577325b -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f064024d-d6d7-4d70-98d8-58210577325b.40ffd684-f79a-4484-89b2-8210c8f2b76e {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:40 devstack sudo[128775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f064024d-d6d7-4d70-98d8-58210577325b -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f064024d-d6d7-4d70-98d8-58210577325b.40ffd684-f79a-4484-89b2-8210c8f2b76e Sep 08 07:02:40 devstack sudo[128775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:40 devstack sudo[128775]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-941d7e63-598f-4481-992f-9ef1e09e6173 tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f064024d-d6d7-4d70-98d8-58210577325b -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f064024d-d6d7-4d70-98d8-58210577325b.40ffd684-f79a-4484-89b2-8210c8f2b76e" returned: 0 in 0.283s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:40 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-941d7e63-598f-4481-992f-9ef1e09e6173 tempest-ProjectMemberTests-411164925 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f064024d-d6d7-4d70-98d8-58210577325b.40ffd684-f79a-4484-89b2-8210c8f2b76e is being set with open permissions: ugo+rw Sep 08 07:02:40 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-941d7e63-598f-4481-992f-9ef1e09e6173 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f064024d-d6d7-4d70-98d8-58210577325b.40ffd684-f79a-4484-89b2-8210c8f2b76e {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:40 devstack sudo[128789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f064024d-d6d7-4d70-98d8-58210577325b.40ffd684-f79a-4484-89b2-8210c8f2b76e Sep 08 07:02:40 devstack sudo[128789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:41 devstack sudo[128789]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-941d7e63-598f-4481-992f-9ef1e09e6173 tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f064024d-d6d7-4d70-98d8-58210577325b.40ffd684-f79a-4484-89b2-8210c8f2b76e" returned: 0 in 0.234s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-941d7e63-598f-4481-992f-9ef1e09e6173 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f064024d-d6d7-4d70-98d8-58210577325b.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:41 devstack sudo[128798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f064024d-d6d7-4d70-98d8-58210577325b.info Sep 08 07:02:41 devstack sudo[128798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:41 devstack sudo[128798]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-941d7e63-598f-4481-992f-9ef1e09e6173 tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f064024d-d6d7-4d70-98d8-58210577325b.info" returned: 0 in 0.248s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:41 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-941d7e63-598f-4481-992f-9ef1e09e6173 tempest-ProjectMemberTests-411164925 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f064024d-d6d7-4d70-98d8-58210577325b.info is being set with open permissions: ugo+rw Sep 08 07:02:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-941d7e63-598f-4481-992f-9ef1e09e6173 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f064024d-d6d7-4d70-98d8-58210577325b.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:41 devstack sudo[128810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f064024d-d6d7-4d70-98d8-58210577325b.info Sep 08 07:02:41 devstack sudo[128810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:41 devstack sudo[128810]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-941d7e63-598f-4481-992f-9ef1e09e6173 tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f064024d-d6d7-4d70-98d8-58210577325b.info" returned: 0 in 0.240s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-941d7e63-598f-4481-992f-9ef1e09e6173 tempest-ProjectMemberTests-411164925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.869s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:02:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-74f96b73-f6d6-4fe0-9781-21a7827bbf41 tempest-ProjectReaderTests-1480099582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.143s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:02:41 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-74f96b73-f6d6-4fe0-9781-21a7827bbf41 tempest-ProjectReaderTests-1480099582 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:02:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1402299606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4618329-d6a1-4ca5-ac3a-662752731e22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4772b6dc45c4c50a1d46113fafb3720',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:02:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:02:40Z,use_quota=True,user_id='6881a92c05fb4c2aaa59a6cc9a688449',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:02:41 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-74f96b73-f6d6-4fe0-9781-21a7827bbf41 tempest-ProjectReaderTests-1480099582 None] Creating volume a4618329-d6a1-4ca5-ac3a-662752731e22 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:02:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-74f96b73-f6d6-4fe0-9781-21a7827bbf41 tempest-ProjectReaderTests-1480099582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:02:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-74f96b73-f6d6-4fe0-9781-21a7827bbf41 tempest-ProjectReaderTests-1480099582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:02:41 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-74f96b73-f6d6-4fe0-9781-21a7827bbf41 tempest-ProjectReaderTests-1480099582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:02:41 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-74f96b73-f6d6-4fe0-9781-21a7827bbf41 tempest-ProjectReaderTests-1480099582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:02:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-74f96b73-f6d6-4fe0-9781-21a7827bbf41 tempest-ProjectReaderTests-1480099582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:02:41 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-74f96b73-f6d6-4fe0-9781-21a7827bbf41 tempest-ProjectReaderTests-1480099582 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:02:41 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-74f96b73-f6d6-4fe0-9781-21a7827bbf41 tempest-ProjectReaderTests-1480099582 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 07:02:41 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-74f96b73-f6d6-4fe0-9781-21a7827bbf41 tempest-ProjectReaderTests-1480099582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a4618329-d6a1-4ca5-ac3a-662752731e22 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:41 devstack sudo[128822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a4618329-d6a1-4ca5-ac3a-662752731e22 1073741824 Sep 08 07:02:41 devstack sudo[128822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:41 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-941d7e63-598f-4481-992f-9ef1e09e6173 tempest-ProjectMemberTests-411164925 None] Create snapshot completed successfully Sep 08 07:02:42 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-fed34f37-47cf-418d-8cd4-24ee7ed03abf tempest-ProjectMemberTests-411164925 None] Acquiring lock "cinder-40ffd684-f79a-4484-89b2-8210c8f2b76e-delete_snapshot" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:02:42 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-fed34f37-47cf-418d-8cd4-24ee7ed03abf tempest-ProjectMemberTests-411164925 None] Lock "cinder-40ffd684-f79a-4484-89b2-8210c8f2b76e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:02:42 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-fed34f37-47cf-418d-8cd4-24ee7ed03abf tempest-ProjectMemberTests-411164925 None] Acquiring lock "cinder-quobyte-f064024d-d6d7-4d70-98d8-58210577325b" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:02:42 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-fed34f37-47cf-418d-8cd4-24ee7ed03abf tempest-ProjectMemberTests-411164925 None] Lock "cinder-quobyte-f064024d-d6d7-4d70-98d8-58210577325b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:02:42 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-fed34f37-47cf-418d-8cd4-24ee7ed03abf tempest-ProjectMemberTests-411164925 None] Acquiring lock "cinder-quobyte-40ffd684-f79a-4484-89b2-8210c8f2b76e" by "_delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:02:42 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-fed34f37-47cf-418d-8cd4-24ee7ed03abf tempest-ProjectMemberTests-411164925 None] Lock "cinder-quobyte-40ffd684-f79a-4484-89b2-8210c8f2b76e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:02:42 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-fed34f37-47cf-418d-8cd4-24ee7ed03abf tempest-ProjectMemberTests-411164925 None] Deleting offline snapshot 40ffd684-f79a-4484-89b2-8210c8f2b76e of volume f064024d-d6d7-4d70-98d8-58210577325b {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 07:02:42 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-fed34f37-47cf-418d-8cd4-24ee7ed03abf tempest-ProjectMemberTests-411164925 None] snapshot_file for this snap is: volume-f064024d-d6d7-4d70-98d8-58210577325b.40ffd684-f79a-4484-89b2-8210c8f2b76e {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 07:02:42 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2af2c6-83a7-4ac5-92a0-85fc40411994]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:02:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-fed34f37-47cf-418d-8cd4-24ee7ed03abf tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f064024d-d6d7-4d70-98d8-58210577325b.40ffd684-f79a-4484-89b2-8210c8f2b76e {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:42 devstack sudo[128822]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-74f96b73-f6d6-4fe0-9781-21a7827bbf41 tempest-ProjectReaderTests-1480099582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a4618329-d6a1-4ca5-ac3a-662752731e22 1073741824" returned: 0 in 0.454s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:42 devstack sudo[128837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f064024d-d6d7-4d70-98d8-58210577325b.40ffd684-f79a-4484-89b2-8210c8f2b76e Sep 08 07:02:42 devstack sudo[128837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-74f96b73-f6d6-4fe0-9781-21a7827bbf41 tempest-ProjectReaderTests-1480099582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a4618329-d6a1-4ca5-ac3a-662752731e22 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:42 devstack sudo[128842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a4618329-d6a1-4ca5-ac3a-662752731e22 Sep 08 07:02:42 devstack sudo[128842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:42 devstack sudo[128837]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-fed34f37-47cf-418d-8cd4-24ee7ed03abf tempest-ProjectMemberTests-411164925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f064024d-d6d7-4d70-98d8-58210577325b.40ffd684-f79a-4484-89b2-8210c8f2b76e" returned: 0 in 0.395s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:42 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-fed34f37-47cf-418d-8cd4-24ee7ed03abf tempest-ProjectMemberTests-411164925 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f064024d-d6d7-4d70-98d8-58210577325b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:02:42 devstack sudo[128842]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-74f96b73-f6d6-4fe0-9781-21a7827bbf41 tempest-ProjectReaderTests-1480099582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a4618329-d6a1-4ca5-ac3a-662752731e22" returned: 0 in 0.294s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:42 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-74f96b73-f6d6-4fe0-9781-21a7827bbf41 tempest-ProjectReaderTests-1480099582 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:02:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-74f96b73-f6d6-4fe0-9781-21a7827bbf41 tempest-ProjectReaderTests-1480099582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:02:42 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e74dff6-2e22-46fd-9aa2-3088627df8d0]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:02:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-fed34f37-47cf-418d-8cd4-24ee7ed03abf tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f064024d-d6d7-4d70-98d8-58210577325b {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:42 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-74f96b73-f6d6-4fe0-9781-21a7827bbf41 tempest-ProjectReaderTests-1480099582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e8b7a40-c0d9-4e98-8021-fb7749bf5465) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4618329-d6a1-4ca5-ac3a-662752731e22', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:42 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-74f96b73-f6d6-4fe0-9781-21a7827bbf41 tempest-ProjectReaderTests-1480099582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7a2ffe0-49de-44f5-bc4e-88cbae7b7cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:42 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-74f96b73-f6d6-4fe0-9781-21a7827bbf41 tempest-ProjectReaderTests-1480099582 None] Volume volume-a4618329-d6a1-4ca5-ac3a-662752731e22 (a4618329-d6a1-4ca5-ac3a-662752731e22): created successfully Sep 08 07:02:42 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-74f96b73-f6d6-4fe0-9781-21a7827bbf41 tempest-ProjectReaderTests-1480099582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7a2ffe0-49de-44f5-bc4e-88cbae7b7cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:42 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-74f96b73-f6d6-4fe0-9781-21a7827bbf41 tempest-ProjectReaderTests-1480099582 None] Flow 'volume_create_manager' (c57c77b1-140e-4146-bb92-780803c43fb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:02:42 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-74f96b73-f6d6-4fe0-9781-21a7827bbf41 tempest-ProjectReaderTests-1480099582 None] Created volume successfully. Sep 08 07:02:42 devstack sudo[128858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f064024d-d6d7-4d70-98d8-58210577325b Sep 08 07:02:42 devstack sudo[128858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:42 devstack sudo[128858]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-fed34f37-47cf-418d-8cd4-24ee7ed03abf tempest-ProjectMemberTests-411164925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f064024d-d6d7-4d70-98d8-58210577325b" returned: 0 in 0.347s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:42 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-fed34f37-47cf-418d-8cd4-24ee7ed03abf tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f064024d-d6d7-4d70-98d8-58210577325b.40ffd684-f79a-4484-89b2-8210c8f2b76e {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:42 devstack sudo[128875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f064024d-d6d7-4d70-98d8-58210577325b.40ffd684-f79a-4484-89b2-8210c8f2b76e Sep 08 07:02:42 devstack sudo[128875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:43 devstack sudo[128875]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-fed34f37-47cf-418d-8cd4-24ee7ed03abf tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f064024d-d6d7-4d70-98d8-58210577325b.40ffd684-f79a-4484-89b2-8210c8f2b76e" returned: 0 in 0.332s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-fed34f37-47cf-418d-8cd4-24ee7ed03abf tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f064024d-d6d7-4d70-98d8-58210577325b.40ffd684-f79a-4484-89b2-8210c8f2b76e {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:43 devstack sudo[128889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f064024d-d6d7-4d70-98d8-58210577325b.40ffd684-f79a-4484-89b2-8210c8f2b76e Sep 08 07:02:43 devstack sudo[128889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:43 devstack sudo[128889]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-fed34f37-47cf-418d-8cd4-24ee7ed03abf tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f064024d-d6d7-4d70-98d8-58210577325b.40ffd684-f79a-4484-89b2-8210c8f2b76e" returned: 0 in 0.272s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:43 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-fed34f37-47cf-418d-8cd4-24ee7ed03abf tempest-ProjectMemberTests-411164925 None] Lock "cinder-quobyte-40ffd684-f79a-4484-89b2-8210c8f2b76e" released by "_delete_snapshot" :: held 1.447s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:02:43 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-fed34f37-47cf-418d-8cd4-24ee7ed03abf tempest-ProjectMemberTests-411164925 None] Lock "cinder-quobyte-f064024d-d6d7-4d70-98d8-58210577325b" released by "delete_snapshot" :: held 1.471s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:02:43 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-fed34f37-47cf-418d-8cd4-24ee7ed03abf tempest-ProjectMemberTests-411164925 None] Created reservations ['192a166b-ab7a-4683-b405-b6c8fef2b5cf', '5eabb020-2cf1-4bc8-8613-966a744470c0', '3daf225f-60a2-4cd3-9f35-afbdbf4f5abc', '368c31a9-c74a-4e6a-93ec-616ff30b9fa9'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:02:43 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-fed34f37-47cf-418d-8cd4-24ee7ed03abf tempest-ProjectMemberTests-411164925 None] Delete snapshot completed successfully. Sep 08 07:02:43 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-fed34f37-47cf-418d-8cd4-24ee7ed03abf tempest-ProjectMemberTests-411164925 None] Lock "cinder-40ffd684-f79a-4484-89b2-8210c8f2b76e-delete_snapshot" released by "delete_snapshot" :: held 1.612s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:02:43 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-831c073e-62c1-4444-a2b9-9e99604ecb0d tempest-ProjectReaderTests-1480099582 None] Acquiring lock "cinder-a4618329-d6a1-4ca5-ac3a-662752731e22-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:02:43 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-831c073e-62c1-4444-a2b9-9e99604ecb0d tempest-ProjectReaderTests-1480099582 None] Lock "cinder-a4618329-d6a1-4ca5-ac3a-662752731e22-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:02:43 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-831c073e-62c1-4444-a2b9-9e99604ecb0d tempest-ProjectReaderTests-1480099582 None] Acquiring lock "cinder-quobyte-a4618329-d6a1-4ca5-ac3a-662752731e22" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:02:43 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-831c073e-62c1-4444-a2b9-9e99604ecb0d tempest-ProjectReaderTests-1480099582 None] Lock "cinder-quobyte-a4618329-d6a1-4ca5-ac3a-662752731e22" acquired by "delete_volume" :: waited 0.018s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:02:43 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[76966aac-30b3-4871-a20c-e690ca423661]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:02:43 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-831c073e-62c1-4444-a2b9-9e99604ecb0d tempest-ProjectReaderTests-1480099582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a4618329-d6a1-4ca5-ac3a-662752731e22 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:43 devstack sudo[128913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a4618329-d6a1-4ca5-ac3a-662752731e22 Sep 08 07:02:43 devstack sudo[128913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:44 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-08557d22-0605-4ffc-aa5b-88e047ae2a5a tempest-ProjectMemberTests-411164925 None] Acquiring lock "cinder-f064024d-d6d7-4d70-98d8-58210577325b-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:02:44 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-08557d22-0605-4ffc-aa5b-88e047ae2a5a tempest-ProjectMemberTests-411164925 None] Lock "cinder-f064024d-d6d7-4d70-98d8-58210577325b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:02:44 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-08557d22-0605-4ffc-aa5b-88e047ae2a5a tempest-ProjectMemberTests-411164925 None] Acquiring lock "cinder-quobyte-f064024d-d6d7-4d70-98d8-58210577325b" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:02:44 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-08557d22-0605-4ffc-aa5b-88e047ae2a5a tempest-ProjectMemberTests-411164925 None] Lock "cinder-quobyte-f064024d-d6d7-4d70-98d8-58210577325b" acquired by "delete_volume" :: waited 0.018s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:02:44 devstack sudo[128913]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-831c073e-62c1-4444-a2b9-9e99604ecb0d tempest-ProjectReaderTests-1480099582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a4618329-d6a1-4ca5-ac3a-662752731e22" returned: 0 in 0.411s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-831c073e-62c1-4444-a2b9-9e99604ecb0d tempest-ProjectReaderTests-1480099582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a4618329-d6a1-4ca5-ac3a-662752731e22 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:44 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4146fa-cc5a-4159-b8e7-342182530851]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:02:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-08557d22-0605-4ffc-aa5b-88e047ae2a5a tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f064024d-d6d7-4d70-98d8-58210577325b {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:44 devstack sudo[128930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a4618329-d6a1-4ca5-ac3a-662752731e22 Sep 08 07:02:44 devstack sudo[128930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:44 devstack sudo[128931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f064024d-d6d7-4d70-98d8-58210577325b Sep 08 07:02:44 devstack sudo[128931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:44 devstack sudo[128930]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-831c073e-62c1-4444-a2b9-9e99604ecb0d tempest-ProjectReaderTests-1480099582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-a4618329-d6a1-4ca5-ac3a-662752731e22" returned: 0 in 0.279s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:44 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-831c073e-62c1-4444-a2b9-9e99604ecb0d tempest-ProjectReaderTests-1480099582 None] Lock "cinder-quobyte-a4618329-d6a1-4ca5-ac3a-662752731e22" released by "delete_volume" :: held 0.727s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:02:44 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-831c073e-62c1-4444-a2b9-9e99604ecb0d tempest-ProjectReaderTests-1480099582 None] Created reservations ['20715a39-0d65-41d8-be77-1a84f7405f96', '517f2429-99c7-4bf3-bb90-cdd12511194b', '4b5b5975-9dcb-42dc-b29a-1e29bfe59011', '19d83970-237f-4130-bf6b-1fb748ca99d4'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:02:44 devstack sudo[128931]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-08557d22-0605-4ffc-aa5b-88e047ae2a5a tempest-ProjectMemberTests-411164925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f064024d-d6d7-4d70-98d8-58210577325b" returned: 0 in 0.377s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-08557d22-0605-4ffc-aa5b-88e047ae2a5a tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f064024d-d6d7-4d70-98d8-58210577325b {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:44 devstack sudo[128950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f064024d-d6d7-4d70-98d8-58210577325b Sep 08 07:02:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-831c073e-62c1-4444-a2b9-9e99604ecb0d tempest-ProjectReaderTests-1480099582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:02:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-831c073e-62c1-4444-a2b9-9e99604ecb0d tempest-ProjectReaderTests-1480099582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:02:44 devstack sudo[128950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:44 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-831c073e-62c1-4444-a2b9-9e99604ecb0d tempest-ProjectReaderTests-1480099582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:02:44 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-831c073e-62c1-4444-a2b9-9e99604ecb0d tempest-ProjectReaderTests-1480099582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:02:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-831c073e-62c1-4444-a2b9-9e99604ecb0d tempest-ProjectReaderTests-1480099582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:02:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-831c073e-62c1-4444-a2b9-9e99604ecb0d tempest-ProjectReaderTests-1480099582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:44 devstack sudo[128952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 07:02:44 devstack sudo[128952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:44 devstack sudo[128950]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-08557d22-0605-4ffc-aa5b-88e047ae2a5a tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-f064024d-d6d7-4d70-98d8-58210577325b" returned: 0 in 0.274s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:44 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-08557d22-0605-4ffc-aa5b-88e047ae2a5a tempest-ProjectMemberTests-411164925 None] Lock "cinder-quobyte-f064024d-d6d7-4d70-98d8-58210577325b" released by "delete_volume" :: held 0.740s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:02:44 devstack sudo[128952]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:44 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-831c073e-62c1-4444-a2b9-9e99604ecb0d tempest-ProjectReaderTests-1480099582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.276s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:44 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-831c073e-62c1-4444-a2b9-9e99604ecb0d tempest-ProjectReaderTests-1480099582 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:02:45 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-831c073e-62c1-4444-a2b9-9e99604ecb0d tempest-ProjectReaderTests-1480099582 None] Deleted volume successfully. Sep 08 07:02:45 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-831c073e-62c1-4444-a2b9-9e99604ecb0d tempest-ProjectReaderTests-1480099582 None] Lock "cinder-a4618329-d6a1-4ca5-ac3a-662752731e22-delete_volume" released by "delete_volume" :: held 1.230s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:02:45 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-08557d22-0605-4ffc-aa5b-88e047ae2a5a tempest-ProjectMemberTests-411164925 None] Created reservations ['0182895b-0f9a-4231-818b-6bd48e204ba4', '02f1ec26-bb10-46ae-bb61-810dc4886326', '4f8a2798-67c2-4672-9547-b395558d288a', 'b7eefed1-7826-47c5-a516-8082dcacbca5'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:02:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-08557d22-0605-4ffc-aa5b-88e047ae2a5a tempest-ProjectMemberTests-411164925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:02:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-08557d22-0605-4ffc-aa5b-88e047ae2a5a tempest-ProjectMemberTests-411164925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:02:45 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-08557d22-0605-4ffc-aa5b-88e047ae2a5a tempest-ProjectMemberTests-411164925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:02:45 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-08557d22-0605-4ffc-aa5b-88e047ae2a5a tempest-ProjectMemberTests-411164925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:02:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-08557d22-0605-4ffc-aa5b-88e047ae2a5a tempest-ProjectMemberTests-411164925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:02:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-08557d22-0605-4ffc-aa5b-88e047ae2a5a tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:45 devstack sudo[128968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 07:02:45 devstack sudo[128968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:45 devstack sudo[128968]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-08557d22-0605-4ffc-aa5b-88e047ae2a5a tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.292s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:45 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-08557d22-0605-4ffc-aa5b-88e047ae2a5a tempest-ProjectMemberTests-411164925 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:02:45 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-08557d22-0605-4ffc-aa5b-88e047ae2a5a tempest-ProjectMemberTests-411164925 None] Deleted volume successfully. Sep 08 07:02:45 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bc03703-a78f-4dee-8239-285331e08476 tempest-ProjectReaderTests-1480099582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:02:45 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6bc03703-a78f-4dee-8239-285331e08476 tempest-ProjectReaderTests-1480099582 None] Flow 'volume_create_manager' (229efe34-f2ec-4398-9c0c-3dc9a9d80c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:02:45 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6bc03703-a78f-4dee-8239-285331e08476 tempest-ProjectReaderTests-1480099582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30c11803-af8d-4ab9-a8a2-103dc9cda303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:45 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6bc03703-a78f-4dee-8239-285331e08476 tempest-ProjectReaderTests-1480099582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30c11803-af8d-4ab9-a8a2-103dc9cda303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:02:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2064700170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=646e0433-1b75-4fd0-9e9c-c93b02464bbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4772b6dc45c4c50a1d46113fafb3720',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:02:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:02:45Z,use_quota=True,user_id='6881a92c05fb4c2aaa59a6cc9a688449',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:45 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6bc03703-a78f-4dee-8239-285331e08476 tempest-ProjectReaderTests-1480099582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a712f8c-55cd-4a11-a904-9188ddac3c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:45 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6bc03703-a78f-4dee-8239-285331e08476 tempest-ProjectReaderTests-1480099582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a712f8c-55cd-4a11-a904-9188ddac3c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:45 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6bc03703-a78f-4dee-8239-285331e08476 tempest-ProjectReaderTests-1480099582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0757d63-2ab7-4860-bfe0-c417336ee012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:45 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6bc03703-a78f-4dee-8239-285331e08476 tempest-ProjectReaderTests-1480099582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0757d63-2ab7-4860-bfe0-c417336ee012) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '646e0433-1b75-4fd0-9e9c-c93b02464bbe', 'volume_name': 'volume-646e0433-1b75-4fd0-9e9c-c93b02464bbe', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:45 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6bc03703-a78f-4dee-8239-285331e08476 tempest-ProjectReaderTests-1480099582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d262f88b-3b31-49ca-a442-99f65bdf98d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:45 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6bc03703-a78f-4dee-8239-285331e08476 tempest-ProjectReaderTests-1480099582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d262f88b-3b31-49ca-a442-99f65bdf98d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:45 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6bc03703-a78f-4dee-8239-285331e08476 tempest-ProjectReaderTests-1480099582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e53d372-e2f7-47a3-b7b4-2a0787d23216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:45 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-6bc03703-a78f-4dee-8239-285331e08476 tempest-ProjectReaderTests-1480099582 None] Volume 646e0433-1b75-4fd0-9e9c-c93b02464bbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-646e0433-1b75-4fd0-9e9c-c93b02464bbe', 'volume_size': 1} Sep 08 07:02:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-6bc03703-a78f-4dee-8239-285331e08476 tempest-ProjectReaderTests-1480099582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:02:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-6bc03703-a78f-4dee-8239-285331e08476 tempest-ProjectReaderTests-1480099582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:02:45 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-6bc03703-a78f-4dee-8239-285331e08476 tempest-ProjectReaderTests-1480099582 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:02:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2064700170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=646e0433-1b75-4fd0-9e9c-c93b02464bbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4772b6dc45c4c50a1d46113fafb3720',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:02:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:02:45Z,use_quota=True,user_id='6881a92c05fb4c2aaa59a6cc9a688449',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:02:45 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-6bc03703-a78f-4dee-8239-285331e08476 tempest-ProjectReaderTests-1480099582 None] Creating volume 646e0433-1b75-4fd0-9e9c-c93b02464bbe {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:02:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-6bc03703-a78f-4dee-8239-285331e08476 tempest-ProjectReaderTests-1480099582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:02:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-6bc03703-a78f-4dee-8239-285331e08476 tempest-ProjectReaderTests-1480099582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:02:45 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-6bc03703-a78f-4dee-8239-285331e08476 tempest-ProjectReaderTests-1480099582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:02:45 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-6bc03703-a78f-4dee-8239-285331e08476 tempest-ProjectReaderTests-1480099582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:02:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-6bc03703-a78f-4dee-8239-285331e08476 tempest-ProjectReaderTests-1480099582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:02:45 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-6bc03703-a78f-4dee-8239-285331e08476 tempest-ProjectReaderTests-1480099582 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:02:45 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-6bc03703-a78f-4dee-8239-285331e08476 tempest-ProjectReaderTests-1480099582 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 07:02:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6bc03703-a78f-4dee-8239-285331e08476 tempest-ProjectReaderTests-1480099582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-646e0433-1b75-4fd0-9e9c-c93b02464bbe 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:45 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-08557d22-0605-4ffc-aa5b-88e047ae2a5a tempest-ProjectMemberTests-411164925 None] Lock "cinder-f064024d-d6d7-4d70-98d8-58210577325b-delete_volume" released by "delete_volume" :: held 1.367s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:02:45 devstack sudo[128983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-646e0433-1b75-4fd0-9e9c-c93b02464bbe 1073741824 Sep 08 07:02:45 devstack sudo[128983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:45 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd2ea27c-f40c-4a23-9083-377e968cfaa3 tempest-ProjectMemberTests-411164925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:02:45 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-dd2ea27c-f40c-4a23-9083-377e968cfaa3 tempest-ProjectMemberTests-411164925 None] Flow 'volume_create_manager' (2d18e672-dfb5-4b8f-8931-b39264469802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:02:45 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-dd2ea27c-f40c-4a23-9083-377e968cfaa3 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00b14a04-498d-4a63-bb12-464d637f4a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:45 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-dd2ea27c-f40c-4a23-9083-377e968cfaa3 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00b14a04-498d-4a63-bb12-464d637f4a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:02:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-32968077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d044040c-8f74-45b0-9213-67157b97658e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc639babed634473856ad52d77e5a6af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:02:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:02:46Z,use_quota=True,user_id='c850edcf996545b89f3d8d0b683570e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:45 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-dd2ea27c-f40c-4a23-9083-377e968cfaa3 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90dd5627-6e4e-4f1a-bb0c-bfbbc165f98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:45 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-dd2ea27c-f40c-4a23-9083-377e968cfaa3 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90dd5627-6e4e-4f1a-bb0c-bfbbc165f98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:45 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-dd2ea27c-f40c-4a23-9083-377e968cfaa3 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0df0b1b4-91a4-4311-8392-5dc5c78ad903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:45 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-dd2ea27c-f40c-4a23-9083-377e968cfaa3 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0df0b1b4-91a4-4311-8392-5dc5c78ad903) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd044040c-8f74-45b0-9213-67157b97658e', 'volume_name': 'volume-d044040c-8f74-45b0-9213-67157b97658e', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:45 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-dd2ea27c-f40c-4a23-9083-377e968cfaa3 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc9ae25a-e48b-45a3-8d7b-cb7273397bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:45 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-dd2ea27c-f40c-4a23-9083-377e968cfaa3 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc9ae25a-e48b-45a3-8d7b-cb7273397bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:45 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-dd2ea27c-f40c-4a23-9083-377e968cfaa3 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8037072-3608-403f-ae2a-01741239c52a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:45 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-dd2ea27c-f40c-4a23-9083-377e968cfaa3 tempest-ProjectMemberTests-411164925 None] Volume d044040c-8f74-45b0-9213-67157b97658e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d044040c-8f74-45b0-9213-67157b97658e', 'volume_size': 1} Sep 08 07:02:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-dd2ea27c-f40c-4a23-9083-377e968cfaa3 tempest-ProjectMemberTests-411164925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:02:45 devstack sudo[128983]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6bc03703-a78f-4dee-8239-285331e08476 tempest-ProjectReaderTests-1480099582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-646e0433-1b75-4fd0-9e9c-c93b02464bbe 1073741824" returned: 0 in 0.421s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:45 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6bc03703-a78f-4dee-8239-285331e08476 tempest-ProjectReaderTests-1480099582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-646e0433-1b75-4fd0-9e9c-c93b02464bbe {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:46 devstack sudo[129003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-646e0433-1b75-4fd0-9e9c-c93b02464bbe Sep 08 07:02:46 devstack sudo[129003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:46 devstack sudo[129003]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6bc03703-a78f-4dee-8239-285331e08476 tempest-ProjectReaderTests-1480099582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-646e0433-1b75-4fd0-9e9c-c93b02464bbe" returned: 0 in 0.244s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:46 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-6bc03703-a78f-4dee-8239-285331e08476 tempest-ProjectReaderTests-1480099582 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:02:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-6bc03703-a78f-4dee-8239-285331e08476 tempest-ProjectReaderTests-1480099582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:02:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-dd2ea27c-f40c-4a23-9083-377e968cfaa3 tempest-ProjectMemberTests-411164925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.341s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:02:46 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-dd2ea27c-f40c-4a23-9083-377e968cfaa3 tempest-ProjectMemberTests-411164925 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:02:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-32968077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d044040c-8f74-45b0-9213-67157b97658e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc639babed634473856ad52d77e5a6af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:02:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:02:46Z,use_quota=True,user_id='c850edcf996545b89f3d8d0b683570e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:02:46 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-dd2ea27c-f40c-4a23-9083-377e968cfaa3 tempest-ProjectMemberTests-411164925 None] Creating volume d044040c-8f74-45b0-9213-67157b97658e {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:02:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-dd2ea27c-f40c-4a23-9083-377e968cfaa3 tempest-ProjectMemberTests-411164925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:02:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-dd2ea27c-f40c-4a23-9083-377e968cfaa3 tempest-ProjectMemberTests-411164925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:02:46 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-dd2ea27c-f40c-4a23-9083-377e968cfaa3 tempest-ProjectMemberTests-411164925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:02:46 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-dd2ea27c-f40c-4a23-9083-377e968cfaa3 tempest-ProjectMemberTests-411164925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:02:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-dd2ea27c-f40c-4a23-9083-377e968cfaa3 tempest-ProjectMemberTests-411164925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:02:46 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-dd2ea27c-f40c-4a23-9083-377e968cfaa3 tempest-ProjectMemberTests-411164925 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:02:46 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-dd2ea27c-f40c-4a23-9083-377e968cfaa3 tempest-ProjectMemberTests-411164925 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 07:02:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-dd2ea27c-f40c-4a23-9083-377e968cfaa3 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d044040c-8f74-45b0-9213-67157b97658e 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:46 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6bc03703-a78f-4dee-8239-285331e08476 tempest-ProjectReaderTests-1480099582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e53d372-e2f7-47a3-b7b4-2a0787d23216) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-646e0433-1b75-4fd0-9e9c-c93b02464bbe', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:46 devstack sudo[129012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d044040c-8f74-45b0-9213-67157b97658e 1073741824 Sep 08 07:02:46 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6bc03703-a78f-4dee-8239-285331e08476 tempest-ProjectReaderTests-1480099582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b29c1e6-e1c7-4a9f-9d2a-a7b489940397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:46 devstack sudo[129012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:46 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-6bc03703-a78f-4dee-8239-285331e08476 tempest-ProjectReaderTests-1480099582 None] Volume volume-646e0433-1b75-4fd0-9e9c-c93b02464bbe (646e0433-1b75-4fd0-9e9c-c93b02464bbe): created successfully Sep 08 07:02:46 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6bc03703-a78f-4dee-8239-285331e08476 tempest-ProjectReaderTests-1480099582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b29c1e6-e1c7-4a9f-9d2a-a7b489940397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:46 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6bc03703-a78f-4dee-8239-285331e08476 tempest-ProjectReaderTests-1480099582 None] Flow 'volume_create_manager' (229efe34-f2ec-4398-9c0c-3dc9a9d80c91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:02:46 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-6bc03703-a78f-4dee-8239-285331e08476 tempest-ProjectReaderTests-1480099582 None] Created volume successfully. Sep 08 07:02:46 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-ab4c91e9-25d6-4223-96b2-52f6bc2e2a43 tempest-ProjectReaderTests-1480099582 None] Acquiring lock "cinder-646e0433-1b75-4fd0-9e9c-c93b02464bbe-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:02:46 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-ab4c91e9-25d6-4223-96b2-52f6bc2e2a43 tempest-ProjectReaderTests-1480099582 None] Lock "cinder-646e0433-1b75-4fd0-9e9c-c93b02464bbe-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:02:46 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-ab4c91e9-25d6-4223-96b2-52f6bc2e2a43 tempest-ProjectReaderTests-1480099582 None] Acquiring lock "cinder-quobyte-646e0433-1b75-4fd0-9e9c-c93b02464bbe" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:02:46 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-ab4c91e9-25d6-4223-96b2-52f6bc2e2a43 tempest-ProjectReaderTests-1480099582 None] Lock "cinder-quobyte-646e0433-1b75-4fd0-9e9c-c93b02464bbe" acquired by "delete_volume" :: waited 0.016s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:02:46 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[eccc5f61-b0ba-4207-94ed-8bab5c90b5cd]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:02:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ab4c91e9-25d6-4223-96b2-52f6bc2e2a43 tempest-ProjectReaderTests-1480099582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-646e0433-1b75-4fd0-9e9c-c93b02464bbe {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:46 devstack sudo[129012]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:46 devstack sudo[129030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-646e0433-1b75-4fd0-9e9c-c93b02464bbe Sep 08 07:02:46 devstack sudo[129030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-dd2ea27c-f40c-4a23-9083-377e968cfaa3 tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d044040c-8f74-45b0-9213-67157b97658e 1073741824" returned: 0 in 0.477s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-dd2ea27c-f40c-4a23-9083-377e968cfaa3 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d044040c-8f74-45b0-9213-67157b97658e {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:46 devstack sudo[129036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d044040c-8f74-45b0-9213-67157b97658e Sep 08 07:02:46 devstack sudo[129036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:46 devstack sudo[129030]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ab4c91e9-25d6-4223-96b2-52f6bc2e2a43 tempest-ProjectReaderTests-1480099582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-646e0433-1b75-4fd0-9e9c-c93b02464bbe" returned: 0 in 0.370s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:46 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ab4c91e9-25d6-4223-96b2-52f6bc2e2a43 tempest-ProjectReaderTests-1480099582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-646e0433-1b75-4fd0-9e9c-c93b02464bbe {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:47 devstack sudo[129050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-646e0433-1b75-4fd0-9e9c-c93b02464bbe Sep 08 07:02:47 devstack sudo[129050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:47 devstack sudo[129036]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-dd2ea27c-f40c-4a23-9083-377e968cfaa3 tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d044040c-8f74-45b0-9213-67157b97658e" returned: 0 in 0.259s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:47 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-dd2ea27c-f40c-4a23-9083-377e968cfaa3 tempest-ProjectMemberTests-411164925 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:02:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-dd2ea27c-f40c-4a23-9083-377e968cfaa3 tempest-ProjectMemberTests-411164925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:02:47 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-dd2ea27c-f40c-4a23-9083-377e968cfaa3 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8037072-3608-403f-ae2a-01741239c52a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d044040c-8f74-45b0-9213-67157b97658e', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:47 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-dd2ea27c-f40c-4a23-9083-377e968cfaa3 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96ef849b-f662-4969-92e0-b6ff8d5d9cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:47 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-dd2ea27c-f40c-4a23-9083-377e968cfaa3 tempest-ProjectMemberTests-411164925 None] Volume volume-d044040c-8f74-45b0-9213-67157b97658e (d044040c-8f74-45b0-9213-67157b97658e): created successfully Sep 08 07:02:47 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-dd2ea27c-f40c-4a23-9083-377e968cfaa3 tempest-ProjectMemberTests-411164925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96ef849b-f662-4969-92e0-b6ff8d5d9cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:47 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-dd2ea27c-f40c-4a23-9083-377e968cfaa3 tempest-ProjectMemberTests-411164925 None] Flow 'volume_create_manager' (2d18e672-dfb5-4b8f-8931-b39264469802) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:02:47 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-dd2ea27c-f40c-4a23-9083-377e968cfaa3 tempest-ProjectMemberTests-411164925 None] Created volume successfully. Sep 08 07:02:47 devstack sudo[129050]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ab4c91e9-25d6-4223-96b2-52f6bc2e2a43 tempest-ProjectReaderTests-1480099582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-646e0433-1b75-4fd0-9e9c-c93b02464bbe" returned: 0 in 0.243s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:47 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-ab4c91e9-25d6-4223-96b2-52f6bc2e2a43 tempest-ProjectReaderTests-1480099582 None] Lock "cinder-quobyte-646e0433-1b75-4fd0-9e9c-c93b02464bbe" released by "delete_volume" :: held 0.653s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:02:47 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-ab4c91e9-25d6-4223-96b2-52f6bc2e2a43 tempest-ProjectReaderTests-1480099582 None] Created reservations ['cafbb29a-42a0-4b14-a316-008050f4ba50', '47a540d7-b98c-48db-a165-913b7fd7400e', '365adb49-55d9-465a-a3ac-e43e69305d79', 'd2d4e97d-4cc7-40e0-a7c9-4311b07841e2'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:02:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-ab4c91e9-25d6-4223-96b2-52f6bc2e2a43 tempest-ProjectReaderTests-1480099582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:02:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-ab4c91e9-25d6-4223-96b2-52f6bc2e2a43 tempest-ProjectReaderTests-1480099582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:02:47 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-ab4c91e9-25d6-4223-96b2-52f6bc2e2a43 tempest-ProjectReaderTests-1480099582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:02:47 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-ab4c91e9-25d6-4223-96b2-52f6bc2e2a43 tempest-ProjectReaderTests-1480099582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:02:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-ab4c91e9-25d6-4223-96b2-52f6bc2e2a43 tempest-ProjectReaderTests-1480099582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:02:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ab4c91e9-25d6-4223-96b2-52f6bc2e2a43 tempest-ProjectReaderTests-1480099582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:47 devstack sudo[129062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 07:02:47 devstack sudo[129062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:47 devstack sudo[129062]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:47 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-ab4c91e9-25d6-4223-96b2-52f6bc2e2a43 tempest-ProjectReaderTests-1480099582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.239s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:47 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-ab4c91e9-25d6-4223-96b2-52f6bc2e2a43 tempest-ProjectReaderTests-1480099582 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:02:47 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-ab4c91e9-25d6-4223-96b2-52f6bc2e2a43 tempest-ProjectReaderTests-1480099582 None] Deleted volume successfully. Sep 08 07:02:47 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-ab4c91e9-25d6-4223-96b2-52f6bc2e2a43 tempest-ProjectReaderTests-1480099582 None] Lock "cinder-646e0433-1b75-4fd0-9e9c-c93b02464bbe-delete_volume" released by "delete_volume" :: held 1.085s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:02:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-93f422e4-d25b-4d68-a938-6e981a3432d2 tempest-ProjectMemberTests-411164925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:02:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-93f422e4-d25b-4d68-a938-6e981a3432d2 tempest-ProjectMemberTests-411164925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:02:48 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4ca4a74-26d1-40b0-bf92-83b26073397a tempest-ProjectReaderTests-1480099582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:02:48 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a4ca4a74-26d1-40b0-bf92-83b26073397a tempest-ProjectReaderTests-1480099582 None] Flow 'volume_create_manager' (7e43a222-981a-4270-8f4a-4ff62e8e4b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:02:48 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a4ca4a74-26d1-40b0-bf92-83b26073397a tempest-ProjectReaderTests-1480099582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02e39108-83d4-45a6-91ae-94b8779e5981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:48 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-93f422e4-d25b-4d68-a938-6e981a3432d2 tempest-ProjectMemberTests-411164925 None] Creating offline snapshot ff75a9f0-0df1-4da0-81d7-5de7ed053366 of volume d044040c-8f74-45b0-9213-67157b97658e {{(pid=87507) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 07:02:48 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a4ca4a74-26d1-40b0-bf92-83b26073397a tempest-ProjectReaderTests-1480099582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02e39108-83d4-45a6-91ae-94b8779e5981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:02:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-874757173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0073a3b8-7a95-4c30-9659-d9ce24a91470,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4772b6dc45c4c50a1d46113fafb3720',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:02:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:02:48Z,use_quota=True,user_id='6881a92c05fb4c2aaa59a6cc9a688449',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:48 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a4ca4a74-26d1-40b0-bf92-83b26073397a tempest-ProjectReaderTests-1480099582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebe5d4fa-d2cb-487a-910d-79b1dd82f09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:48 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a4ca4a74-26d1-40b0-bf92-83b26073397a tempest-ProjectReaderTests-1480099582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebe5d4fa-d2cb-487a-910d-79b1dd82f09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:48 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a4ca4a74-26d1-40b0-bf92-83b26073397a tempest-ProjectReaderTests-1480099582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7945ec8e-bdac-41eb-9a91-17af7a230933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:48 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a4ca4a74-26d1-40b0-bf92-83b26073397a tempest-ProjectReaderTests-1480099582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7945ec8e-bdac-41eb-9a91-17af7a230933) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0073a3b8-7a95-4c30-9659-d9ce24a91470', 'volume_name': 'volume-0073a3b8-7a95-4c30-9659-d9ce24a91470', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:48 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a4ca4a74-26d1-40b0-bf92-83b26073397a tempest-ProjectReaderTests-1480099582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13f2ea90-a505-4a36-bad9-9acffe6f48c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:48 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a4ca4a74-26d1-40b0-bf92-83b26073397a tempest-ProjectReaderTests-1480099582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13f2ea90-a505-4a36-bad9-9acffe6f48c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:48 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a4ca4a74-26d1-40b0-bf92-83b26073397a tempest-ProjectReaderTests-1480099582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (262c9ce2-6fc6-46cb-8210-8e1ee64d7a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:48 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-a4ca4a74-26d1-40b0-bf92-83b26073397a tempest-ProjectReaderTests-1480099582 None] Volume 0073a3b8-7a95-4c30-9659-d9ce24a91470: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0073a3b8-7a95-4c30-9659-d9ce24a91470', 'volume_size': 1} Sep 08 07:02:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a4ca4a74-26d1-40b0-bf92-83b26073397a tempest-ProjectReaderTests-1480099582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:02:48 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec8b5fb-42ed-4c9b-a4f1-e6bdf0c20268]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:02:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-93f422e4-d25b-4d68-a938-6e981a3432d2 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d044040c-8f74-45b0-9213-67157b97658e {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:48 devstack sudo[129095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d044040c-8f74-45b0-9213-67157b97658e Sep 08 07:02:48 devstack sudo[129095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:48 devstack sudo[129095]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-93f422e4-d25b-4d68-a938-6e981a3432d2 tempest-ProjectMemberTests-411164925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d044040c-8f74-45b0-9213-67157b97658e" returned: 0 in 0.354s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:48 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-93f422e4-d25b-4d68-a938-6e981a3432d2 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d044040c-8f74-45b0-9213-67157b97658e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d044040c-8f74-45b0-9213-67157b97658e.ff75a9f0-0df1-4da0-81d7-5de7ed053366 1G {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:48 devstack sudo[129109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d044040c-8f74-45b0-9213-67157b97658e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d044040c-8f74-45b0-9213-67157b97658e.ff75a9f0-0df1-4da0-81d7-5de7ed053366 1G Sep 08 07:02:48 devstack sudo[129109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:49 devstack sudo[129109]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-93f422e4-d25b-4d68-a938-6e981a3432d2 tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d044040c-8f74-45b0-9213-67157b97658e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d044040c-8f74-45b0-9213-67157b97658e.ff75a9f0-0df1-4da0-81d7-5de7ed053366 1G" returned: 0 in 0.388s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-93f422e4-d25b-4d68-a938-6e981a3432d2 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d044040c-8f74-45b0-9213-67157b97658e -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d044040c-8f74-45b0-9213-67157b97658e.ff75a9f0-0df1-4da0-81d7-5de7ed053366 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:49 devstack sudo[129127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d044040c-8f74-45b0-9213-67157b97658e -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d044040c-8f74-45b0-9213-67157b97658e.ff75a9f0-0df1-4da0-81d7-5de7ed053366 Sep 08 07:02:49 devstack sudo[129127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:49 devstack sudo[129127]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-93f422e4-d25b-4d68-a938-6e981a3432d2 tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d044040c-8f74-45b0-9213-67157b97658e -F qcow2 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d044040c-8f74-45b0-9213-67157b97658e.ff75a9f0-0df1-4da0-81d7-5de7ed053366" returned: 0 in 0.294s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:49 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-93f422e4-d25b-4d68-a938-6e981a3432d2 tempest-ProjectMemberTests-411164925 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d044040c-8f74-45b0-9213-67157b97658e.ff75a9f0-0df1-4da0-81d7-5de7ed053366 is being set with open permissions: ugo+rw Sep 08 07:02:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-93f422e4-d25b-4d68-a938-6e981a3432d2 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d044040c-8f74-45b0-9213-67157b97658e.ff75a9f0-0df1-4da0-81d7-5de7ed053366 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:49 devstack sudo[129142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d044040c-8f74-45b0-9213-67157b97658e.ff75a9f0-0df1-4da0-81d7-5de7ed053366 Sep 08 07:02:49 devstack sudo[129142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:49 devstack sudo[129142]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-93f422e4-d25b-4d68-a938-6e981a3432d2 tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d044040c-8f74-45b0-9213-67157b97658e.ff75a9f0-0df1-4da0-81d7-5de7ed053366" returned: 0 in 0.236s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-93f422e4-d25b-4d68-a938-6e981a3432d2 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d044040c-8f74-45b0-9213-67157b97658e.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:49 devstack sudo[129153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d044040c-8f74-45b0-9213-67157b97658e.info Sep 08 07:02:49 devstack sudo[129153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:49 devstack sudo[129153]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-93f422e4-d25b-4d68-a938-6e981a3432d2 tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d044040c-8f74-45b0-9213-67157b97658e.info" returned: 0 in 0.250s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:49 devstack cinder-volume[87507]: WARNING cinder.volume.drivers.remotefs [None req-93f422e4-d25b-4d68-a938-6e981a3432d2 tempest-ProjectMemberTests-411164925 None] /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d044040c-8f74-45b0-9213-67157b97658e.info is being set with open permissions: ugo+rw Sep 08 07:02:49 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-93f422e4-d25b-4d68-a938-6e981a3432d2 tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d044040c-8f74-45b0-9213-67157b97658e.info {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:49 devstack sudo[129163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d044040c-8f74-45b0-9213-67157b97658e.info Sep 08 07:02:49 devstack sudo[129163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:50 devstack sudo[129163]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-93f422e4-d25b-4d68-a938-6e981a3432d2 tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d044040c-8f74-45b0-9213-67157b97658e.info" returned: 0 in 0.237s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-93f422e4-d25b-4d68-a938-6e981a3432d2 tempest-ProjectMemberTests-411164925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.913s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:02:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a4ca4a74-26d1-40b0-bf92-83b26073397a tempest-ProjectReaderTests-1480099582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.817s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:02:50 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-a4ca4a74-26d1-40b0-bf92-83b26073397a tempest-ProjectReaderTests-1480099582 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:02:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-874757173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0073a3b8-7a95-4c30-9659-d9ce24a91470,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4772b6dc45c4c50a1d46113fafb3720',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:02:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:02:48Z,use_quota=True,user_id='6881a92c05fb4c2aaa59a6cc9a688449',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:02:50 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-a4ca4a74-26d1-40b0-bf92-83b26073397a tempest-ProjectReaderTests-1480099582 None] Creating volume 0073a3b8-7a95-4c30-9659-d9ce24a91470 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:02:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a4ca4a74-26d1-40b0-bf92-83b26073397a tempest-ProjectReaderTests-1480099582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:02:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a4ca4a74-26d1-40b0-bf92-83b26073397a tempest-ProjectReaderTests-1480099582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:02:50 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-a4ca4a74-26d1-40b0-bf92-83b26073397a tempest-ProjectReaderTests-1480099582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:02:50 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-a4ca4a74-26d1-40b0-bf92-83b26073397a tempest-ProjectReaderTests-1480099582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:02:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a4ca4a74-26d1-40b0-bf92-83b26073397a tempest-ProjectReaderTests-1480099582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:02:50 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-a4ca4a74-26d1-40b0-bf92-83b26073397a tempest-ProjectReaderTests-1480099582 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:02:50 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-a4ca4a74-26d1-40b0-bf92-83b26073397a tempest-ProjectReaderTests-1480099582 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 07:02:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a4ca4a74-26d1-40b0-bf92-83b26073397a tempest-ProjectReaderTests-1480099582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0073a3b8-7a95-4c30-9659-d9ce24a91470 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:50 devstack sudo[129175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0073a3b8-7a95-4c30-9659-d9ce24a91470 1073741824 Sep 08 07:02:50 devstack sudo[129175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:50 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-93f422e4-d25b-4d68-a938-6e981a3432d2 tempest-ProjectMemberTests-411164925 None] Create snapshot completed successfully Sep 08 07:02:50 devstack sudo[129175]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a4ca4a74-26d1-40b0-bf92-83b26073397a tempest-ProjectReaderTests-1480099582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0073a3b8-7a95-4c30-9659-d9ce24a91470 1073741824" returned: 0 in 0.404s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a4ca4a74-26d1-40b0-bf92-83b26073397a tempest-ProjectReaderTests-1480099582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0073a3b8-7a95-4c30-9659-d9ce24a91470 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:50 devstack sudo[129193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0073a3b8-7a95-4c30-9659-d9ce24a91470 Sep 08 07:02:50 devstack sudo[129193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:50 devstack sudo[129193]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a4ca4a74-26d1-40b0-bf92-83b26073397a tempest-ProjectReaderTests-1480099582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0073a3b8-7a95-4c30-9659-d9ce24a91470" returned: 0 in 0.245s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:50 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-a4ca4a74-26d1-40b0-bf92-83b26073397a tempest-ProjectReaderTests-1480099582 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:02:50 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a4ca4a74-26d1-40b0-bf92-83b26073397a tempest-ProjectReaderTests-1480099582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:02:50 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a4ca4a74-26d1-40b0-bf92-83b26073397a tempest-ProjectReaderTests-1480099582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (262c9ce2-6fc6-46cb-8210-8e1ee64d7a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0073a3b8-7a95-4c30-9659-d9ce24a91470', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:50 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a4ca4a74-26d1-40b0-bf92-83b26073397a tempest-ProjectReaderTests-1480099582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f78ce831-fcbb-4d4f-a07e-64016d8c00ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:50 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-a4ca4a74-26d1-40b0-bf92-83b26073397a tempest-ProjectReaderTests-1480099582 None] Volume volume-0073a3b8-7a95-4c30-9659-d9ce24a91470 (0073a3b8-7a95-4c30-9659-d9ce24a91470): created successfully Sep 08 07:02:50 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a4ca4a74-26d1-40b0-bf92-83b26073397a tempest-ProjectReaderTests-1480099582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f78ce831-fcbb-4d4f-a07e-64016d8c00ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:50 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a4ca4a74-26d1-40b0-bf92-83b26073397a tempest-ProjectReaderTests-1480099582 None] Flow 'volume_create_manager' (7e43a222-981a-4270-8f4a-4ff62e8e4b3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:02:50 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-a4ca4a74-26d1-40b0-bf92-83b26073397a tempest-ProjectReaderTests-1480099582 None] Created volume successfully. Sep 08 07:02:51 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-8b1c2aba-d6df-43db-8a2c-fbb5db00398e tempest-ProjectMemberTests-411164925 None] Acquiring lock "cinder-ff75a9f0-0df1-4da0-81d7-5de7ed053366-delete_snapshot" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:02:51 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-8b1c2aba-d6df-43db-8a2c-fbb5db00398e tempest-ProjectMemberTests-411164925 None] Lock "cinder-ff75a9f0-0df1-4da0-81d7-5de7ed053366-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:02:51 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-8b1c2aba-d6df-43db-8a2c-fbb5db00398e tempest-ProjectMemberTests-411164925 None] Acquiring lock "cinder-quobyte-d044040c-8f74-45b0-9213-67157b97658e" by "delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:02:51 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-8b1c2aba-d6df-43db-8a2c-fbb5db00398e tempest-ProjectMemberTests-411164925 None] Lock "cinder-quobyte-d044040c-8f74-45b0-9213-67157b97658e" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:02:51 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-8b1c2aba-d6df-43db-8a2c-fbb5db00398e tempest-ProjectMemberTests-411164925 None] Acquiring lock "cinder-quobyte-ff75a9f0-0df1-4da0-81d7-5de7ed053366" by "_delete_snapshot" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:02:51 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-69072460-3889-458d-a6e0-c8a26e0a7d3d tempest-ProjectReaderTests-1480099582 None] Acquiring lock "cinder-0073a3b8-7a95-4c30-9659-d9ce24a91470-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:02:51 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-8b1c2aba-d6df-43db-8a2c-fbb5db00398e tempest-ProjectMemberTests-411164925 None] Lock "cinder-quobyte-ff75a9f0-0df1-4da0-81d7-5de7ed053366" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:02:51 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-8b1c2aba-d6df-43db-8a2c-fbb5db00398e tempest-ProjectMemberTests-411164925 None] Deleting offline snapshot ff75a9f0-0df1-4da0-81d7-5de7ed053366 of volume d044040c-8f74-45b0-9213-67157b97658e {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 07:02:51 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-8b1c2aba-d6df-43db-8a2c-fbb5db00398e tempest-ProjectMemberTests-411164925 None] snapshot_file for this snap is: volume-d044040c-8f74-45b0-9213-67157b97658e.ff75a9f0-0df1-4da0-81d7-5de7ed053366 {{(pid=87507) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 07:02:51 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-69072460-3889-458d-a6e0-c8a26e0a7d3d tempest-ProjectReaderTests-1480099582 None] Lock "cinder-0073a3b8-7a95-4c30-9659-d9ce24a91470-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:02:51 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4b23c1-7f64-4e3a-9848-d45c5e06f7ec]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:02:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8b1c2aba-d6df-43db-8a2c-fbb5db00398e tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d044040c-8f74-45b0-9213-67157b97658e.ff75a9f0-0df1-4da0-81d7-5de7ed053366 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:51 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-69072460-3889-458d-a6e0-c8a26e0a7d3d tempest-ProjectReaderTests-1480099582 None] Acquiring lock "cinder-quobyte-0073a3b8-7a95-4c30-9659-d9ce24a91470" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:02:51 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-69072460-3889-458d-a6e0-c8a26e0a7d3d tempest-ProjectReaderTests-1480099582 None] Lock "cinder-quobyte-0073a3b8-7a95-4c30-9659-d9ce24a91470" acquired by "delete_volume" :: waited 0.015s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:02:51 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a02e72-0e56-400e-acef-ee637012374b]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:02:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-69072460-3889-458d-a6e0-c8a26e0a7d3d tempest-ProjectReaderTests-1480099582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0073a3b8-7a95-4c30-9659-d9ce24a91470 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:51 devstack sudo[129223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d044040c-8f74-45b0-9213-67157b97658e.ff75a9f0-0df1-4da0-81d7-5de7ed053366 Sep 08 07:02:51 devstack sudo[129223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:51 devstack sudo[129227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0073a3b8-7a95-4c30-9659-d9ce24a91470 Sep 08 07:02:51 devstack sudo[129227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:51 devstack sudo[129223]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8b1c2aba-d6df-43db-8a2c-fbb5db00398e tempest-ProjectMemberTests-411164925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d044040c-8f74-45b0-9213-67157b97658e.ff75a9f0-0df1-4da0-81d7-5de7ed053366" returned: 0 in 0.370s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:51 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-8b1c2aba-d6df-43db-8a2c-fbb5db00398e tempest-ProjectMemberTests-411164925 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d044040c-8f74-45b0-9213-67157b97658e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87507) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 07:02:51 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4bca63e-a8f8-497e-a4ca-cf5b32bd340e]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:02:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8b1c2aba-d6df-43db-8a2c-fbb5db00398e tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d044040c-8f74-45b0-9213-67157b97658e {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:51 devstack sudo[129227]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-69072460-3889-458d-a6e0-c8a26e0a7d3d tempest-ProjectReaderTests-1480099582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0073a3b8-7a95-4c30-9659-d9ce24a91470" returned: 0 in 0.363s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:51 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-69072460-3889-458d-a6e0-c8a26e0a7d3d tempest-ProjectReaderTests-1480099582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0073a3b8-7a95-4c30-9659-d9ce24a91470 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:51 devstack sudo[129246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0073a3b8-7a95-4c30-9659-d9ce24a91470 Sep 08 07:02:51 devstack sudo[129246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:51 devstack sudo[129245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d044040c-8f74-45b0-9213-67157b97658e Sep 08 07:02:51 devstack sudo[129245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:52 devstack sudo[129246]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-69072460-3889-458d-a6e0-c8a26e0a7d3d tempest-ProjectReaderTests-1480099582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-0073a3b8-7a95-4c30-9659-d9ce24a91470" returned: 0 in 0.249s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:52 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-69072460-3889-458d-a6e0-c8a26e0a7d3d tempest-ProjectReaderTests-1480099582 None] Lock "cinder-quobyte-0073a3b8-7a95-4c30-9659-d9ce24a91470" released by "delete_volume" :: held 0.655s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:02:52 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-69072460-3889-458d-a6e0-c8a26e0a7d3d tempest-ProjectReaderTests-1480099582 None] Created reservations ['1de722cf-323e-4a13-9307-e697e433f5c2', '5c66e470-3d11-4503-908a-bb0f501abc2d', '548e3546-1579-4799-8978-4e71abc3a738', '54686bbf-18f8-4894-9952-b7624296ffc9'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:02:52 devstack sudo[129245]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8b1c2aba-d6df-43db-8a2c-fbb5db00398e tempest-ProjectMemberTests-411164925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d044040c-8f74-45b0-9213-67157b97658e" returned: 0 in 0.369s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8b1c2aba-d6df-43db-8a2c-fbb5db00398e tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d044040c-8f74-45b0-9213-67157b97658e.ff75a9f0-0df1-4da0-81d7-5de7ed053366 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:52 devstack sudo[129265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d044040c-8f74-45b0-9213-67157b97658e.ff75a9f0-0df1-4da0-81d7-5de7ed053366 Sep 08 07:02:52 devstack sudo[129265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-69072460-3889-458d-a6e0-c8a26e0a7d3d tempest-ProjectReaderTests-1480099582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:02:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-69072460-3889-458d-a6e0-c8a26e0a7d3d tempest-ProjectReaderTests-1480099582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:02:52 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-69072460-3889-458d-a6e0-c8a26e0a7d3d tempest-ProjectReaderTests-1480099582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:02:52 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-69072460-3889-458d-a6e0-c8a26e0a7d3d tempest-ProjectReaderTests-1480099582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:02:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-69072460-3889-458d-a6e0-c8a26e0a7d3d tempest-ProjectReaderTests-1480099582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:02:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-69072460-3889-458d-a6e0-c8a26e0a7d3d tempest-ProjectReaderTests-1480099582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:52 devstack sudo[129268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 07:02:52 devstack sudo[129268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:52 devstack sudo[129265]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:52 devstack sudo[129268]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8b1c2aba-d6df-43db-8a2c-fbb5db00398e tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d044040c-8f74-45b0-9213-67157b97658e.ff75a9f0-0df1-4da0-81d7-5de7ed053366" returned: 0 in 0.368s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8b1c2aba-d6df-43db-8a2c-fbb5db00398e tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d044040c-8f74-45b0-9213-67157b97658e.ff75a9f0-0df1-4da0-81d7-5de7ed053366 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-69072460-3889-458d-a6e0-c8a26e0a7d3d tempest-ProjectReaderTests-1480099582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.294s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:52 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-69072460-3889-458d-a6e0-c8a26e0a7d3d tempest-ProjectReaderTests-1480099582 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:02:52 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-69072460-3889-458d-a6e0-c8a26e0a7d3d tempest-ProjectReaderTests-1480099582 None] Deleted volume successfully. Sep 08 07:02:52 devstack sudo[129283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d044040c-8f74-45b0-9213-67157b97658e.ff75a9f0-0df1-4da0-81d7-5de7ed053366 Sep 08 07:02:52 devstack sudo[129283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:52 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-69072460-3889-458d-a6e0-c8a26e0a7d3d tempest-ProjectReaderTests-1480099582 None] Lock "cinder-0073a3b8-7a95-4c30-9659-d9ce24a91470-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:02:52 devstack sudo[129283]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:52 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8b1c2aba-d6df-43db-8a2c-fbb5db00398e tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d044040c-8f74-45b0-9213-67157b97658e.ff75a9f0-0df1-4da0-81d7-5de7ed053366" returned: 0 in 0.272s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:52 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-8b1c2aba-d6df-43db-8a2c-fbb5db00398e tempest-ProjectMemberTests-411164925 None] Lock "cinder-quobyte-ff75a9f0-0df1-4da0-81d7-5de7ed053366" released by "_delete_snapshot" :: held 1.483s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:02:52 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-8b1c2aba-d6df-43db-8a2c-fbb5db00398e tempest-ProjectMemberTests-411164925 None] Lock "cinder-quobyte-d044040c-8f74-45b0-9213-67157b97658e" released by "delete_snapshot" :: held 1.520s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:02:52 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-8b1c2aba-d6df-43db-8a2c-fbb5db00398e tempest-ProjectMemberTests-411164925 None] Created reservations ['718f76d4-e9a6-4987-862d-c5fa19ad0ca5', 'c97bf104-e996-4628-9d51-4123fa5a70f8', '66c915c7-1564-42db-bd78-25d96a0fdd92', '595dc99a-7dcc-435e-a51e-63e951f0d4c9'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:02:53 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-8b1c2aba-d6df-43db-8a2c-fbb5db00398e tempest-ProjectMemberTests-411164925 None] Delete snapshot completed successfully. Sep 08 07:02:53 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-8b1c2aba-d6df-43db-8a2c-fbb5db00398e tempest-ProjectMemberTests-411164925 None] Lock "cinder-ff75a9f0-0df1-4da0-81d7-5de7ed053366-delete_snapshot" released by "delete_snapshot" :: held 1.663s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:02:53 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3757180-3120-4a25-ad6d-255b3018e4a8 tempest-ProjectReaderTests-1480099582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:02:53 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a3757180-3120-4a25-ad6d-255b3018e4a8 tempest-ProjectReaderTests-1480099582 None] Flow 'volume_create_manager' (3c30645a-bcc5-4671-b5b2-12b63e6594d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:02:53 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a3757180-3120-4a25-ad6d-255b3018e4a8 tempest-ProjectReaderTests-1480099582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db9b8345-d5be-4618-9f69-77d614676b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:53 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a3757180-3120-4a25-ad6d-255b3018e4a8 tempest-ProjectReaderTests-1480099582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db9b8345-d5be-4618-9f69-77d614676b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:02:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1598654519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e6f4f30-07c6-49ca-9d7e-27f1db877867,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4772b6dc45c4c50a1d46113fafb3720',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:02:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:02:53Z,use_quota=True,user_id='6881a92c05fb4c2aaa59a6cc9a688449',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:53 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a3757180-3120-4a25-ad6d-255b3018e4a8 tempest-ProjectReaderTests-1480099582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd593786-87eb-4d4f-824b-47c791c21aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:53 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a3757180-3120-4a25-ad6d-255b3018e4a8 tempest-ProjectReaderTests-1480099582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd593786-87eb-4d4f-824b-47c791c21aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:53 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a3757180-3120-4a25-ad6d-255b3018e4a8 tempest-ProjectReaderTests-1480099582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de9281db-d2f0-49f0-90ad-3e4c5ca5d72d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:53 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a3757180-3120-4a25-ad6d-255b3018e4a8 tempest-ProjectReaderTests-1480099582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de9281db-d2f0-49f0-90ad-3e4c5ca5d72d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e6f4f30-07c6-49ca-9d7e-27f1db877867', 'volume_name': 'volume-2e6f4f30-07c6-49ca-9d7e-27f1db877867', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:53 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a3757180-3120-4a25-ad6d-255b3018e4a8 tempest-ProjectReaderTests-1480099582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cae19016-3fb3-4d66-9de0-eb837d7ff699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:53 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a3757180-3120-4a25-ad6d-255b3018e4a8 tempest-ProjectReaderTests-1480099582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cae19016-3fb3-4d66-9de0-eb837d7ff699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:53 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a3757180-3120-4a25-ad6d-255b3018e4a8 tempest-ProjectReaderTests-1480099582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef28dcf3-2b80-4f76-9def-1d565066ce4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:53 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-a3757180-3120-4a25-ad6d-255b3018e4a8 tempest-ProjectReaderTests-1480099582 None] Volume 2e6f4f30-07c6-49ca-9d7e-27f1db877867: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e6f4f30-07c6-49ca-9d7e-27f1db877867', 'volume_size': 1} Sep 08 07:02:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a3757180-3120-4a25-ad6d-255b3018e4a8 tempest-ProjectReaderTests-1480099582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:02:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a3757180-3120-4a25-ad6d-255b3018e4a8 tempest-ProjectReaderTests-1480099582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:02:53 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-a3757180-3120-4a25-ad6d-255b3018e4a8 tempest-ProjectReaderTests-1480099582 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:02:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1598654519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e6f4f30-07c6-49ca-9d7e-27f1db877867,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4772b6dc45c4c50a1d46113fafb3720',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:02:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:02:53Z,use_quota=True,user_id='6881a92c05fb4c2aaa59a6cc9a688449',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:02:53 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-a3757180-3120-4a25-ad6d-255b3018e4a8 tempest-ProjectReaderTests-1480099582 None] Creating volume 2e6f4f30-07c6-49ca-9d7e-27f1db877867 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:02:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a3757180-3120-4a25-ad6d-255b3018e4a8 tempest-ProjectReaderTests-1480099582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:02:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a3757180-3120-4a25-ad6d-255b3018e4a8 tempest-ProjectReaderTests-1480099582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:02:53 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-a3757180-3120-4a25-ad6d-255b3018e4a8 tempest-ProjectReaderTests-1480099582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:02:53 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-a3757180-3120-4a25-ad6d-255b3018e4a8 tempest-ProjectReaderTests-1480099582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:02:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a3757180-3120-4a25-ad6d-255b3018e4a8 tempest-ProjectReaderTests-1480099582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:02:53 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-a3757180-3120-4a25-ad6d-255b3018e4a8 tempest-ProjectReaderTests-1480099582 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:02:53 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-a3757180-3120-4a25-ad6d-255b3018e4a8 tempest-ProjectReaderTests-1480099582 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 07:02:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a3757180-3120-4a25-ad6d-255b3018e4a8 tempest-ProjectReaderTests-1480099582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2e6f4f30-07c6-49ca-9d7e-27f1db877867 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:53 devstack sudo[129301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2e6f4f30-07c6-49ca-9d7e-27f1db877867 1073741824 Sep 08 07:02:53 devstack sudo[129301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:53 devstack sudo[129301]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:53 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-033e54db-cd76-42b2-b18c-5471c4c335ab tempest-ProjectMemberTests-411164925 None] Acquiring lock "cinder-d044040c-8f74-45b0-9213-67157b97658e-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:02:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a3757180-3120-4a25-ad6d-255b3018e4a8 tempest-ProjectReaderTests-1480099582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2e6f4f30-07c6-49ca-9d7e-27f1db877867 1073741824" returned: 0 in 0.428s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:53 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-033e54db-cd76-42b2-b18c-5471c4c335ab tempest-ProjectMemberTests-411164925 None] Lock "cinder-d044040c-8f74-45b0-9213-67157b97658e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:02:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a3757180-3120-4a25-ad6d-255b3018e4a8 tempest-ProjectReaderTests-1480099582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2e6f4f30-07c6-49ca-9d7e-27f1db877867 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:53 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-033e54db-cd76-42b2-b18c-5471c4c335ab tempest-ProjectMemberTests-411164925 None] Acquiring lock "cinder-quobyte-d044040c-8f74-45b0-9213-67157b97658e" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:02:53 devstack sudo[129322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2e6f4f30-07c6-49ca-9d7e-27f1db877867 Sep 08 07:02:53 devstack sudo[129322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:53 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-033e54db-cd76-42b2-b18c-5471c4c335ab tempest-ProjectMemberTests-411164925 None] Lock "cinder-quobyte-d044040c-8f74-45b0-9213-67157b97658e" acquired by "delete_volume" :: waited 0.020s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:02:53 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f1ed5d-7766-4b32-b42a-bed9710949c1]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:02:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-033e54db-cd76-42b2-b18c-5471c4c335ab tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d044040c-8f74-45b0-9213-67157b97658e {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:53 devstack sudo[129327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d044040c-8f74-45b0-9213-67157b97658e Sep 08 07:02:53 devstack sudo[129327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:53 devstack sudo[129322]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-a3757180-3120-4a25-ad6d-255b3018e4a8 tempest-ProjectReaderTests-1480099582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2e6f4f30-07c6-49ca-9d7e-27f1db877867" returned: 0 in 0.253s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:53 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-a3757180-3120-4a25-ad6d-255b3018e4a8 tempest-ProjectReaderTests-1480099582 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:02:53 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-a3757180-3120-4a25-ad6d-255b3018e4a8 tempest-ProjectReaderTests-1480099582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:02:53 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a3757180-3120-4a25-ad6d-255b3018e4a8 tempest-ProjectReaderTests-1480099582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef28dcf3-2b80-4f76-9def-1d565066ce4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e6f4f30-07c6-49ca-9d7e-27f1db877867', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:53 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a3757180-3120-4a25-ad6d-255b3018e4a8 tempest-ProjectReaderTests-1480099582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d4ce7a7-c14f-466b-a9e9-08722c9fa2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:02:53 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-a3757180-3120-4a25-ad6d-255b3018e4a8 tempest-ProjectReaderTests-1480099582 None] Volume volume-2e6f4f30-07c6-49ca-9d7e-27f1db877867 (2e6f4f30-07c6-49ca-9d7e-27f1db877867): created successfully Sep 08 07:02:53 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a3757180-3120-4a25-ad6d-255b3018e4a8 tempest-ProjectReaderTests-1480099582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d4ce7a7-c14f-466b-a9e9-08722c9fa2f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:02:53 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-a3757180-3120-4a25-ad6d-255b3018e4a8 tempest-ProjectReaderTests-1480099582 None] Flow 'volume_create_manager' (3c30645a-bcc5-4671-b5b2-12b63e6594d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:02:53 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-a3757180-3120-4a25-ad6d-255b3018e4a8 tempest-ProjectReaderTests-1480099582 None] Created volume successfully. Sep 08 07:02:54 devstack sudo[129327]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-033e54db-cd76-42b2-b18c-5471c4c335ab tempest-ProjectMemberTests-411164925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d044040c-8f74-45b0-9213-67157b97658e" returned: 0 in 0.374s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-033e54db-cd76-42b2-b18c-5471c4c335ab tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d044040c-8f74-45b0-9213-67157b97658e {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:54 devstack sudo[129345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d044040c-8f74-45b0-9213-67157b97658e Sep 08 07:02:54 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-e38524f3-810b-425e-84e3-f2de9f16fe68 tempest-ProjectReaderTests-1480099582 None] Acquiring lock "cinder-2e6f4f30-07c6-49ca-9d7e-27f1db877867-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:02:54 devstack sudo[129345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:54 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-e38524f3-810b-425e-84e3-f2de9f16fe68 tempest-ProjectReaderTests-1480099582 None] Lock "cinder-2e6f4f30-07c6-49ca-9d7e-27f1db877867-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:02:54 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-e38524f3-810b-425e-84e3-f2de9f16fe68 tempest-ProjectReaderTests-1480099582 None] Acquiring lock "cinder-quobyte-2e6f4f30-07c6-49ca-9d7e-27f1db877867" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:02:54 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-e38524f3-810b-425e-84e3-f2de9f16fe68 tempest-ProjectReaderTests-1480099582 None] Lock "cinder-quobyte-2e6f4f30-07c6-49ca-9d7e-27f1db877867" acquired by "delete_volume" :: waited 0.019s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:02:54 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[725b61e0-d3eb-43b7-9ffa-249e4cd29730]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:02:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e38524f3-810b-425e-84e3-f2de9f16fe68 tempest-ProjectReaderTests-1480099582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2e6f4f30-07c6-49ca-9d7e-27f1db877867 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:54 devstack sudo[129350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2e6f4f30-07c6-49ca-9d7e-27f1db877867 Sep 08 07:02:54 devstack sudo[129350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:54 devstack sudo[129345]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-033e54db-cd76-42b2-b18c-5471c4c335ab tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-d044040c-8f74-45b0-9213-67157b97658e" returned: 0 in 0.275s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:54 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-033e54db-cd76-42b2-b18c-5471c4c335ab tempest-ProjectMemberTests-411164925 None] Lock "cinder-quobyte-d044040c-8f74-45b0-9213-67157b97658e" released by "delete_volume" :: held 0.713s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:02:54 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-033e54db-cd76-42b2-b18c-5471c4c335ab tempest-ProjectMemberTests-411164925 None] Created reservations ['7aeb4db6-f8ff-46e7-b55b-4631982c5c34', '5a05b7d3-1292-45bb-9caf-1949b43be57a', 'b9aeae54-d8e5-4755-898a-561ae01aa536', 'c7f91070-922e-4837-86c9-d90649dd876c'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:02:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-033e54db-cd76-42b2-b18c-5471c4c335ab tempest-ProjectMemberTests-411164925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:02:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-033e54db-cd76-42b2-b18c-5471c4c335ab tempest-ProjectMemberTests-411164925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:02:54 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-033e54db-cd76-42b2-b18c-5471c4c335ab tempest-ProjectMemberTests-411164925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:02:54 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-033e54db-cd76-42b2-b18c-5471c4c335ab tempest-ProjectMemberTests-411164925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:02:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-033e54db-cd76-42b2-b18c-5471c4c335ab tempest-ProjectMemberTests-411164925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:02:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-033e54db-cd76-42b2-b18c-5471c4c335ab tempest-ProjectMemberTests-411164925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:54 devstack sudo[129362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 07:02:54 devstack sudo[129362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:54 devstack sudo[129350]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e38524f3-810b-425e-84e3-f2de9f16fe68 tempest-ProjectReaderTests-1480099582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2e6f4f30-07c6-49ca-9d7e-27f1db877867" returned: 0 in 0.385s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e38524f3-810b-425e-84e3-f2de9f16fe68 tempest-ProjectReaderTests-1480099582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2e6f4f30-07c6-49ca-9d7e-27f1db877867 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:54 devstack sudo[129370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2e6f4f30-07c6-49ca-9d7e-27f1db877867 Sep 08 07:02:54 devstack sudo[129370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:54 devstack sudo[129362]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-033e54db-cd76-42b2-b18c-5471c4c335ab tempest-ProjectMemberTests-411164925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.266s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:54 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-033e54db-cd76-42b2-b18c-5471c4c335ab tempest-ProjectMemberTests-411164925 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:02:54 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-033e54db-cd76-42b2-b18c-5471c4c335ab tempest-ProjectMemberTests-411164925 None] Deleted volume successfully. Sep 08 07:02:54 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-033e54db-cd76-42b2-b18c-5471c4c335ab tempest-ProjectMemberTests-411164925 None] Lock "cinder-d044040c-8f74-45b0-9213-67157b97658e-delete_volume" released by "delete_volume" :: held 1.214s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:02:54 devstack sudo[129370]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e38524f3-810b-425e-84e3-f2de9f16fe68 tempest-ProjectReaderTests-1480099582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-2e6f4f30-07c6-49ca-9d7e-27f1db877867" returned: 0 in 0.269s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:54 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-e38524f3-810b-425e-84e3-f2de9f16fe68 tempest-ProjectReaderTests-1480099582 None] Lock "cinder-quobyte-2e6f4f30-07c6-49ca-9d7e-27f1db877867" released by "delete_volume" :: held 0.708s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:02:54 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-e38524f3-810b-425e-84e3-f2de9f16fe68 tempest-ProjectReaderTests-1480099582 None] Created reservations ['17cd1e68-af88-48b5-88c7-8d5eb1b2a7d8', '3ad14bc7-006f-486f-8257-db143d1a0491', 'e79d2a80-934c-42fa-ab8c-0c56152c60de', '5ee1b821-68ad-4aca-9560-c3bd3d3cda87'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:02:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-e38524f3-810b-425e-84e3-f2de9f16fe68 tempest-ProjectReaderTests-1480099582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:02:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-e38524f3-810b-425e-84e3-f2de9f16fe68 tempest-ProjectReaderTests-1480099582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:02:54 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-e38524f3-810b-425e-84e3-f2de9f16fe68 tempest-ProjectReaderTests-1480099582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:02:54 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-e38524f3-810b-425e-84e3-f2de9f16fe68 tempest-ProjectReaderTests-1480099582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:02:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-e38524f3-810b-425e-84e3-f2de9f16fe68 tempest-ProjectReaderTests-1480099582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:02:54 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e38524f3-810b-425e-84e3-f2de9f16fe68 tempest-ProjectReaderTests-1480099582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:02:54 devstack sudo[129386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 07:02:55 devstack sudo[129386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:02:55 devstack sudo[129386]: pam_unix(sudo:session): session closed for user root Sep 08 07:02:55 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-e38524f3-810b-425e-84e3-f2de9f16fe68 tempest-ProjectReaderTests-1480099582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.269s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:02:55 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-e38524f3-810b-425e-84e3-f2de9f16fe68 tempest-ProjectReaderTests-1480099582 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:02:55 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-e38524f3-810b-425e-84e3-f2de9f16fe68 tempest-ProjectReaderTests-1480099582 None] Deleted volume successfully. Sep 08 07:02:55 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-e38524f3-810b-425e-84e3-f2de9f16fe68 tempest-ProjectReaderTests-1480099582 None] Lock "cinder-2e6f4f30-07c6-49ca-9d7e-27f1db877867-delete_volume" released by "delete_volume" :: held 1.192s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:03:07 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c12b39b-ec85-41b2-bc95-0372b9890cb4 tempest-ProjectReaderTests-1507555715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:03:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6c12b39b-ec85-41b2-bc95-0372b9890cb4 tempest-ProjectReaderTests-1507555715 None] Flow 'volume_create_manager' (874a0e59-c563-4ca9-8c51-1e459fbac090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:03:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6c12b39b-ec85-41b2-bc95-0372b9890cb4 tempest-ProjectReaderTests-1507555715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fad7a646-9721-440c-97f8-30a90af85f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:03:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6c12b39b-ec85-41b2-bc95-0372b9890cb4 tempest-ProjectReaderTests-1507555715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fad7a646-9721-440c-97f8-30a90af85f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:03:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-559371266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28ec4db3-a95d-4990-bd52-d6ea4a8057d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d60b82682b1485aa8637e353ca2230b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:03:07Z,use_quota=True,user_id='d2d0a7fa78ae41b8880ee231f5256af4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:03:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6c12b39b-ec85-41b2-bc95-0372b9890cb4 tempest-ProjectReaderTests-1507555715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acf92013-1fdc-4235-84f8-33f51d59bd44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:03:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6c12b39b-ec85-41b2-bc95-0372b9890cb4 tempest-ProjectReaderTests-1507555715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acf92013-1fdc-4235-84f8-33f51d59bd44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:03:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6c12b39b-ec85-41b2-bc95-0372b9890cb4 tempest-ProjectReaderTests-1507555715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (006eec74-c88c-428a-9384-1554b9b9517b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:03:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6c12b39b-ec85-41b2-bc95-0372b9890cb4 tempest-ProjectReaderTests-1507555715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (006eec74-c88c-428a-9384-1554b9b9517b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28ec4db3-a95d-4990-bd52-d6ea4a8057d5', 'volume_name': 'volume-28ec4db3-a95d-4990-bd52-d6ea4a8057d5', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:03:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6c12b39b-ec85-41b2-bc95-0372b9890cb4 tempest-ProjectReaderTests-1507555715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaf40243-f2bb-4c4e-9a55-ee1d2b9b1dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:03:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6c12b39b-ec85-41b2-bc95-0372b9890cb4 tempest-ProjectReaderTests-1507555715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaf40243-f2bb-4c4e-9a55-ee1d2b9b1dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:03:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6c12b39b-ec85-41b2-bc95-0372b9890cb4 tempest-ProjectReaderTests-1507555715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af19729f-a76b-482d-aab5-62610d275016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:03:07 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-6c12b39b-ec85-41b2-bc95-0372b9890cb4 tempest-ProjectReaderTests-1507555715 None] Volume 28ec4db3-a95d-4990-bd52-d6ea4a8057d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28ec4db3-a95d-4990-bd52-d6ea4a8057d5', 'volume_size': 1} Sep 08 07:03:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-6c12b39b-ec85-41b2-bc95-0372b9890cb4 tempest-ProjectReaderTests-1507555715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:03:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-6c12b39b-ec85-41b2-bc95-0372b9890cb4 tempest-ProjectReaderTests-1507555715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:03:07 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-6c12b39b-ec85-41b2-bc95-0372b9890cb4 tempest-ProjectReaderTests-1507555715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:03:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-559371266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28ec4db3-a95d-4990-bd52-d6ea4a8057d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d60b82682b1485aa8637e353ca2230b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:03:07Z,use_quota=True,user_id='d2d0a7fa78ae41b8880ee231f5256af4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:03:07 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-6c12b39b-ec85-41b2-bc95-0372b9890cb4 tempest-ProjectReaderTests-1507555715 None] Creating volume 28ec4db3-a95d-4990-bd52-d6ea4a8057d5 {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:03:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-6c12b39b-ec85-41b2-bc95-0372b9890cb4 tempest-ProjectReaderTests-1507555715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:03:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-6c12b39b-ec85-41b2-bc95-0372b9890cb4 tempest-ProjectReaderTests-1507555715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:03:07 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-6c12b39b-ec85-41b2-bc95-0372b9890cb4 tempest-ProjectReaderTests-1507555715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:03:07 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-6c12b39b-ec85-41b2-bc95-0372b9890cb4 tempest-ProjectReaderTests-1507555715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:03:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-6c12b39b-ec85-41b2-bc95-0372b9890cb4 tempest-ProjectReaderTests-1507555715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:03:07 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-6c12b39b-ec85-41b2-bc95-0372b9890cb4 tempest-ProjectReaderTests-1507555715 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:03:07 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-6c12b39b-ec85-41b2-bc95-0372b9890cb4 tempest-ProjectReaderTests-1507555715 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 07:03:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6c12b39b-ec85-41b2-bc95-0372b9890cb4 tempest-ProjectReaderTests-1507555715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-28ec4db3-a95d-4990-bd52-d6ea4a8057d5 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:03:07 devstack sudo[129756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-28ec4db3-a95d-4990-bd52-d6ea4a8057d5 1073741824 Sep 08 07:03:07 devstack sudo[129756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:03:07 devstack sudo[129756]: pam_unix(sudo:session): session closed for user root Sep 08 07:03:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6c12b39b-ec85-41b2-bc95-0372b9890cb4 tempest-ProjectReaderTests-1507555715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-28ec4db3-a95d-4990-bd52-d6ea4a8057d5 1073741824" returned: 0 in 0.407s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:03:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6c12b39b-ec85-41b2-bc95-0372b9890cb4 tempest-ProjectReaderTests-1507555715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-28ec4db3-a95d-4990-bd52-d6ea4a8057d5 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:03:07 devstack sudo[129776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-28ec4db3-a95d-4990-bd52-d6ea4a8057d5 Sep 08 07:03:07 devstack sudo[129776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:03:07 devstack sudo[129776]: pam_unix(sudo:session): session closed for user root Sep 08 07:03:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-6c12b39b-ec85-41b2-bc95-0372b9890cb4 tempest-ProjectReaderTests-1507555715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-28ec4db3-a95d-4990-bd52-d6ea4a8057d5" returned: 0 in 0.234s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:03:07 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-6c12b39b-ec85-41b2-bc95-0372b9890cb4 tempest-ProjectReaderTests-1507555715 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:03:07 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-6c12b39b-ec85-41b2-bc95-0372b9890cb4 tempest-ProjectReaderTests-1507555715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:03:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6c12b39b-ec85-41b2-bc95-0372b9890cb4 tempest-ProjectReaderTests-1507555715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af19729f-a76b-482d-aab5-62610d275016) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28ec4db3-a95d-4990-bd52-d6ea4a8057d5', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:03:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6c12b39b-ec85-41b2-bc95-0372b9890cb4 tempest-ProjectReaderTests-1507555715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4a10642-5470-4896-b99b-83f2f6d94d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:03:07 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-6c12b39b-ec85-41b2-bc95-0372b9890cb4 tempest-ProjectReaderTests-1507555715 None] Volume volume-28ec4db3-a95d-4990-bd52-d6ea4a8057d5 (28ec4db3-a95d-4990-bd52-d6ea4a8057d5): created successfully Sep 08 07:03:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6c12b39b-ec85-41b2-bc95-0372b9890cb4 tempest-ProjectReaderTests-1507555715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4a10642-5470-4896-b99b-83f2f6d94d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:03:07 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-6c12b39b-ec85-41b2-bc95-0372b9890cb4 tempest-ProjectReaderTests-1507555715 None] Flow 'volume_create_manager' (874a0e59-c563-4ca9-8c51-1e459fbac090) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:03:07 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-6c12b39b-ec85-41b2-bc95-0372b9890cb4 tempest-ProjectReaderTests-1507555715 None] Created volume successfully. Sep 08 07:03:08 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-0f6502da-fdf1-4f26-833e-ba005b0b162d tempest-ProjectReaderTests-1507555715 None] Acquiring lock "cinder-28ec4db3-a95d-4990-bd52-d6ea4a8057d5-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:03:08 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-0f6502da-fdf1-4f26-833e-ba005b0b162d tempest-ProjectReaderTests-1507555715 None] Lock "cinder-28ec4db3-a95d-4990-bd52-d6ea4a8057d5-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:03:08 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-0f6502da-fdf1-4f26-833e-ba005b0b162d tempest-ProjectReaderTests-1507555715 None] Acquiring lock "cinder-quobyte-28ec4db3-a95d-4990-bd52-d6ea4a8057d5" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:03:08 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-0f6502da-fdf1-4f26-833e-ba005b0b162d tempest-ProjectReaderTests-1507555715 None] Lock "cinder-quobyte-28ec4db3-a95d-4990-bd52-d6ea4a8057d5" acquired by "delete_volume" :: waited 0.015s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:03:08 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb73939-effa-4753-9c97-cbcb28aa5d44]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:03:08 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0f6502da-fdf1-4f26-833e-ba005b0b162d tempest-ProjectReaderTests-1507555715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-28ec4db3-a95d-4990-bd52-d6ea4a8057d5 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:03:08 devstack sudo[129801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-28ec4db3-a95d-4990-bd52-d6ea4a8057d5 Sep 08 07:03:08 devstack sudo[129801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:03:08 devstack sudo[129801]: pam_unix(sudo:session): session closed for user root Sep 08 07:03:08 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0f6502da-fdf1-4f26-833e-ba005b0b162d tempest-ProjectReaderTests-1507555715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-28ec4db3-a95d-4990-bd52-d6ea4a8057d5" returned: 0 in 0.361s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:03:08 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0f6502da-fdf1-4f26-833e-ba005b0b162d tempest-ProjectReaderTests-1507555715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-28ec4db3-a95d-4990-bd52-d6ea4a8057d5 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:03:08 devstack sudo[129815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-28ec4db3-a95d-4990-bd52-d6ea4a8057d5 Sep 08 07:03:08 devstack sudo[129815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:03:08 devstack sudo[129815]: pam_unix(sudo:session): session closed for user root Sep 08 07:03:08 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0f6502da-fdf1-4f26-833e-ba005b0b162d tempest-ProjectReaderTests-1507555715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-28ec4db3-a95d-4990-bd52-d6ea4a8057d5" returned: 0 in 0.241s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:03:08 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-0f6502da-fdf1-4f26-833e-ba005b0b162d tempest-ProjectReaderTests-1507555715 None] Lock "cinder-quobyte-28ec4db3-a95d-4990-bd52-d6ea4a8057d5" released by "delete_volume" :: held 0.641s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:03:08 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-0f6502da-fdf1-4f26-833e-ba005b0b162d tempest-ProjectReaderTests-1507555715 None] Created reservations ['3beff450-8d83-4e25-9af2-87afd27548d0', 'e93bf1c6-cf99-4f93-a89e-068b91e35d37', '25517bce-64f8-4153-9846-11817e669e3e', '1ed21b5b-59bf-40b8-abb0-addbd9f343e3'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:03:09 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-0f6502da-fdf1-4f26-833e-ba005b0b162d tempest-ProjectReaderTests-1507555715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:03:09 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-0f6502da-fdf1-4f26-833e-ba005b0b162d tempest-ProjectReaderTests-1507555715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:03:09 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-0f6502da-fdf1-4f26-833e-ba005b0b162d tempest-ProjectReaderTests-1507555715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:03:09 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-0f6502da-fdf1-4f26-833e-ba005b0b162d tempest-ProjectReaderTests-1507555715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:03:09 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-0f6502da-fdf1-4f26-833e-ba005b0b162d tempest-ProjectReaderTests-1507555715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:03:09 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0f6502da-fdf1-4f26-833e-ba005b0b162d tempest-ProjectReaderTests-1507555715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:03:09 devstack sudo[129830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 07:03:09 devstack sudo[129830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:03:09 devstack sudo[129830]: pam_unix(sudo:session): session closed for user root Sep 08 07:03:09 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-0f6502da-fdf1-4f26-833e-ba005b0b162d tempest-ProjectReaderTests-1507555715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.250s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:03:09 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-0f6502da-fdf1-4f26-833e-ba005b0b162d tempest-ProjectReaderTests-1507555715 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:03:09 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-0f6502da-fdf1-4f26-833e-ba005b0b162d tempest-ProjectReaderTests-1507555715 None] Deleted volume successfully. Sep 08 07:03:09 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-0f6502da-fdf1-4f26-833e-ba005b0b162d tempest-ProjectReaderTests-1507555715 None] Lock "cinder-28ec4db3-a95d-4990-bd52-d6ea4a8057d5-delete_volume" released by "delete_volume" :: held 1.080s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:03:09 devstack cinder-volume[87507]: DEBUG cinder.volume.flows.manager.create_volume [None req-73a3d63f-e5c9-435a-a17f-afd0152c727f tempest-ProjectReaderTests-1507555715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87507) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 07:03:09 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-73a3d63f-e5c9-435a-a17f-afd0152c727f tempest-ProjectReaderTests-1507555715 None] Flow 'volume_create_manager' (77ac21d8-80b2-47d1-8c2c-e85a99916650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:03:09 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-73a3d63f-e5c9-435a-a17f-afd0152c727f tempest-ProjectReaderTests-1507555715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03e3c9c8-5c8e-4fb6-9bbe-61466f208861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:03:09 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-73a3d63f-e5c9-435a-a17f-afd0152c727f tempest-ProjectReaderTests-1507555715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03e3c9c8-5c8e-4fb6-9bbe-61466f208861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-842634254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a8ae31d-0984-4e32-a502-27cac945c0fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d60b82682b1485aa8637e353ca2230b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:03:10Z,use_quota=True,user_id='d2d0a7fa78ae41b8880ee231f5256af4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:03:09 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-73a3d63f-e5c9-435a-a17f-afd0152c727f tempest-ProjectReaderTests-1507555715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a18de8d-aa56-4ca4-b48f-247c8cb9cd44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:03:09 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-73a3d63f-e5c9-435a-a17f-afd0152c727f tempest-ProjectReaderTests-1507555715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a18de8d-aa56-4ca4-b48f-247c8cb9cd44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:03:09 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-73a3d63f-e5c9-435a-a17f-afd0152c727f tempest-ProjectReaderTests-1507555715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bbb2516-4018-4801-ab41-c531eca5f60b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:03:09 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-73a3d63f-e5c9-435a-a17f-afd0152c727f tempest-ProjectReaderTests-1507555715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bbb2516-4018-4801-ab41-c531eca5f60b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a8ae31d-0984-4e32-a502-27cac945c0fb', 'volume_name': 'volume-7a8ae31d-0984-4e32-a502-27cac945c0fb', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:03:09 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-73a3d63f-e5c9-435a-a17f-afd0152c727f tempest-ProjectReaderTests-1507555715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59091d98-5c24-4e9b-888b-c1c194e2c93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:03:09 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-73a3d63f-e5c9-435a-a17f-afd0152c727f tempest-ProjectReaderTests-1507555715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59091d98-5c24-4e9b-888b-c1c194e2c93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:03:09 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-73a3d63f-e5c9-435a-a17f-afd0152c727f tempest-ProjectReaderTests-1507555715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22c4dbed-0aa0-4b82-ba80-d1e1ffff229b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:03:09 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-73a3d63f-e5c9-435a-a17f-afd0152c727f tempest-ProjectReaderTests-1507555715 None] Volume 7a8ae31d-0984-4e32-a502-27cac945c0fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a8ae31d-0984-4e32-a502-27cac945c0fb', 'volume_size': 1} Sep 08 07:03:09 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-73a3d63f-e5c9-435a-a17f-afd0152c727f tempest-ProjectReaderTests-1507555715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:03:09 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-73a3d63f-e5c9-435a-a17f-afd0152c727f tempest-ProjectReaderTests-1507555715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:03:09 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-73a3d63f-e5c9-435a-a17f-afd0152c727f tempest-ProjectReaderTests-1507555715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T05:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-842634254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a8ae31d-0984-4e32-a502-27cac945c0fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d60b82682b1485aa8637e353ca2230b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T05:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T05:03:10Z,use_quota=True,user_id='d2d0a7fa78ae41b8880ee231f5256af4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(463a8ae5-c94e-47bc-b9b2-5d3a421cc981),volume_type_id=463a8ae5-c94e-47bc-b9b2-5d3a421cc981)}" {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 07:03:09 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.remotefs [None req-73a3d63f-e5c9-435a-a17f-afd0152c727f tempest-ProjectReaderTests-1507555715 None] Creating volume 7a8ae31d-0984-4e32-a502-27cac945c0fb {{(pid=87507) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 07:03:09 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-73a3d63f-e5c9-435a-a17f-afd0152c727f tempest-ProjectReaderTests-1507555715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:03:09 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-73a3d63f-e5c9-435a-a17f-afd0152c727f tempest-ProjectReaderTests-1507555715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:03:09 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-73a3d63f-e5c9-435a-a17f-afd0152c727f tempest-ProjectReaderTests-1507555715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:03:09 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-73a3d63f-e5c9-435a-a17f-afd0152c727f tempest-ProjectReaderTests-1507555715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:03:09 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-73a3d63f-e5c9-435a-a17f-afd0152c727f tempest-ProjectReaderTests-1507555715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:03:09 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-73a3d63f-e5c9-435a-a17f-afd0152c727f tempest-ProjectReaderTests-1507555715 None] Selected osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d as target Quobyte volume. {{(pid=87507) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 07:03:09 devstack cinder-volume[87507]: INFO cinder.volume.drivers.remotefs [None req-73a3d63f-e5c9-435a-a17f-afd0152c727f tempest-ProjectReaderTests-1507555715 None] casted to osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d Sep 08 07:03:09 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-73a3d63f-e5c9-435a-a17f-afd0152c727f tempest-ProjectReaderTests-1507555715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7a8ae31d-0984-4e32-a502-27cac945c0fb 1073741824 {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:03:09 devstack sudo[129858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7a8ae31d-0984-4e32-a502-27cac945c0fb 1073741824 Sep 08 07:03:09 devstack sudo[129858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:03:10 devstack sudo[129858]: pam_unix(sudo:session): session closed for user root Sep 08 07:03:10 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-73a3d63f-e5c9-435a-a17f-afd0152c727f tempest-ProjectReaderTests-1507555715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7a8ae31d-0984-4e32-a502-27cac945c0fb 1073741824" returned: 0 in 0.419s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:03:10 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-73a3d63f-e5c9-435a-a17f-afd0152c727f tempest-ProjectReaderTests-1507555715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7a8ae31d-0984-4e32-a502-27cac945c0fb {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:03:10 devstack sudo[129878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7a8ae31d-0984-4e32-a502-27cac945c0fb Sep 08 07:03:10 devstack sudo[129878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:03:10 devstack sudo[129878]: pam_unix(sudo:session): session closed for user root Sep 08 07:03:10 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-73a3d63f-e5c9-435a-a17f-afd0152c727f tempest-ProjectReaderTests-1507555715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7a8ae31d-0984-4e32-a502-27cac945c0fb" returned: 0 in 0.239s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:03:10 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-73a3d63f-e5c9-435a-a17f-afd0152c727f tempest-ProjectReaderTests-1507555715 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'} {{(pid=87507) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 07:03:10 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-73a3d63f-e5c9-435a-a17f-afd0152c727f tempest-ProjectReaderTests-1507555715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:03:10 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-73a3d63f-e5c9-435a-a17f-afd0152c727f tempest-ProjectReaderTests-1507555715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22c4dbed-0aa0-4b82-ba80-d1e1ffff229b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a8ae31d-0984-4e32-a502-27cac945c0fb', 'volume_size': 1}' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:03:10 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-73a3d63f-e5c9-435a-a17f-afd0152c727f tempest-ProjectReaderTests-1507555715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1ab2edf-be8c-4480-a54a-509b3ffe8ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 07:03:10 devstack cinder-volume[87507]: INFO cinder.volume.flows.manager.create_volume [None req-73a3d63f-e5c9-435a-a17f-afd0152c727f tempest-ProjectReaderTests-1507555715 None] Volume volume-7a8ae31d-0984-4e32-a502-27cac945c0fb (7a8ae31d-0984-4e32-a502-27cac945c0fb): created successfully Sep 08 07:03:10 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-73a3d63f-e5c9-435a-a17f-afd0152c727f tempest-ProjectReaderTests-1507555715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1ab2edf-be8c-4480-a54a-509b3ffe8ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87507) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 07:03:10 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-73a3d63f-e5c9-435a-a17f-afd0152c727f tempest-ProjectReaderTests-1507555715 None] Flow 'volume_create_manager' (77ac21d8-80b2-47d1-8c2c-e85a99916650) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87507) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 07:03:10 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-73a3d63f-e5c9-435a-a17f-afd0152c727f tempest-ProjectReaderTests-1507555715 None] Created volume successfully. Sep 08 07:03:10 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-7ae4826b-e735-44ae-8d5d-0a2aebf1e252 tempest-ProjectReaderTests-1507555715 None] Acquiring lock "cinder-7a8ae31d-0984-4e32-a502-27cac945c0fb-delete_volume" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:03:10 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-7ae4826b-e735-44ae-8d5d-0a2aebf1e252 tempest-ProjectReaderTests-1507555715 None] Lock "cinder-7a8ae31d-0984-4e32-a502-27cac945c0fb-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:03:10 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-7ae4826b-e735-44ae-8d5d-0a2aebf1e252 tempest-ProjectReaderTests-1507555715 None] Acquiring lock "cinder-quobyte-7a8ae31d-0984-4e32-a502-27cac945c0fb" by "delete_volume" {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 07:03:10 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-7ae4826b-e735-44ae-8d5d-0a2aebf1e252 tempest-ProjectReaderTests-1507555715 None] Lock "cinder-quobyte-7a8ae31d-0984-4e32-a502-27cac945c0fb" acquired by "delete_volume" :: waited 0.016s {{(pid=87507) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 07:03:10 devstack cinder-volume[87507]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b2a7e6-a3c7-4a87-9e05-ebcc8c8194b9]: (4, 'qcow2') {{(pid=88698) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 07:03:10 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7ae4826b-e735-44ae-8d5d-0a2aebf1e252 tempest-ProjectReaderTests-1507555715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7a8ae31d-0984-4e32-a502-27cac945c0fb {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:03:11 devstack sudo[129899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7a8ae31d-0984-4e32-a502-27cac945c0fb Sep 08 07:03:11 devstack sudo[129899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:03:11 devstack sudo[129899]: pam_unix(sudo:session): session closed for user root Sep 08 07:03:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7ae4826b-e735-44ae-8d5d-0a2aebf1e252 tempest-ProjectReaderTests-1507555715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7a8ae31d-0984-4e32-a502-27cac945c0fb" returned: 0 in 0.350s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:03:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7ae4826b-e735-44ae-8d5d-0a2aebf1e252 tempest-ProjectReaderTests-1507555715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7a8ae31d-0984-4e32-a502-27cac945c0fb {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:03:11 devstack sudo[129913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7a8ae31d-0984-4e32-a502-27cac945c0fb Sep 08 07:03:11 devstack sudo[129913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:03:11 devstack sudo[129913]: pam_unix(sudo:session): session closed for user root Sep 08 07:03:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7ae4826b-e735-44ae-8d5d-0a2aebf1e252 tempest-ProjectReaderTests-1507555715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd/volume-7a8ae31d-0984-4e32-a502-27cac945c0fb" returned: 0 in 0.243s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:03:11 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-7ae4826b-e735-44ae-8d5d-0a2aebf1e252 tempest-ProjectReaderTests-1507555715 None] Lock "cinder-quobyte-7a8ae31d-0984-4e32-a502-27cac945c0fb" released by "delete_volume" :: held 0.629s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:03:11 devstack cinder-volume[87507]: DEBUG cinder.quota [None req-7ae4826b-e735-44ae-8d5d-0a2aebf1e252 tempest-ProjectReaderTests-1507555715 None] Created reservations ['414507ed-7389-424a-a4b6-53550cfcb43c', 'cfab3685-bf03-4390-93ea-5edfa95cb65f', '67e9e5ea-8ea5-4801-9e63-a57f194f724c', '3e87fa9c-3884-49d0-a073-b33a031cc88e'] {{(pid=87507) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 07:03:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-7ae4826b-e735-44ae-8d5d-0a2aebf1e252 tempest-ProjectReaderTests-1507555715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:03:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-7ae4826b-e735-44ae-8d5d-0a2aebf1e252 tempest-ProjectReaderTests-1507555715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:03:11 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-7ae4826b-e735-44ae-8d5d-0a2aebf1e252 tempest-ProjectReaderTests-1507555715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:03:11 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-7ae4826b-e735-44ae-8d5d-0a2aebf1e252 tempest-ProjectReaderTests-1507555715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:03:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-7ae4826b-e735-44ae-8d5d-0a2aebf1e252 tempest-ProjectReaderTests-1507555715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:03:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7ae4826b-e735-44ae-8d5d-0a2aebf1e252 tempest-ProjectReaderTests-1507555715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:03:11 devstack sudo[129928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 07:03:11 devstack sudo[129928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:03:11 devstack sudo[129928]: pam_unix(sudo:session): session closed for user root Sep 08 07:03:11 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-7ae4826b-e735-44ae-8d5d-0a2aebf1e252 tempest-ProjectReaderTests-1507555715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.240s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:03:11 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-7ae4826b-e735-44ae-8d5d-0a2aebf1e252 tempest-ProjectReaderTests-1507555715 None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:03:11 devstack cinder-volume[87507]: INFO cinder.volume.manager [None req-7ae4826b-e735-44ae-8d5d-0a2aebf1e252 tempest-ProjectReaderTests-1507555715 None] Deleted volume successfully. Sep 08 07:03:11 devstack cinder-volume[87507]: DEBUG cinder.coordination [None req-7ae4826b-e735-44ae-8d5d-0a2aebf1e252 tempest-ProjectReaderTests-1507555715 None] Lock "cinder-7a8ae31d-0984-4e32-a502-27cac945c0fb-delete_volume" released by "delete_volume" :: held 1.065s {{(pid=87507) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 07:03:20 devstack cinder-volume[87507]: DEBUG oslo_service.periodic_task [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87507) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 07:03:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 07:03:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 07:03:20 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d': None} {{(pid=87507) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 07:03:20 devstack cinder-volume[87507]: DEBUG cinder.volume.drivers.quobyte [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-bb67cde0-ca08-46aa-b58e-e239a7885f6d'] {{(pid=87507) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 07:03:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.lockutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87507) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 07:03:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 07:03:20 devstack sudo[130184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd Sep 08 07:03:20 devstack sudo[130184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 07:03:20 devstack sudo[130184]: pam_unix(sudo:session): session closed for user root Sep 08 07:03:20 devstack cinder-volume[87507]: DEBUG oslo_concurrency.processutils [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a7ef603d028f39ec610166b89070fd" returned: 0 in 0.241s {{(pid=87507) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 07:03:20 devstack cinder-volume[87507]: DEBUG cinder.manager [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Notifying Schedulers of capabilities ... {{(pid=87507) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 07:03:20 devstack cinder-volume[87507]: DEBUG oslo_service.periodic_task [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] Running periodic task VolumeManager._thread_info {{(pid=87507) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 07:03:20 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] thread count: 29 {{(pid=87507) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 07:03:20 devstack cinder-volume[87507]: DEBUG cinder.volume.manager [None req-8684ba76-dd00-4351-8e9b-bee3c119874a None None] thread info: [<_MainThread(MainThread, started 127913129345152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87507) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 07:03:21 devstack cinder-volume[87507]: DEBUG dbcounter [-] [87507] Writing DB stats cinder:SELECT=88,cinder:INSERT=33,cinder:UPDATE=123,cinder:DELETE=11 {{(pid=87507) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 07:03:21 devstack cinder-volume[87507]: DEBUG dbcounter [-] [87507] Writing DB stats cinder:INSERT=33,cinder:UPDATE=141,cinder:SELECT=92,cinder:DELETE=11 {{(pid=87507) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}